JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 11.11.2019, 12:50
wannabee
Guest
 
Posts: n/a
Default JDownloader "invalid download directory" (Google Drive Unlimited Rclone)

Hello guys,

I have running a headless centos 7 server with the jdownloader.jar installed.

I get the error "invalid download directory" when the download directory is set to my mounted gsuite account. When i change the directory to a "real" folder (not just mounted rclone) it works. The permissions are the same.. so that couldnt be the problem. Maybe the jdownloader have problems with the size of the unlimited gsuite drive? It says in the settings menue of myjdownloader 1.13PB total.

This is my log id: jdlog://1850230900751

hope someone can help..
regards:)
Reply With Quote
  #2  
Old 11.11.2019, 15:32
wannabee
Guest
 
Posts: n/a
Default

short update

it´s possible to store the files local on the server and then extract it to the mounted google drive.
But directly download and extracting on the google drive mount is impossible.:huh:
Reply With Quote
  #3  
Old 12.11.2019, 16:44
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,524
Default

You can customize the extract to folder but it would be better to use scripts/cronjob/eventscripter (see https://board.jdownloader.org/showthread.php?t=70525 ) to move extracted finished files. downloading directly to google drive mounted files will very likely fail because of requires random-read/write-access.
The available disk space/size is queried from OS and most *cloud mapped/mounted* filesystems have that large *available* space.

The log doesn't contain any errors/downloads. When you create log via MyJDownloader webinterface, please make sure to select all sessions!

I'm recommending to NOT use cloud mapped/mounted filesystems because of issues with random-read/write-access.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #4  
Old 12.11.2019, 16:45
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,524
Default

Please create a new log and I can check the exact cause though there won't be anything to fix in case the issues are caused by what I think it is
__________________
JD-Dev & Server-Admin
Reply With Quote
  #5  
Old 12.11.2019, 19:02
wannabee
Guest
 
Posts: n/a
Default

Thanks for your reply:)

I´ve made a new install and generated a new log:

This is my log id: jdlog://6190230900751

The problem is, that i run the server on a vps host and i have just 20 GB´s SSD. Thats the point why i want to save the downloads directly on the mount. I thought changing the extraction folder was just a temporarily solution.. The user who´s running jdownloader has full acces to the mount(i mounted the gdrive with that user). With other programms it´s possible to have full access to the mount.. that surprises me

regards
Reply With Quote
  #6  
Old 13.11.2019, 10:59
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,524
Default

The issue is caused by this
java.io.IOException: Illegal seek
and
java.io.IOException: Operation not permitted

As I though this is caused by *how google drive* works, see
stackoverflow.com/questions/36102998/how-to-get-partial-write-access-to-a-file-from-private-folder-of-google-drive-an#
__________________
JD-Dev & Server-Admin
Reply With Quote
  #7  
Old 13.11.2019, 11:00
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,524
Default

Quote:
Originally Posted by wannabee View Post
With other programms it´s possible to have full access to the mount.. that surprises me
Yes, but the difference is *how they are using* the filesystem. normal copy/open/create/delete is working. But opening a file and then randomly seek and write chunks of data to it causes this issue.
__________________
JD-Dev & Server-Admin

Last edited by Jiaz; 13.11.2019 at 11:02.
Reply With Quote
  #8  
Old 13.11.2019, 11:01
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,524
Default

Quote:
Originally Posted by wannabee View Post
The problem is, that i run the server on a vps host and i have just 20 GB´s SSD.
You could download until disk space is full and JDownloader stops the download, then move finished/extracted downloads to google drive and continue with download. This can be achieved with help of the eventscripter extension, see https://board.jdownloader.org/showthread.php?t=70525
When you need help with it or got questions, please ask mgpai for help
__________________
JD-Dev & Server-Admin
Reply With Quote
  #9  
Old 13.11.2019, 11:10
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,524
Default

Maybe it's possible to change file handling stuff to avoid those *critical filesystem calls*, but I can't guarantee it
__________________
JD-Dev & Server-Admin
Reply With Quote
  #10  
Old 14.11.2019, 15:36
wannabee
Guest
 
Posts: n/a
Thumbs up

thanks for your help
i´ve found another solution, simply adding "--vfs-cache-mode writes --vfs-cache-max-age 0h0m0s" to the rclone mount command, then it works too, but the extracting is slow. This is caused by google drive
Reply With Quote
  #11  
Old 15.11.2019, 06:42
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,524
Default

Thanks for the feedback! don't you have to specify where to cache those writes to?
__________________
JD-Dev & Server-Admin
Reply With Quote
  #12  
Old 01.12.2019, 03:49
wannabee
Guest
 
Posts: n/a
Default

no, in my home directory there is a .config folder where the rclone cache is stored
the "vfs-cache-max-age 0h0m0s" simply deletes the files after there are uploaded to the google drive.
now two weeks without errors, so thats working great!
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 00:40.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.