JDownloader Community - Appwork GmbH
 

Notices

Reply
 
Thread Tools Display Modes
  #41  
Old 13.05.2021, 00:33
Wheezer Wheezer is offline
JD Addict
 
Join Date: Mar 2009
Location: WheezerLand
Posts: 158
Default

Quote:
Originally Posted by Jiaz View Post
@Wheezer: Check about dialog of JDownloader, see **External links are only visible to Support Staff**...
it states the java memory settings. Can you provide screenshot?
Attached is a screen shot of the "About" dialog for my installation.
... W ...
Attached Images
File Type: png JD2(about)(2020-05-12).png (32.0 KB, 3 views)
Reply With Quote
  #42  
Old 13.05.2021, 17:15
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,289
Default

@Wheezer: You are using heavily outdated Java 1.7 ?
You should install recent Java 1.8 , eg from adoptjdk or backup your complete cfg folder
and install fresh from here https://jdownloader.org/jdownloader2
and then restore the complete cfg folder (do not merge but replace it)
__________________
JD-Dev & Server-Admin
Reply With Quote
  #43  
Old 13.05.2021, 18:50
Wheezer Wheezer is offline
JD Addict
 
Join Date: Mar 2009
Location: WheezerLand
Posts: 158
Default

Thanks .... will update today and check the impact.
Reply With Quote
  #44  
Old 13.05.2021, 18:51
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,289
Default

Depending on the age of your JDownloader installation/Launcher, the launcher(exe) will only be able to find max java 1.8, newer installer/launcher is required for support for newer java versions. Just for your information
__________________
JD-Dev & Server-Admin
Reply With Quote
  #45  
Old 14.05.2021, 01:32
Wheezer Wheezer is offline
JD Addict
 
Join Date: Mar 2009
Location: WheezerLand
Posts: 158
Default

Well this was interesting ... great experience but no joy with the new version.
What happened was:
  1. Backed up the system and I think I need to clean it up a bit, backup file was 10.GB.
  2. Cleaned up the finished links, great now down to 9.98 GB.
  3. Download and install version with java 1.8 into a clean location.
  4. Copied the cfg folder from the older set and then start JD and ... wait.
  5. After about 30 mins running at 78% load (on 12 cores) still no start up.
  6. ARGH !!! (terminate process)
  7. Cleaned it up and started the older version, came up fine.

So now I have learned that, perhaps, there are too many links in the download list. Maybe 2 million plus queued download links is a bit beyond the design specifications

But I did notice adding even more links gets interesting and to not do it. When adding links and a download is running a curious loop starts. JD will start to create a "linkcollector" zip file (about 162K), then start to create a "downloadList" zip file (about 1,500K). Then (for some reason) a dance begins where it is constantly creating one, then the other. Probably due to the size and time to create them, but it really slows down downloads.

So .... time to just clean up and get the download list a little more manageable.

FWIW .. I have Java 8 update 281 (build 1.8.0_281-b09) already installed on the system.

Thanks for the help.
... W ...

Last edited by Wheezer; 14.05.2021 at 01:43.
Reply With Quote
  #46  
Old 14.05.2021, 10:22
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,289
Default

@Wheezer: It's not connected to used Java version but to your large link list and most likely not enough java heap memory. Check about dialog for available memory. You might have to tweak the .vmoptions for larger link lists. In your JDownloader folder you should find a .vmoptions files. Open it with text editor and remove any -Xmx or -Xms line and add -Xmx20g (same as shown in your screenshot of previous/old installation).
__________________
JD-Dev & Server-Admin
Reply With Quote
  #47  
Old 14.05.2021, 10:23
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,289
Default

Quote:
Originally Posted by Wheezer View Post
But I did notice adding even more links gets interesting and to not do it. When adding links and a download is running a curious loop starts. JD will start to create a "linkcollector" zip file (about 162K), then start to create a "downloadList" zip file (about 1,500K). Then (for some reason) a dance begins where it is constantly creating one, then the other. Probably due to the size and time to create them, but it really slows down downloads.
With that many links in list, the write of changed list to disk will take some time. Increase these settings to reduce save to disk
https://board.jdownloader.org/showpo...04&postcount=7

eg DownloadController.minimumsavedelay to 60000 (min 1 min)
and DownloadController.maximumsavedelay to 180000 (max 3 mins)
JD will wait minimum 1 minute to write changes to disk and max 3 minutes

LinkCollector.maximumsavedelay and LinkCollector.minimumsavedelay are same settings for Linkgrabber list
__________________
JD-Dev & Server-Admin
Reply With Quote
  #48  
Old 14.05.2021, 12:37
Wheezer Wheezer is offline
JD Addict
 
Join Date: Mar 2009
Location: WheezerLand
Posts: 158
Default

@Jiaz: Thanks for the fixes. I applied both and noted that the delays have been significantly reduced. CPU use now ranges from 5% to 13%, no longer spiking at 30%-45%

I had seen both of the savedelay settings in the advanced configuration settings, but was hesitant to alter the default values.

As for the .vmoptions files, both were of a ver old date (06/25/2014) and both simply contained "-Xms64m" and "-Dsun.java2d.d3d=false", altering the setting to "-Xmx20g" is helping.

Side question regarding the link collector files files. I want to build a subset to send to mgpai for script testing. Looking at the ZIP file contents it looks like I could create a subset from scratch. Is there a n easier way to just save or extract a subset of the link collector list so I can make a test subset for him?

Thanks!
... W ..
Reply With Quote
  #49  
Old 14.05.2021, 12:59
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,289
Default

@Wheezer: You can also remove the -Xms line.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #50  
Old 14.05.2021, 13:02
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,289
Default

Quote:
Originally Posted by Wheezer View Post
Side question regarding the link collector files files. I want to build a subset to send to mgpai for script testing. Looking at the ZIP file contents it looks like I could create a subset from scratch. Is there a n easier way to just save or extract a subset of the link collector list so I can make a test subset for him?
Not directly but fairly easily go to your JDownloader/cfg folder and backup latest
downloadListXX.zip or linkcollectorXX.zip that you want to keep.
Then remove the links from list, and leave those you want to send him, then wait for JDownloader
to store new list/zip and then can send him the file.
Close JDownloader and delete the new created zip file(s) until your backup is the one with highest number.
Alternative. Clear the list and drag/drop the backup zip into JDownloader to import it back into JD
__________________
JD-Dev & Server-Admin
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 17:44.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.