View Single Post
  #18  
Old 17.09.2021, 18:47
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,554
Default

Quote:
Originally Posted by TomArrow View Post
I have 116895 links in 2911 packages in the download list and 247363 links in 20442 packages in the link collector. My CFG folder is 3.5 GB. downloadList[number].zip is 81 MB. linkcollector[number].zip is 229 MB. And that's with me already having pruned the lists twice in the past, leading to me being unable to detect duplicates as mentioned.

JD2 has already written almost 200 GB according to Task Manager.
Can you please further feedback on this (because your comment about forgotten changes for Linkcollector).
Mostly downloading stuff and no changes in linkcollector? or manging/adding links to collector?
I'm asking to find out the cause of the high write output. Because default maximum delay is 1 minute, so
during ongoing downloads, the list is saved maximum 60 times per hour, would sum up to 4GB/hour
So must be connected to your linkcollector use? or have you set VERY large buffers in JDownloader
so during download the changes take much longer?

Please help me to understand your usecase
and I will try my best to help with possible/feasible optimizations! I already have new proof of concept
storage in work that reduces file sizes even more.
__________________
JD-Dev & Server-Admin
Reply With Quote