[beechcott]

About a month or two ago, a problem suddenly started occurring in JDownloader and has continued to exist since then. Essentially, certain minor actions sometimes (but not always) cause the entire JDownloader interface to freeze for at least 30 seconds, sometimes over a minute. These include opening/maximizing or closing/minimizing packages in the linkgrabber list or download list, renaming packages, choosing a different YouTobe video aspect ratio/variant, adding a package to the download list, and sometimes even crawling links.

At first, I thought it was a matter of not having enough RAM. But after I bought and installed 64 GB of RAM and (successfully) changed JDownloader's RAM allocation to 16 GB in the JDownloader2.vmoptions file, this proved not to be the case. For one, thing, the RAM usage never gets even close to the 16 GB limit and my system's total RAM usage never goes above 55% even with multiple programs running.

But most notably, I finally discovered that whenever the JDownloader freezes occur, it's the Disk usage rather than RAM that goes up. I discovered that in normal circumstances, Windows Task Manager shows JDownloader's Disc usage as 0 MB/s. However, whenever the freezes occur, Jdownlaoder's Disk usage in Task Manager shoots up to around 9-11 MB/s and stays in that range until the freeze stops, then abruptly drops down to normal. The Disk being used is presumably my C drive, which is a SSD. It seems that for some reason, various minor actions within JDownloader cause its Disk usage to shoot way up to the point of causing the program's interface to freeze. Note that this happens even if no file is being downloaded, meaning that the Disk usage is not due to file downloading. I don't know what could cause this or how to fix it.

These freezes do not only effect JDownloader itself. If I happen to be watching a YouTube (or other online) video in a browser when the freeze happens, the video will freeze for about half a second when the JDownloader freeze starts. In fact, any time I copy a YouTube link to my clipboard and JDownloader begins to crawl the link, this freeze of the YouTube video in my browser occurs, even if JDownloader doesn't freeze.



I created a log of a short session in which one of the freezes happened.

My log ID:

10.09.24 23.32.55 <--> 11.09.24 02.20.28 jdlog://1745411370661/

[pspzockerscene]

Without even looking at your logs, my assumption is the following:
You got a very large downloadlist and/or linkgrabberlist which, whenever it gets saved to disk, is causing that problem.
That would also explain why, according to your about dialog, JDownloader is using soo much RAM.
Please read:
https://support.jdownloader.org/de/k...loader-is-slow

Just in case I'am right - there are some settings regarding the write-out of downloadlist/linkgrabberlist, see the following support article (scroll all the way down):
https://support.jdownloader.org/de/k...nkgrabber-list
-> Maybe adjusting those helps.

[beechcott]

Originally Posted by pspzockerscene

Without even looking at your logs, my assumption is the following:
You got a very large downloadlist and/or linkgrabberlist which, whenever it gets saved to disk, is causing that problem.
That would also explain why, according to your about dialog, JDownloader is using soo much RAM.
Please read:
**External links are only visible to Support Staff**...

I was afraid of that. It is true that my downloadlist (currently the weirdly coincidental number of 247,247 links) and linkgrabberlist (currently 412,609 links) are quite long.

The reason my lists are so long is because I have been using JDownloader for years as a way of archiving information about files I have either downloaded or want to download. I knew my RAM usage would go up the bigger the lists got, but I figured that upgrading my RAM would be enough to fix the problem (and so far it is enough, in that JDownloader uses only a fraction of my current RAM). I didn't count on it freezing due to disk usage, though. I also thought it might be due to a different cause, because my lists have been nearly this big for years, and the problem only started about two months ago.

Just in case I'am right - there are some settings regarding the write-out of downloadlist/linkgrabberlist, see the following support article (scroll all the way down):
**External links are only visible to Support Staff**...
-> Maybe adjusting those helps.

I might have found a better solution.

I've been trying for ages to find an EventScripter script that would allow copying and pasting information about JDownloader packages and files into document files so I could delete the packages from JDownloader and still keep the information archived. I could never find a script that worked. However, just a few minutes ago, I happened across a post on this forum that mentioned that there's a built-in feature called "Copy Information" that can be added to the context menu and edited. It looks like I might be able to use that to copy package and link information to text files and delete it from JDownloader. Hopefully that can whittle the list down enough to fix the problem.

[pspzockerscene]

Originally Posted by beechcott

I was afraid of that. It is true that my downloadlist (currently the weirdly coincidental number of 247,247 links) and linkgrabberlist (currently 412,609 links) are quite long.

How big are your downloadlistXXX.zip and linkgrabberlistXXX.zip files in your JDownloader directory?
I only need the size of the latest copy (= with the highest number in filename).

Originally Posted by beechcott

The reason my lists are so long is because I have been using JDownloader for years as a way of archiving information about files I have either downloaded or want to download.

You are not the only user who is doing this.
The problem with this is that JD was never designed to keep such a large history.
Search our forums for "download list history" and you will find similar threads and also possible workarounds (e.g. keep history in an external file).

Originally Posted by beechcott

I've been trying for ages to find an EventScripter script that would allow copying and pasting information about JDownloader packages and files into document files so I could delete the packages from JDownloader and still keep the information archived.

A long time ago, someone created a "check for duplicates / history script", see:
https://board.jdownloader.org/showthread.php?t=83048
Just keep in mind that this may cause other side effects, see:
https://board.jdownloader.org/showthread.php?t=96420

Originally Posted by beechcott

I could never find a script that worked. However, just a few minutes ago, I happened across a post on this forum that mentioned that there's a built-in feature called "Copy Information" that can be added to the context menu and edited. It looks like I might be able to use that to copy package and link information to text files and delete it from JDownloader.

Yes that can be an idea.

Though if you really don't care about the RAM usage, you should be able to continue using JDownloader like that.
Adjusting the write-out interval of your downloadlist may help - I'd suggest to experiment with this.

[beechcott]

Originally Posted by pspzockerscene

How big are your downloadlistXXX.zip and linkgrabberlistXXX.zip files in your JDownloader directory?
I only need the size of the latest copy (= with the highest number in filename).

downloadList715380.zip is 197 MB, and linkcollector162566.zip is 637 MB.

Search our forums for "download list history" and you will find similar threads and also possible workarounds (e.g. keep history in an external file).

I'll see what I can find.

Though if you really don't care about the RAM usage, you should be able to continue using JDownloader like that.
Adjusting the write-out interval of your downloadlist may help - I'd suggest to experiment with this.

If I extend the write-out interval, wouldn't that increase the risk of files not being saved if the program crashes?

[pspzockerscene]

Originally Posted by beechcott

If I extend the write-out interval, wouldn't that increase the risk of files not being saved if the program crashes?

Yes.
EDIT Do you frequently experience crashes?

[beechcott]

Originally Posted by pspzockerscene

Yes.
EDIT Do you frequently experience crashes?

Not very often.

[pspzockerscene]

Well then, consider trying it.

The possible data loss also depends on how often you really add links.
If your list mostly doesn't change, you will have the older list versions in your JDownloader folder so in case of a crash you won't necessarily lose much.

[beechcott]

Originally Posted by pspzockerscene

Well then, consider trying it.

I'll try it and see if it helps. I should probably be able to tell how effective it is by tomorrow.

[pspzockerscene]

Which values did you change?
I'm just asking to be sure that you've changed the correct ones.

[beechcott]

Originally Posted by pspzockerscene

Which values did you change?
I'm just asking to be sure that you've changed the correct ones.

I changed DownloadController.minimumsavedelay and LinkCollector.minimumsavedelay from 5000 to 60000.

[pspzockerscene]

That should do.

[beechcott]

Originally Posted by pspzockerscene

That should do.

Now that I've tried it out with the new settings, the change sort works and sort of doesn't. It works in that I don't get the freezes within a few seconds like before. However, it doesn't work, in that the freezes still happen - a minute later.

It looks like I'm going to have to whittle down my lists (and especially the linkgrabber list, which gives me many more problems than the download list) significantly more.

[pspzockerscene]

You could still just rename your current cfg folder and test with a fresh config to simply have a comparison on how JDownloader behaves with an empty list to narrow it down 100% to the large downloadlist.

[beechcott]

Originally Posted by pspzockerscene

You could still just rename your current cfg folder and test with a fresh config to simply have a comparison on how JDownloader behaves with an empty list to narrow it down 100% to the large downloadlist.

It works smoothly and quickly after trying that.

I went back to my regular cfg folder after trying that test.

Is it possible that JDownloader keeping too many downloadListXXXXXX.zip.backup and linkcollectorXXXXXX.zip.backup files could have something to do with the problem? It has roughly 1 GB of the former and 8 GB of the latter.

[pspzockerscene]

Well, you can define the number of copies to store, see:
https://support.jdownloader.org/know...nkgrabber-list

If you got enough time, try the following:
Setup a RAM disk and run JDownloader from there.
No need to do an extra install - just copy your existing complete JDownloader folder into the RAM disk.
See if the freezes are gone then.

Also watch your SSD write-usage while JDownloader is running.

[beechcott]

Originally Posted by pspzockerscene

Well, you can define the number of copies to store, see:
**External links are only visible to Support Staff**...

I just checked, and it's set to 5. I'm not sure why there are so many of the backup files. And most of them are dated July 30.

If you got enough time, try the following:
Setup a RAM disk and run JDownloader from there.
No need to do an extra install - just copy your existing complete JDownloader folder into the RAM disk.
See if the freezes are gone then.

I don't have time to do any of that tonight. I'll have to look into whether that's something I'd be comfortable doing (I'm not sure how much I trust messing that much with RAM's functioning).

Also watch your SSD write-usage while JDownloader is running.

It's normally at 0 when idling. When I induce one of the freezes, Task Manager shows JDownlaoder using large amounts of disk (8-13 GB, when I tried it again just now), although Resource Manager showed only 2,850,877 bytes in write-usage by JDownlaoder at the same time.