JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 11.11.2022, 23:52
IanMatthysen IanMatthysen is offline
I will play nice!
 
Join Date: Oct 2022
Posts: 3
Default Download list missing after

Hi!

I've recently formatted my PC and reinstalled my software (including JDownloader 2). Before that, I did make a backup of the cfg and logs folders. When I replaced the contents of those folders, the Link Grabber list restored successfully, but not so with the list of downloads.

I Google'd and consulted the forum posts for a solution, but I was unable to resolve the issue.

My suspicion is that it might have something to do with the size of the downloadListXXXXXXX.zip file. Currently it's about 414 MB, and it might be possible that JDownloader cannot handle such large .zip files.

Are there alternative ways in which I can restore my download list?

Any responses to my query will be greatly appreciated! Please let me know if you require more details.

Have a great day!

Ian
Reply With Quote
  #2  
Old 14.11.2022, 15:09
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 64,016
Default

Hi,
please post a screenshot of: Help -> About JDownloader

Please try to import your downloadlistXXX.zip file via File -> Load Linkcontainer and tell us what happens.
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist

Last edited by pspzockerscene; 14.11.2022 at 18:10. Reason: Fixed typo
Reply With Quote
  #3  
Old 14.11.2022, 18:13
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 64,016
Default

Update:
Most likely your JVM does't get enough RAM to load that downloadliste.
Here are your options:
1. Change the xmx parameter in your .vmoptions file: Instructions
or:
2. Re-install JDownloader via jdownloader.org/jdownloader2 which should then auto use correct xmx values.
Afterwards you should be able to import that big downloadlistXXX.zip file.

Are you using the JDownloader downloadlist as a backup/history or why is your file so big?
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #4  
Old 15.11.2022, 11:54
IanMatthysen IanMatthysen is offline
I will play nice!
 
Join Date: Oct 2022
Posts: 3
Default RE: Download list missing after

Hi!

Thank you so much for the replies! I really do appreciate it.

As requested in your previous reply, I attached a screenshot of my Help -> About JDownloader window. The image file is named JDownloader About.png.

About your second question (Please try to import your downloadlistXXX.zip file via File -> Load Linkcontainer), here is what happens:
1. JDownloader appears to become unresponsive, but I just let it "do it's thing". After about 10 minutes, the becomes responsive again, but the download list is still empty.
2. I also had a look in the log files (particularly the jd.controlling.downloadcontroller.DownloadController.log.0) after this to see if there are any errors logged. This is the contents of the file:

------------------------Thread: 52:jd.controlling.downloadcontroller.DownloadController.log-----------------------
--ID:52TS:1668459268621-2022/11/14 10:54:28 PM - [jd.controlling.downloadcontroller.DownloadController$7(run)] -> Init DownloadList
--ID:52TS:1668459268621-2022/11/14 10:54:28 PM - [jd.controlling.downloadcontroller.DownloadController(findAvailableDownloadLists)] -> Collect Lists
--ID:52TS:1668459268623-2022/11/14 10:54:28 PM - [jd.controlling.downloadcontroller.DownloadController(findAvailableDownloadLists)] -> Lists: [C:\Users\Ian\AppData\Local\JDownloader 2.0\cfg\downloadList1.zip, C:\Users\Ian\AppData\Local\JDownloader 2.0\cfg\downloadList.zip]
--ID:52TS:1668459268623-2022/11/14 10:54:28 PM - [jd.controlling.downloadcontroller.DownloadController(loadFile)] -> Load List: C:\Users\Ian\AppData\Local\JDownloader 2.0\cfg\downloadList1.zip
--ID:52TS:1668459268627-2022/11/14 10:54:28 PM - [jd.controlling.downloadcontroller.DownloadController$7(run)] -> LinkList found: 0/0
------------------------Thread: 159:jd.controlling.downloadcontroller.DownloadController.log-----------------------
--ID:159TS:1668459323866-2022/11/14 10:55:23 PM - [jd.controlling.downloadcontroller.DownloadController(loadFile)] -> Load List: D:\Game Backups\Program Files (x86)_JDownloader_cfg\cfg\downloadList1894058.zip
--ID:159TS:1668460433502-2022/11/14 11:13:53 PM - [] -> Exception thrown at jd.controlling.downloadcontroller.DownloadController.loadFile(DownloadController.java:778):
java.lang.OutOfMemoryError: Java heap space

--ID:159TS:1668460436014-2022/11/14 11:13:56 PM - [jd.controlling.downloadcontroller.DownloadController(loadFile)] -> Entry:18543_1695|EntryIndex:212020|Size:-1|Compressed Size:-1



Yes, I'm running Windows 7, but I tried this on my Windows 10 laptop as well, but I got the same result on my Windows 10 laptop as well. Both PCs have 16GB RAM.

With regards to your second reply, I did not yet have the chance to follow your recommendations, but I will do so as soon as I can and let you know what happens. But to answer your last question ("Are you using the JDownloader downloadlist as a backup/history or why is your file so big?"). You could say I'm using it as a history to prevent me from downloading the same files over and over. I sometimes download Instagram posts, and sometimes there could be 1000+ posts, so it's handy if I only download the newer posts.

Again, thank you so much for your assistance so far.

Kind regards

Ian
Attached Images
File Type: png JDownloader About.png (56.4 KB, 2 views)
Reply With Quote
  #5  
Old 22.11.2022, 02:17
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 64,016
Default

The snippet of your log confirm my thoughts that your JDownloader is running out of memory.
After following my instructions that should work fine again but keep in mind that JDownloaders downloadlist is not ment to be used as a history so you should clean it after a while or you might run into this issue again in some time.
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #6  
Old 22.11.2022, 16:42
IanMatthysen IanMatthysen is offline
I will play nice!
 
Join Date: Oct 2022
Posts: 3
Default RE: Download list missing after

Thanks again for the reply. I really do appreciate it.

What you said does make sense. If the downloadlist.zip files get too big, it will eventually become a problem. I think I might have to develop my own SQL Server database with a Visual Studio WPF application to store my download list!

I think I should also mention the other things I attempted in order to restore my download list. I tried splitting up the downloadlistXXX.zip file in to 5 smaller files), and then the following:
(1) I copied the .zip files to the cfg folder, hoping that JDownloader will load the contents of each .zip file one at a time, but it did not happen. It loaded the contents of the downloadlistXXX.zip with the smallest XXX numeric value, and renamed the remainder of the downloadlistXXX.zip files by adding a .backup to the extension of the file names.
(2) I tried using File -> Load Linkcontainer approach. I was able to add the contents of downloadList1.zip file, but when I try to add downloadList2.zip, nothing happens.

Could it be that I'm doing something wrong in either of these approaches?
(1) Could it be that the structure of the .zip files is wrong? I always make sure that the extraInfo file is present in each downloadlistXXX.zip file.
(2) Could it be that the file names themselves are incorrect? For example, downloadList1.zip file might contain the files 00000 through 09999_99, and downloadList2.zip might contain 10000 through 19999_99, etc. Should each downloadlistXXX.zip file's file names start at 00000 again?

Again, thanks so much for the assistance and insights into this issue!
Reply With Quote
  #7  
Old 24.11.2022, 14:04
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 78,379
Default

@IanMatthysen: I will add the custom .vmoptions to created backup files in future. For now on, I would recommend to install 64bit JDownloader Java bundle, see https://jdownloader.org/jdownloader2
(you already do) and also have to customize the vmoption file, see
https://support.jdownloader.org/Know...vmoptions-file
with 16GB of system memory, I would recommend to use
Quote:
-Xmx4g
to allow JD up to 4gb of memory.
Do not try to workaround the issue with split/other ways in the end your JDownloader needs enough memory in order to load/hold/work with such large list.
We've got some new optimizations in pipeline to further reduce memory size of list/list entries.

Just set a good/high enough max heap value via the .vmoptions file and JDownloader should be fine to load the list.
__________________
JD-Dev & Server-Admin

Last edited by Jiaz; 24.11.2022 at 14:07.
Reply With Quote
  #8  
Old 24.11.2022, 14:07
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 78,379
Default

Quote:
Originally Posted by IanMatthysen View Post
(2) Could it be that the file names themselves are incorrect? For example, downloadList1.zip file might contain the files 00000 through 09999_99, and downloadList2.zip might contain 10000 through 19999_99, etc. Should each downloadlistXXX.zip file's file names start at 00000 again?
I don't have the full overview right now, have to check but sounds reasonable
__________________
JD-Dev & Server-Admin
Reply With Quote
  #9  
Old 24.11.2022, 14:09
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 78,379
Default

Quote:
Originally Posted by IanMatthysen View Post
My suspicion is that it might have something to do with the size of the downloadListXXXXXXX.zip file. Currently it's about 414 MB, and it might be possible that JDownloader cannot handle such large .zip files.
Just asking and of course I understand if you dont want to but maybe you can provide such large *real world* file to me so I can analyze and further try to optimize memory consumption. Eg upload to wetransfer or anywhere else and send link to support@jdownloader.org
Real large lists are always better as dummy/fake ones as they don't reflect *real work usage*.
__________________
JD-Dev & Server-Admin
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 09:58.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2022, Jelsoft Enterprises Ltd.