JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 16.12.2024, 18:42
jeonje jeonje is offline
JD Adviser
 
Join Date: Nov 2023
Posts: 106
Default Jdownloader2 links import/export merge, memory/heat management

Dear amazing team, good day Sir's. in MacBook, I have 100000 downloaded links which I keep so that I don't redownload duplicate files in future, even in idle state the app uses 6-7 GB memory and MacBook m1 heats. Will disabling all the links in downloaded list help manage that ?

Or can we export all the downloaded links which will fix the memory and heating issue and later import them all back without replacing the current links so basically merging the imported links with the current links at that time, likewise even importing the links from other MacBook to current MacBook.

Will it work perfectly or will there be problems because I don't want to loose any links and instead merge multiple links all into one later.
Reply With Quote
  #2  
Old 17.12.2024, 10:56
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 82,124
Default

@jeonje: Check about dialog, see https://support.jdownloader.org/de/k...tion-directory
Can you please show a screenshot of this dialog when high cpu usage?

Quote:
Originally Posted by jeonje View Post
Will disabling all the links in downloaded list help manage that ?
Won't help because you only change enable/disable information but link still occupies same amount of memory


Quote:
Originally Posted by jeonje View Post
Or can we export all the downloaded links which will fix the memory and heating issue and later import them all back without replacing the current links so basically merging the imported links with the current links at that time, likewise even importing the links from other MacBook to current MacBook.
Will it work perfectly or will there be problems because I don't want to loose any links and instead merge multiple links all into one later.
You can keep a copy of the list files, see https://support.jdownloader.org/de/k...nkgrabber-list
and then clear the list (free up memory usage) and later import/merge those lists.

Could you provide me a copy of such a large list? I need real world large examples in order to further optimize/reduce memory consumption. If yes, upload it somewhere (eg wetransfer or mega) and then send us link to support@jdownloader.org
__________________
JD-Dev & Server-Admin

Last edited by Jiaz; 17.12.2024 at 11:01.
Reply With Quote
  #3  
Old 17.12.2024, 17:27
jeonje jeonje is offline
JD Adviser
 
Join Date: Nov 2023
Posts: 106
Default

Sir, how to best approach in this case.

1. Have downloaded files from Coomer.su, YouTube.com, recu.me, x.com
and want to keep the downloaded files links in downloads tab for future reference.

2. How do I export all downloaded history from only Coomer.su and keep the rest, and later import them back and merge with other existing download history on download tab.

3. The How to restore a lost Download list or LinkGrabber list? only shows how to import
backup file using File --> Load Linkcontainer option.
Reply With Quote
  #4  
Old 17.12.2024, 17:48
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 82,124
Default

1.) more memory as more links do require more memory, see https://support.jdownloader.org/de/k...vmoptions-file

2.) merge currently does NOT merge with existing/same links -> means that importing a list twice, will result each link to show up twice in list. backup current list, delete what you want to export, backup new list and restore old list. then you have a backup with only what you want to keep and current list with what you want to work on

3.) I'm sorry but I don't understand what is unclear about the article?
__________________
JD-Dev & Server-Admin
Reply With Quote
  #5  
Old 17.12.2024, 18:12
jeonje jeonje is offline
JD Adviser
 
Join Date: Nov 2023
Posts: 106
Default

you mean
1. I should first backup all complete links+settings from app menu file-backup-backup all settings.
2. Delete all links from Coomer.su then repeat the process from above.

What I wanted was :
1. Select the links and export the selected links before deleting them to free ram and heating due to high energy consumption.
2. Later bring those exported links which now is deleted back merging with other remains links from the list.
3. How does it create a duplicate link because I already deleted previous links before exporting and am now reimporting them back.
4. doing a complete backup with settings from menu option doesn't allows this.
Reply With Quote
  #6  
Old 17.12.2024, 18:19
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 82,124
Default

@jeonje:
1.) you can just copy/backup the downloadListXXX.zip or linkcollectorXXX.zip, no need to create full backup. the file with highest number contains the current list
2.) yes, delete what you don't want in offline list and then create a list that only contains *history*

Import/Loading of list files will not check for existing links/duplicated and result in adding same link multiple times. You cannot use this method for what you want to achieve.

I recommend either to increase memory or remove finished stuff. Having hands on such large list will help me to further optimize it
__________________
JD-Dev & Server-Admin
Reply With Quote
  #7  
Old 17.12.2024, 18:49
jeonje jeonje is offline
JD Adviser
 
Join Date: Nov 2023
Posts: 106
Default

1. so once I delete the already downloaded Coomer.su profile links from the app. but I don't want to loose the history so that when i rescan the same profile only new links not already downloaded will get downloaded. I thought I could preserve the links by simply exporting them and then deleting it so when I need to rescan the same profile I will first reimport the previously exported links back and then rescan the profile so old downloaded liked would get recognised in already downloaded files list.

but you said it won't work.

How does 2 different jdownlaoder2 link downlaoded packages history from 2 different computer gets merged to avoid the duplicate downloads in future.

am confused as hell. Sir

everything you said I have not understood. It's so confusing.

can you please if possible make it simple to understand.


which links should I send your support team, how to do it. ?

Last edited by jeonje; 17.12.2024 at 19:11. Reason: confusion
Reply With Quote
  #8  
Old 17.12.2024, 19:34
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 74,423
Default

Quote:
Originally Posted by jeonje View Post
How does 2 different jdownlaoder2 link downlaoded packages history from 2 different computer gets merged to avoid the duplicate downloads in future.
It gets merged if you merge it.

Quote:
Originally Posted by jeonje View Post
am confused as hell. Sir
I see.
I do not see us making any further progress here with a text based support attempt.

Please do the following:
1. Collect a list of all remaining questions you have.
2. Install Teamviewer and be ready for a live session with one of our support staff.
Teamviewer installation:
teamviewer.com/download/

3. Contact us again via support@jdownloader.org.
Keep in mind that we are from Germany so we are in time zone GMT+1 and are typically online from 9AM-5PM.

Quote:
Originally Posted by jeonje View Post
which links should I send your support team, how to do it. ?
You should get the latest downloadlistXXX.zip (your huge downloadlist) and send it to us to support@jdownloader.org.
If the file is too big to send via email, you may need to upload it to a cloud or filehoster and share the link with us.
Example for such a file hoster: workupload.com
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 17.12.2024 at 19:49.
Reply With Quote
  #9  
Old 17.12.2024, 20:05
jeonje jeonje is offline
JD Adviser
 
Join Date: Nov 2023
Posts: 106
Default

sir do we have to pay a fee for the live session, and is it going to be in English because I don't understand German.
Reply With Quote
  #10  
Old 17.12.2024, 20:16
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 74,423
Default

Quote:
Originally Posted by jeonje View Post
sir do we have to pay a fee for the live session
No.

Quote:
Originally Posted by jeonje View Post
and is it going to be in English
Yes.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #11  
Old 17.12.2024, 21:04
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 82,124
Default

Quote:
Originally Posted by jeonje View Post
How does 2 different jdownlaoder2 link downlaoded packages history from 2 different computer gets merged to avoid the duplicate downloads in future.
That's not supported. You will get duplicates because import/loading of lists do not remove any mirrors/duplicates/same links.
Example:
1.)List has Entry A in it
2.)You load/import that list -> list contains 2x A
3.)You load/import that list -> list contains 3x A
...

With that many links -> meaning very large lists files, you should also take a look at increasing the following advanced settings, https://board.jdownloader.org/showpo...7&postcount=15
__________________
JD-Dev & Server-Admin
Reply With Quote
  #12  
Old 17.12.2024, 21:34
jeonje jeonje is offline
JD Adviser
 
Join Date: Nov 2023
Posts: 106
Default

Isn't download lists merging from 2 separate jdownlaoder from different computer possible. If yes how ? by simply copying the backup file to another location ? I see no export selected links option ?

Example:
1.)List A (from computer A) have Entry A(Coomer.su links) in it but list B (from computer B) has entry B(YouTube.com links) in it.
2.)You load (list B) / into (list A) if possible what's the best approach ?
3) how will there be duplicates ?
...
Reply With Quote
  #13  
Old 17.12.2024, 22:48
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 74,423
Default

Quote:
Originally Posted by jeonje View Post
Isn't download lists merging from 2 separate jdownlaoder from different computer possible.
Yes but as explained, you may get duplicates.

Quote:
Originally Posted by jeonje View Post
If yes how ?
It's all explained here:
https://support.jdownloader.org/know...nkgrabber-list
See "How to merge multiple linkgrabberlists/downloadlists?".

Quote:
Originally Posted by jeonje View Post
ow will there be duplicates ?
There will only be duplicates if List B contains something that is also in list A.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #14  
Old 18.12.2024, 08:16
jeonje jeonje is offline
JD Adviser
 
Join Date: Nov 2023
Posts: 106
Default

now my only problem is exporting downloaded links into file.

1.the help guide only shows go to cfg folder then copy downloadlistXX.zip and linkcollectorXX.zip and import them using File --> Load Linkcontainer.

1. there are many files with extension downloadlistXX.zip and linkcollectorXX.zip can I delete them all and only keep one .zip file.

2. instead how do I manually only select the links from the app that I want to export before deleting. Can I do that ?

OR
app only allows to import whole .zip file from the cfg folder of another jdownlaoder app.
Reply With Quote
  #15  
Old 18.12.2024, 10:01
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 82,124
Default

@jeonje: better wait for teamviewer with pspzockerscene
1.) the files with highest number are current list. lower number are previous versions of the list. JDownloader uses copy-on-write (keep previous version and write new one to disk)
2.) not possible at the moment and thus we explained the *workaround* https://board.jdownloader.org/showpo...48&postcount=6 by backup current/all , then remove all you don't want in backup , then backup that reduced list and then load again the complete/all list

Quote:
Originally Posted by jeonje View Post
app only allows to import whole .zip file from the cfg folder of another jdownlaoder app.
correct. it's full export/import, cannot do on selection only
__________________
JD-Dev & Server-Admin
Reply With Quote
  #16  
Old 18.12.2024, 10:28
jeonje jeonje is offline
JD Adviser
 
Join Date: Nov 2023
Posts: 106
Default

this two options are for different purpose right ?

1. Menu>file>backup all setting and restore setting. (this is for compete backup and replaces everything links, settings, all) (no merge is possible right ?)

2. Menu>file>load link container. (this is for merging links by importing .zip files either link grabber.zip or download list.zip right thats on cgi folder) (merge is possible ?) no settings gets replaced. Only links gets merged.


jdownoader looks/feels like so powerful application like a separate digital operating system the possibilities are so large that till date no other application exists to compete with JD. Also support forum is best too.

I will donate soon as a thank you token. It's so great/quick/reliable support here.
Reply With Quote
  #17  
Old 18.12.2024, 12:03
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 74,423
Default

I'm out here regarding text based support.
This thread is pulling an amount of time that I don't have.

If you need further help from me, it is limited to support via Teamviewer.
In my reply #8 I described what you need to do to receive Teamviewer support.
It is handy to have a working microhpone and speaker ready for the session so we can talk.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #18  
Old 18.12.2024, 13:10
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 82,124
Default

@jeonje:
1.) basically replaces whole cfg folder with content of the backup/zip file. no merge is possible
2.) correct, lists are merged, but no duplicates will get removed (as previously explained)
__________________
JD-Dev & Server-Admin
Reply With Quote
  #19  
Old 20.12.2024, 14:22
jeonje jeonje is offline
JD Adviser
 
Join Date: Nov 2023
Posts: 106
Default

is this information 100% correct ?

Yes, you can merge exported links with your current list in JDownloader2 by importing them back. However, there are a few key considerations to keep in mind:

How to Export Links = Right-click on Links: Select the links you want to export in the LinkGrabber or Download tab. Right-click and choose Export DLC to save them as a .dlc container file. Save the File: Save the .dlc file to a safe location.

How to Merge Links = Import the .dlc File: Drag and drop the .dlc file into the LinkGrabber tab, or use the File > Load Link Container option in the menu.

Merging Behavior = The imported links will appear alongside your current links in the LinkGrabber tab or Download tab (depending on where you import them).
JDownloader2 will check for duplicates and highlight them. You can choose to ignore, overwrite, or remove duplicate entries as needed.

Duplicate Handling = Automatic Detection: JDownloader2 automatically detects duplicate links during the import process, based on the URL or file checksum.
Manual Review: If duplicates are detected, you'll be prompted to decide whether to:
Ignore duplicates. Overwrite existing links with the imported ones.Keep both sets of links.

Best Practices for Large Lists = Export in Smaller Batches: If you have many links, export them in smaller groups. This makes importing and merging more manageable.
Organize Folders: Use folders or categories in the LinkGrabber tab to keep your lists organized before exporting.
Reply With Quote
  #20  
Old 20.12.2024, 14:41
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 82,124
Default

@jeonje: This thread is about using the downloadListXXX and linkgrabberlistXXX files for export/import reasons.

DLC is no Backup. DLC cannot be used for export/import as it will not preseve many meta information (like online status, name, size, destination directory, package structure and many more).
If you want to use DLC for something else than sharing links, we're out of scope and support.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #21  
Old 09.03.2025, 14:03
jeonje jeonje is offline
JD Adviser
 
Join Date: Nov 2023
Posts: 106
Default

DEAR TEAM, PLEASE HELP

- from the tab downloads > tried to export selected packages which contains 100 links as .dlc and tried to reimport them to another instance of JD2 app by going to download tab and imported the .dlc file using "add container or load link container" option.

REUSLT : the link didn't get imported to " download tab" instead it got added to "linkgrabber " tab slowly. But that was not what I wanted.

- I want to add imported package which contains links to " download" tab along with its metadata that says it was 100% downloaded along with its history. So that I avoid redownloading the same files while I grab new links.

- it the above method doesn't work can we directly copy paste .zip files from CFG folder of JD2 APP 1 to JD2 APP 2.
Reply With Quote
  #22  
Old 10.03.2025, 15:16
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 74,423
Default

Quote:
Originally Posted by jeonje View Post
REUSLT : the link didn't get imported to " download tab" instead it got added to "linkgrabber " tab slowly. But that was not what I wanted.
It seems there is still some misunderstanding: A .dlc container is not a backup format!
Please take another look at Jiaz' reply #20.

Jiaz has already explained in previous replies why this is the case.
To clarify:
- Exporting/importing only specific links (with status, progress and so on) from JD_A to JD_B → Not possible
- You can only export/import entire download lists or linkgrabber lists

If you attempt to use DLC containers for import/export, you will lose information.
Additionally, you will not be able to import DLC contents directly into the download tab—DLC items can only be added to the linkgrabber and must be moved manually to the download list.

Quote:
Originally Posted by jeonje View Post
- I want to add imported package which contains links to " download" tab along with its metadata that says it was 100% downloaded along with its history. So that I avoid redownloading the same files while I grab new links.
In that case, you should use the .zip backup file. Import it or drag & drop it into your second JDownloader. Then, in the second JDownloader, remove any items you do not want.

Quote:
Originally Posted by jeonje View Post
- If the above method doesn't work, can we directly copy and paste .zip files from the CFG folder of JD2 APP 1 to JD2 APP 2?
You can import them and use drag & drop.
There is no real need to add copy & paste support for such files, as importing backups is not something users are expected to do frequently.
Please explain why you need copy & paste support for those backup formats.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #23  
Old 10.03.2025, 19:46
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 82,124
Default

@jeonje: Everything is said and explained on this topic. We explained what DLC is and what it is not. And we even explained how you can move all/part of download/linkgrabber list to another JDownloader installation.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #24  
Old 11.03.2025, 08:43
jeonje jeonje is offline
JD Adviser
 
Join Date: Nov 2023
Posts: 106
Default

Dear team thanks for responding always.

The problem :

1. From bin>jd2 folder>CFG folder = I copied downloadList19316.zip and dragged to JD2 Second App which also have packages and links.
RESULT : it did nothing, it didn't imported the links to download tab or linkgrabber tab.

2. If it had imported will downloadList19316.zip files replace all existing package, links, on both linkgrabber and download tab on JD2 Second app or will it merge with the already existing links and packages.
Reply With Quote
  #25  
Old 11.03.2025, 12:40
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 74,423
Default

Quote:
Originally Posted by jeonje View Post
RESULT : it did nothing, it didn't imported the links to download tab or linkgrabber tab.
JDownloader is supposed to ask you; a dialog should come up after the drag & drop action.
Check the size of the downloadlistXXX.zip file: Is it empty or is it really really big like 100+ MB?

We need the following information to be able to help you:
- Logs
- A copy of your downloadlistXXX.zip file
Log instructions:
https://support.jdownloader.org/know...d-session-logs

Quote:
Originally Posted by jeonje View Post
f it had imported will downloadList19316.zip files replace all existing package, links, on both linkgrabber and download tab on JD2 Second app or will it merge with the already existing links and packages.
Existing items will not be touched (deleted/replaced).
The items will be added to your existing list, as explained here.
-> See "How to merge multiple linkgrabberlists/downloadlists?"
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #26  
Old 13.03.2025, 07:40
jeonje jeonje is offline
JD Adviser
 
Join Date: Nov 2023
Posts: 106
Default

dear team,

1. It did nothing while I dragged the 'downloadList19316.zip' (size 500 MB) no of links 13,000. There was no pop up dialog.

2. can we directly copy and paste 'downloadList19316.zip' files from the JD2 APP 1 CFG folder to JD2 APP 2 CFG folder, as drag and drop isn't working ?


if both 1, and 2 method doesn't work ? what are the 3rd method we can try.
Reply With Quote
  #27  
Old 13.03.2025, 11:55
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 74,423
Default

1. Please take a moment to re-read my last post.
It specifically addresses the topic of "very big download lists."
Also Jiaz already addressed that topic in his reply #4.

Additionally, these articles may help:
https://support.jdownloader.org/know...loader-is-slow
https://support.jdownloader.org/know...vmoptions-file

2.
Quote:
Originally Posted by jeonje View Post
Can we directly copy and paste 'downloadList19316.zip' files from the JD2 APP 1 CFG folder to the JD2 APP 2 CFG folder, as drag and drop isn't working?
Yes, you can, but please note that merging multiple lists this way is not possible.

To proceed, please post a screenshot of: Help -> About JDownloader

If you want to do it that way, you either need to remove all other downloadlistXXX.zip files or make suree that your "file to import" has the highest number as only the file with the highest number will be used.

Since this conversation is becoming quite extensive, this will be my final text-based reply.

If you need further assistance, here are your options:
- Support via TeamViewer
- No further support
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 21:23.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.