JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 16.02.2024, 21:05
mostafatefa2009 mostafatefa2009 is offline
JD Alpha
 
Join Date: Feb 2024
Posts: 20
Question How to prevent duplicates from being added?

Hello mods,

I've a Mediafire link with lots of folders that contain a lot of pictures and videos that are duplicated.

Can Jdownloader search by name+size or maybe hash? and prevent such duplicate files from being added if the name+size match?

Thank you.
Reply With Quote
  #2  
Old 18.02.2024, 01:02
mostafatefa2009 mostafatefa2009 is offline
JD Alpha
 
Join Date: Feb 2024
Posts: 20
Question How to prevent duplicates from being added?

Hello mods,

I've a Mediafire link with lots of folders that contain a lot of pictures and videos that are duplicated.

Can Jdownloader search by name+size or maybe hash? and prevent such duplicate files from being added if the name+size match?

Thank you.
Reply With Quote
  #3  
Old 18.02.2024, 15:06
FBD's Avatar
FBD FBD is offline
Mega Loader
 
Join Date: Nov 2018
Location: https://web.libera.chat/#jDownloader
Posts: 68
Default

You mean check for duplicates...

...in the linkgrabber?
JDownloader will only add duplicates if the links are stored on different hosters and use them as mirrors

...in the download-list?
JDownloader does add links to the linkgrabber if they are already in the download-list but highlights them as duplicates. You can create a packagizer rule to drop those links and not add them if you prefer that.

...on your harddisk?
JDownloader does not do this by default, but when the download is started and the file already exists it will be handled according to your option in Settings -> General -> If the file already exits....
This functionality can be achieved by an Event Scripter script in JDownloader. Search this forum for the Event Scripter thread for scripts and examples.
__________________
irc.libera.chat #jDownloader web.libera.chat/#jDownloader
Reply With Quote
  #4  
Old 19.02.2024, 14:01
mostafatefa2009 mostafatefa2009 is offline
JD Alpha
 
Join Date: Feb 2024
Posts: 20
Default

Quote:
Originally Posted by FBD View Post
You mean check for duplicates...

...in the linkgrabber?
JDownloader will only add duplicates if the links are stored on different hosters and use them as mirrors
Here is an exmaple:i.ibb.co/J2QvBCT/Copy-Q-Adi-Mt-C.png


Here is the link: mediafire .com/folder/pr5ayhp46et1u/Test

remove the space before the .com

Last edited by mostafatefa2009; 19.02.2024 at 14:05.
Reply With Quote
  #5  
Old 19.02.2024, 14:22
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,121
Default

Just initially add all items of that folder to your downloadlist.
After this, those links will be displayed as "Already in downloadlist" in your linkgrabber.

As for the linkgrabber itself:
No there are no specific tools to find duplicates.
If you want to avoid duplicates solely on the filenames, put all items of all nexted folders into one package so they will go into the same download folder and let JD skip files with names that already exist.
EDIT

Merged your duplicated threads.
EDIT2

About your example:
Just merge all items into one package in JD and duplicates will be avoided but you will loose the folder-structure of mediafire.com.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 19.02.2024 at 15:22. Reason: EDIT2
Reply With Quote
  #6  
Old 19.02.2024, 15:49
mostafatefa2009 mostafatefa2009 is offline
JD Alpha
 
Join Date: Feb 2024
Posts: 20
Default

Quote:
Originally Posted by pspzockerscene View Post
Just merge all items into one package in JD and duplicates will be avoided but you will loose the folder-structure of mediafire.com.
No, that will be bad for my usage, I have 100+ folders. But just for clarity how to merge all files into one folder?

Also, I was thinking about if it's possible to make use of the checksum tab to avoid duplicates ibb.co/mTv2yx1
Reply With Quote
  #7  
Old 19.02.2024, 15:51
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,121
Default

Quote:
Originally Posted by mostafatefa2009 View Post
But just for clarity how to merge all files into one folder?
Either via drag n drop or select all packages to merge -> Rightclick -> More -> Move to new package

Quote:
Originally Posted by mostafatefa2009 View Post
Also, I was thinking about if it's possible to make use of the checksum tab to avoid duplicates ibb.co/mTv2yx1
The checksum is already used but only for all items that are in the same package / going into the same download-folder.
For further functionality, you might want to utilize a custom EventScripter script:

EventScripter forum thread:
https://board.jdownloader.org/showthread.php?t=70525
EventScripter help article:
https://support.jdownloader.org/Know...event-scripter

Important notice:
Our ticket system & knowledgebase are currently under maintenance.
If this is still the case while you are reading my posts and you can't access help articles linked by our staff, use the Internet archive/wayback machine to be able to view those articles:
archive.org/web/
Enter the URL -> Click on "Browse history" -> Select the latest date available
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 12:06.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.