JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 08.01.2021, 11:47
globus999 globus999 is offline
Mega Loader
 
Join Date: May 2011
Posts: 61
Default File Duplicate detection bug in LinkCollector

Hi,
Not sure if this is a bug, but it would seem so.
As far as I can understand, the LinkCollector is supposed to check the full URL of a file to see if it is already in the LinkGrabber tab. If the URL matches, then it is simply ignored.
In general terms,this seems to work... except when the file begins with a date.
For example, the following files will be detected as duplicates in error:

07-nov-2020-FileABC (URL **External links are only visible to Support Staff**www.somecompany.com/07-nov-2020-FileABC)
07-nov-2020-FileXYZ (URL **External links are only visible to Support Staff**www.somecompany.com/07-nov-2020-FileXYZ)

Note: *both* file_names and URLs are different but they *both* begin with a date.

The only work around I have found to prevent this (and it is not a great work around), is to set LinkCollector:Dupe Manager to OFF and then manually copy the link (into the Clipboard) so that LinkCollector can detect it as a different file. Then, and *only then* both files are added to the LinkGrabber tab.

Could somebody please check this out?

Tx
Reply With Quote
  #2  
Old 08.01.2021, 12:02
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,524
Default

We need real working example links because the date has nothing to do with it. Default check is done on URL but some plugins have customized logic
__________________
JD-Dev & Server-Admin
Reply With Quote
  #3  
Old 08.01.2021, 12:07
globus999 globus999 is offline
Mega Loader
 
Join Date: May 2011
Posts: 61
Default

OK, let me see if I can find an example. FYI, this bug is present running with a plugin and without. This seems to be a core issue. Also, yes, I understand that the "date" may not have anything to do with it, *but* the *format* of the date may not be properly parsed by the URL dupe checker, i.e. it begins with a number. Also, do you need a log?
Reply With Quote
  #4  
Old 08.01.2021, 12:11
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,524
Default

There is no parser involved. Either it's the full URL or plugin customized. I just need example links to reproduce the issue, no logs, thanks
__________________
JD-Dev & Server-Admin
Reply With Quote
  #5  
Old 08.01.2021, 16:20
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,524
Default

Is this about xha...?
__________________
JD-Dev & Server-Admin
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 23:45.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.