JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 31.03.2017, 02:46
mirror51 mirror51 is offline
Modem User
 
Join Date: Mar 2017
Posts: 3
Default Adding Duplicates in from playlist

hi guys,

I am having one problem and not able to solve.

I want to download 2 playlist.

Playlist 1 has 135 videos
Playlist 2 has 26 videos but all those videos are already in Playlist 1 but i still want to download because they are part of different subject but video are same

I have seen that Jdownloader does not add second playlist to download list because all links are already in playlist 1.

I went to advance setting and disable dupe manager , checked add duplicate video but was not able to add duplicate links

I am downloading many playlist with playlist_name as packaage and then video

Can anyone please help me

Example

Quote:
**External links are only visible to Support Staff****External links are only visible to Support Staff** -- has 26 videos
**External links are only visible to Support Staff****External links are only visible to Support Staff** -- 135 videos
if you select both in this order then first will have 26 and second 135 in link grabber list

If you first add 135 videos then second wont appear at all

Last edited by Jiaz; 31.03.2017 at 11:05.
Reply With Quote
  #2  
Old 31.03.2017, 11:04
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 63,237
Default

The playlist contain same videos and therefore are not added. You have to move the links to download list before adding the same files again.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #3  
Old 31.03.2017, 11:37
mirror51 mirror51 is offline
Modem User
 
Join Date: Mar 2017
Posts: 3
Default

Thanks for replying. But i am adding multiple playlists like 20-30 at one time. its hard to add single playlist at a time. Is there any other way
Reply With Quote
  #4  
Old 31.03.2017, 11:47
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 63,237
Default

I will add an advanced settings to disable dupe check in linkcollector, wait for next core update
__________________
JD-Dev & Server-Admin
Reply With Quote
  #5  
Old 31.03.2017, 16:05
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 63,237
Default

After next core update, search for LinkCollector.dupemanagerenabled
__________________
JD-Dev & Server-Admin
Reply With Quote
  #6  
Old 05.05.2019, 11:55
pinko pinko is offline
Baby Loader
 
Join Date: Feb 2019
Posts: 9
Default

Is there any way to find out which videos in same playlist are duplicate (if playlist or channel have two same videos)? So I know which videos were skip at link collecting.

Last edited by pinko; 05.05.2019 at 11:58.
Reply With Quote
  #7  
Old 06.05.2019, 17:39
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 63,237
Default

@pinko: This information is available in log output of the plugin. Enable Settings-Advanced Settings-Log.debugmodeenabled and restart JDownloader. After crawling you can open the logfile from logs folder
with texteditor and search for "Ignore dupe entry"
In case you need more help with this, please let us know
__________________
JD-Dev & Server-Admin
Reply With Quote
  #8  
Old 24.05.2019, 00:13
pinko pinko is offline
Baby Loader
 
Join Date: Feb 2019
Posts: 9
Default

Sorry I forgot about this thread. I search every file in logs for "ignore dupe entry" and there is nothing to be found. I found one duplicate video and I tried to find it in files.
I search for ID of video (that text after "watch?v=" ). I search for name of videos and is all same. It finds only that part for downloading, nothing about skip, ignore,...) The problem is, that both videos have same URL.
I don't know why youtube allow something like that, have two videos with same URL.
Reply With Quote
  #9  
Old 24.05.2019, 10:28
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 63,237
Default

It's important to enable Settings-Advanced Settings-Log.debugmodeenabled and restart JDownloader.
only then you will find 'Ignore dupe entry' within the logs for the plugin
__________________
JD-Dev & Server-Admin
Reply With Quote
  #10  
Old 24.05.2019, 11:49
pinko pinko is offline
Baby Loader
 
Join Date: Feb 2019
Posts: 9
Default

There is key "Log: Debug mode" which is enable. I restart JDownloader, again grab youtube channel. But still after it finished, there was no log about "Ignore dupe entry".
Reply With Quote
  #11  
Old 24.05.2019, 11:58
mgpai mgpai is offline
Script Master
 
Join Date: Sep 2013
Posts: 541
Default

Quote:
Originally Posted by pinko View Post
There is key "Log: Debug mode" which is enable. I restart JDownloader, again grab youtube channel. But still after it finished, there was no log about "Ignore dupe entry".
Log File:
Code:
jd.controlling.linkcollector.LinkCollector.log.0
Example Entry:
Code:
--ID:104TS:1558691753984-5/24/19 12:25:53 PM -  [jd.controlling.linkcollector.LinkCollector$11(run)] -> Filtered Dupe: youtubev2://J1OsKJW51HY/f56a32b954947f04be989f54254a5eac
Reply With Quote
  #12  
Old 24.05.2019, 12:04
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 63,237
Default

@mgpai: no, that's different. that's a dupe -> link already in linkgrabber
you have to check the log from yt plugin and there you should find entries about
Ignore dupe entry
__________________
JD-Dev & Server-Admin
Reply With Quote
  #13  
Old 24.05.2019, 14:31
mgpai mgpai is offline
Script Master
 
Join Date: Sep 2013
Posts: 541
Default

Quote:
Originally Posted by Jiaz View Post
@mgpai: no, that's different.
@Jiaz: Sorry. I misread the question.

Log File:
Code:
youtube.com_jd.plugins.decrypter.TbCmV2.log.0
Example Entry:
Code:
--ID:72TS:1558700810687-5/24/19 2:36:50 PM -  [jd.plugins.decrypter.TbCmV2(parsePlaylist)] -> Ignore dupe entry:J1OsKJW51HY
Reply With Quote
  #14  
Old 24.05.2019, 15:17
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 63,237
Default

yes, that log entry means that the ID exists multiple times in playlist
__________________
JD-Dev & Server-Admin
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 16:32.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2019, Jelsoft Enterprises Ltd.