[mirror51]

hi guys,

I am having one problem and not able to solve.

I want to download 2 playlist.

Playlist 1 has 135 videos
Playlist 2 has 26 videos but all those videos are already in Playlist 1 but i still want to download because they are part of different subject but video are same

I have seen that Jdownloader does not add second playlist to download list because all links are already in playlist 1.

I went to advance setting and disable dupe manager , checked add duplicate video but was not able to add duplicate links

I am downloading many playlist with playlist_name as packaage and then video

Can anyone please help me

Example

**External links are only visible to Support Staff****External links are only visible to Support Staff** -- has 26 videos
**External links are only visible to Support Staff****External links are only visible to Support Staff** -- 135 videos

if you select both in this order then first will have 26 and second 135 in link grabber list

If you first add 135 videos then second wont appear at all

[Jiaz]

The playlist contain same videos and therefore are not added. You have to move the links to download list before adding the same files again.

[mirror51]

Thanks for replying. But i am adding multiple playlists like 20-30 at one time. its hard to add single playlist at a time. Is there any other way

[Jiaz]

I will add an advanced settings to disable dupe check in linkcollector, wait for next core update

[Jiaz]

After next core update, search for LinkCollector.dupemanagerenabled

Is there any way to find out which videos in same playlist are duplicate (if playlist or channel have two same videos)? So I know which videos were skip at link collecting.

[Jiaz]

@pinko: This information is available in log output of the plugin. Enable Settings-Advanced Settings-Log.debugmodeenabled and restart JDownloader. After crawling you can open the logfile from logs folder
with texteditor and search for "Ignore dupe entry"
In case you need more help with this, please let us know

Sorry I forgot about this thread. I search every file in logs for "ignore dupe entry" and there is nothing to be found. I found one duplicate video and I tried to find it in files.
I search for ID of video (that text after "watch?v=" ). I search for name of videos and is all same. It finds only that part for downloading, nothing about skip, ignore,...) The problem is, that both videos have same URL.
I don't know why youtube allow something like that, have two videos with same URL.

[Jiaz]

It's important to enable Settings-Advanced Settings-Log.debugmodeenabled and restart JDownloader.
only then you will find 'Ignore dupe entry' within the logs for the plugin

There is key "Log: Debug mode" which is enable. I restart JDownloader, again grab youtube channel. But still after it finished, there was no log about "Ignore dupe entry".

[mgpai]

Originally Posted by pinko

There is key "Log: Debug mode" which is enable. I restart JDownloader, again grab youtube channel. But still after it finished, there was no log about "Ignore dupe entry".

Log File:

jd.controlling.linkcollector.LinkCollector.log.0

Example Entry:

--ID:104TS:1558691753984-5/24/19 12:25:53 PM -  [jd.controlling.linkcollector.LinkCollector$11(run)] -> Filtered Dupe: youtubev2://J1OsKJW51HY/f56a32b954947f04be989f54254a5eac

[Jiaz]

@mgpai: no, that's different. that's a dupe -> link already in linkgrabber
you have to check the log from yt plugin and there you should find entries about
Ignore dupe entry

[mgpai]

Originally Posted by Jiaz

@mgpai: no, that's different.

@Jiaz: Sorry. I misread the question.

Log File:

youtube.com_jd.plugins.decrypter.TbCmV2.log.0

Example Entry:

--ID:72TS:1558700810687-5/24/19 2:36:50 PM -  [jd.plugins.decrypter.TbCmV2(parsePlaylist)] -> Ignore dupe entry:J1OsKJW51HY

[Jiaz]

yes, that log entry means that the ID exists multiple times in playlist