[FBD]

Originally Posted by pspzockerscene

We didn't get any reports yet but yes I know that changing defaults is never a good idea.

Had several people asking in chat why their "Customized Packagename" option does not work anymore since the update.

Originally Posted by pspzockerscene

Ab option to customize this behavior exists:
YT Settings -> Channel/Playlist group mode -> Put each video into a separate package

It's not the general behavior but the plain *name* of the package. When people have customized the packagename to "*CHANNEL* *PLAYLIST_NAME*" and now crawl a playlist, the packagename still end up being just the playlist name. I meant there is not option to customize that naming.

Originally Posted by pspzockerscene

Using both in one pattern is problematic because:

• When crawling a channel, all there really is to choose from is: either: channelname[and channelID]/playlistTitle[and playlistID] and the number of total [crawled] items in that channel/playlist
• When crawling single videos, none of the above is available but only information about the video itself (except if it was crawled as part of a channel/playlist)
• This combined with the fact that our "YT filename replacer" does not have any kind of "optional placeholders" makes it nearly impossible to cover both cases in one package name pattern.

Current behavior is that not available options will be empty. That's fine and even if someone sets the option to "*CHANNEL* -- *PLAYLIST_NAME*" they would end up with "CoolChannelName --" which is still ok even though it doesn't look nice. May only get problematic if users choose to create subfolders by packagename, having spaces or dashes at the beginning or end of folder names is... suboptimal... but still better than just having the playlist name as the packagename hardcoded.

Originally Posted by pspzockerscene

I'am open for suggestions. What would be your preferred way?

i'd prefer two options there,

• "Customized Packagename for single Videos"
  With the same default as before

• "Customized Packagename for Playlists/Channels"
  Defaulting to "*CHANNEL* *PLAYLIST_NAME*"

The youtube plugin is probably one of the most used and also the one with the most customizing options. Feels wrong not having an option for that - and one more option in the plugin settings will not hurt anyone

[pspzockerscene]

I also just got the first report.

Originally Posted by FBD

Had several people asking in chat why their "Customized Packagename" option does not work anymore since the update.

As said my changes only really lead to this if users add a channel- or a playlist.

Originally Posted by FBD

It's not the general behavior but the plain *name* of the package. When people have customized the packagename to "*CHANNEL* *PLAYLIST_NAME*" and now crawl a playlist, the packagename still end up being just the playlist name. I meant there is not option to customize that naming.

Yes I understand.
As said there is room for improvement but for now, they need to change the mentioned setting to "Put each video into a separate package" and then it will work like before.

Originally Posted by FBD

Current behavior is that not available options will be empty. That's fine and even if someone sets the option to "*CHANNEL* -- *PLAYLIST_NAME*" they would end up with "CoolChannelName --" which is still ok even though it doesn't look nice. May only get problematic if users choose to create subfolders by packagename, having spaces or dashes at the beginning or end of folder names is... suboptimal... but still better than just having the playlist name as the packagename hardcoded.

Again: It's not "hardcoded" in that way.
It's a natural result of the new grouping setting.
If the behavior is set to "put all into one package" there needs to be a single package-name.

Originally Posted by FBD

i'd prefer two options there,

I agree.

But regarding the reports you need to keep in mind that users will continue to report the package name setting to fail because many of them will probably overlook that "Channels/playlist crawler: Grouping mode" setting.
Maybe it is a good idea to update the auto mode of that setting so if a user includes any video-specific replacements in the playlist package name scheme, that scheme will still be used but videos will be grouped into separate packages again (which would be necessary to make this work).

Originally Posted by FBD

Feels wrong not having an option for that - and one more option in the plugin settings will not hurt anyone

I'am absolutely on your side. My main issue here is that I didn't come to any good idea on how to implement this yet.

[pspzockerscene]

So here is my next attempt:
I've added two additional settings so you can customize the filenames fir playlists and channels separately.
Screenshot:


By default, those will still be grouped into one package but:
If grouping mode for channels/playlists is set to "auto" and the user defined pattern contains a replacement which is only available for single videos, that pattern will be used as a single video pattern and the grouping will be "auto" depending on the resulting package-names.

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!
---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

-psp-

[FBD]

Originally Posted by pspzockerscene

By default, those will still be grouped into one package but:
If groupon mode for channels/playlists is set to "auto" and the user defined pattern contains a replacement which is only available for single videos, that pattern will be used as a single video pattern and the grouping will be "auto" depending on the resulting package-names.

Had to read that a few times to understand, lol. But yeah, that makes a lot of sense.

[mav]

edit: 15.08.2023 - partially fixed with core #48149

sample for current youtube url decrypting issue. hope this helps - only the jpg is decoded

e.g. **External links are only visible to Support Staff****External links are only visible to Support Staff**

see attached extract from log file youtube.com_jd.plugins.decrypter.TbCmV2.log.1

exception stack trace

Caller: org.jdownloader.plugins.components.youtube.YoutubeHelper.getPage(YoutubeHelper.java:1848)
org.jdownloader.plugins.components.youtube.YoutubeHelper.getPage(YoutubeHelper.java:1841)
org.jdownloader.plugins.components.youtube.YoutubeHelper.refreshVideo(YoutubeHelper.java:1907)
org.jdownloader.plugins.components.youtube.YoutubeHelper.loadVideo(YoutubeHelper.java:1817)
org.jdownloader.plugins.components.youtube.ClipDataCache.get(ClipDataCache.java:94)
org.jdownloader.plugins.components.youtube.ClipDataCache.load(ClipDataCache.java:65)
jd.plugins.decrypter.TbCmV2.decryptIt(TbCmV2.java:600)
jd.plugins.PluginForDecrypt.decryptIt(PluginForDecrypt.java:356)
jd.plugins.PluginForDecrypt.decryptLink(PluginForDecrypt.java:462)
jd.controlling.linkcrawler.LinkCrawler.crawl(LinkCrawler.java:3613)
jd.controlling.linkcollector.LinkCollectorCrawler.crawl(LinkCollectorCrawler.java:32)
jd.controlling.linkcrawler.LinkCrawler$12.crawling(LinkCrawler.java:1731)
jd.controlling.linkcrawler.LinkCrawlerRunnable.run_now(LinkCrawlerRunnable.java:118)
jd.controlling.linkcrawler.LinkCrawlerRunnable.run(LinkCrawlerRunnable.java:49)
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
java.base/java.lang.Thread.run(Thread.java:1623)

[Lucretius0000]

Hello been a while how is going?

i recently discovered that youtube plugin is working again, i do like this program for youtube is more flexible than other downloaders

but recently it download most of the videos but i get a lot of file not found even though when i retry it download them normally, how i avoid that , do i need to setup the chunk and number of downloads so that it doesnt happen again, or something like that? Or is another settings i need to check out?

jd is very good for huge playlists as i watch indie games mostly

i might actually have solved myself it was some settings in advanced, making the hd the top quality seems fixed the problem for now i need to do some testing, since there are too many video variants now

[pspzockerscene]

@Lucretius0000
Please post your log-ID here
If your bugreport is about a specific website which JD supports via plugin, please also provide example URLs which can be used to reproduce the issue you are having.

Bitte poste deine Log-ID hier.
Falls dein gemeldetes Problem ein Problem mit einer Webseite ist, die per Plugin unterstützt wird, stelle bitte zusätzlich Testlinks zur Verfügung, mit denen sich dein Problem nachstellen lässt.

-psp-

[pspzockerscene]

CORE-Updates have just been released.

YT Changelog:
- YoutubeReplacer: added 'DataOrigin' so each replacer object is aware of where its data was initially coming from (don't mix it up with already existing 'DataSource') useful for new improved package grouping auto mode
- TbCmV2: set username/uploader of auto generated mix playlists to "YouTube"
- YoutubeHelper: added new replacer 'PLAYLIST_CREATOR': name of the user who created that playlist. Needs separate tag as this can be different from name of the user who uploaded the video.
- New default name for playlist-packages: *PLAYLIST_CREATOR* - *PLAYLIST_TITLE*
- YoutubeClipData: updated: added missing fields
- added 'CHANNEL_SIZE' as new replacer field as it is different to 'PLAYLIST_SIZE'
- added short patterns for some replacements e.g. 'PL_ID'
- added PLAYLIST_DESCRIPTION as new tag
- Set playlist description as package comment if user prefers to have all playlist items in one package
- Worked on a simple setting which lets you put the position number of playlist-items to the beginning of the filenames regardless of the customized filename scheme (not yet finished)

[Perene]

Why is JDW saying I can only download at 760p this video, if the player says it's available at 1080p, too?

**External links are only visible to Support Staff****External links are only visible to Support Staff**

Did I miss something?

[pspzockerscene]

Rightclick in YT player -> Display debug information

--> That videos "1080p" is 1920x760.

[mav]

sample for current youtube url decrypting issue - still present with #48149 (only partial fix) hope this helps - now only the name of the jpg is not correctly decrypted or no decryption happens at all - might just be an issue of the order in which the links are parsed.

e.g.
partial decrypt- only jpg missing issue:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

no decrypt:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**


see attached extract from log file youtube.com_jd.plugins.decrypter.TbCmV2.log
youtube.com_jd.plugins.decrypter.TbCmV2.log.1

stack traces are the same for both scenarios:

exception stack trace - partial decode

Caller: org.jdownloader.plugins.components.youtube.YoutubeHelper.getPage(YoutubeHelper.java:2097)
org.jdownloader.plugins.components.youtube.YoutubeHelper.getPage(YoutubeHelper.java:2090)
org.jdownloader.plugins.components.youtube.YoutubeHelper.refreshVideo(YoutubeHelper.java:2156)
org.jdownloader.plugins.components.youtube.YoutubeHelper.loadVideo(YoutubeHelper.java:2066)
org.jdownloader.plugins.components.youtube.ClipDataCache.get(ClipDataCache.java:94)
org.jdownloader.plugins.components.youtube.ClipDataCache.load(ClipDataCache.java:65)
jd.plugins.decrypter.TbCmV2.decryptIt(TbCmV2.java:633)
jd.plugins.PluginForDecrypt.decryptIt(PluginForDecrypt.java:356)
jd.plugins.PluginForDecrypt.decryptLink(PluginForDecrypt.java:462)
jd.controlling.linkcrawler.LinkCrawler.crawl(LinkCrawler.java:3613)
jd.controlling.linkcollector.LinkCollectorCrawler.crawl(LinkCollectorCrawler.java:32)
jd.controlling.linkcrawler.LinkCrawler$12.crawling(LinkCrawler.java:1731)
jd.controlling.linkcrawler.LinkCrawlerRunnable.run_now(LinkCrawlerRunnable.java:118)
jd.controlling.linkcrawler.LinkCrawlerRunnable.run(LinkCrawlerRunnable.java:49)
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
java.base/java.lang.Thread.run(Thread.java:1623)

exception stack trace - no decode

Caller: org.jdownloader.plugins.components.youtube.YoutubeHelper.getPage(YoutubeHelper.java:2097)
org.jdownloader.plugins.components.youtube.YoutubeHelper.getPage(YoutubeHelper.java:2090)
org.jdownloader.plugins.components.youtube.YoutubeHelper.refreshVideo(YoutubeHelper.java:2156)
org.jdownloader.plugins.components.youtube.YoutubeHelper.loadVideo(YoutubeHelper.java:2066)
org.jdownloader.plugins.components.youtube.ClipDataCache.get(ClipDataCache.java:94)
org.jdownloader.plugins.components.youtube.ClipDataCache.load(ClipDataCache.java:65)
jd.plugins.decrypter.TbCmV2.decryptIt(TbCmV2.java:633)
jd.plugins.PluginForDecrypt.decryptIt(PluginForDecrypt.java:356)
jd.plugins.PluginForDecrypt.decryptLink(PluginForDecrypt.java:462)
jd.controlling.linkcrawler.LinkCrawler.crawl(LinkCrawler.java:3613)
jd.controlling.linkcollector.LinkCollectorCrawler.crawl(LinkCollectorCrawler.java:32)
jd.controlling.linkcrawler.LinkCrawler$12.crawling(LinkCrawler.java:1731)
jd.controlling.linkcrawler.LinkCrawlerRunnable.run_now(LinkCrawlerRunnable.java:118)
jd.controlling.linkcrawler.LinkCrawlerRunnable.run(LinkCrawlerRunnable.java:49)
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
java.base/java.lang.Thread.run(Thread.java:1623)

[pspzockerscene]

@mav
We are aware of this.
We haven't found time to work on it yet.

[mav]

this was just an update with new examples, as it seems there was a partial fix today with #48149

[pspzockerscene]

Nope, we haven't touched any of the browser request stuff.

All changes mentioned in my last post were about settings, GUI and channel/playlist crawl behavior.

[paivadaniel]

I use Ubuntu 22.04 and openjdk 11.0.20 2023-07-18. I installed the latest version of Jdownloader2 available for Linux from this page: https://jdownloader.org/download/index

My Jdownloader2 is downloading videos without problems from some sites that I tested, however, not from Youtube, for most of the videos that I tried to download the follow message is displayed:

"Error: try restarting this link (plugin outdated?)"



I already reinstalled Jdownloader2 and ffmpeg, but the problem reoccurs. I suspect that the problem is in ffmpeg, because for the same video the audio and video files are being downloaded up to 100%, however, two separate files are generated with the extension .dashAudio and .dashVideo, as the follow image:

[pspzockerscene]

Merged YT threads.

Please post your log-ID here
If your bugreport is about a specific website which JD supports via plugin, please also provide example URLs which can be used to reproduce the issue you are having.

Bitte poste deine Log-ID hier.
Falls dein gemeldetes Problem ein Problem mit einer Webseite ist, die per Plugin unterstützt wird, stelle bitte zusätzlich Testlinks zur Verfügung, mit denen sich dein Problem nachstellen lässt.

-psp-

[YNN]

Regarding the multiple audio tracks:

Originally Posted by YNN

I got into this again, but again ran out of time.

I see that in the playerresponse data, videos with multiple audio tracks have an audioTrack segment inside the streams returned in adaptiveFormats and inside that is an audioIsDefault line, something like this (chopped up a bit):

adaptiveFormats=
[
	{
	itag=140,
	mimeType=audio/mp4; codecs="mp4a.40.2",
	...
	audioTrack=
		{
		displayName=Spanish (United States) dubbed,
		id=es-US.3,
		audioIsDefault=false
		}
	}

]

I thought the practical thing might be to add a couple of relevant methods to YoutubeHelper class:

1. checkForMultipleAudioTracks would take fmtMaps and iterate over all of them to see if there are multiple audio tracks and return a boolean.
2. Possible inside addYoutubeStreamData another check would be made and the stream would be added only if it's not an audio stream OR there are no multiple tracks OR (there are multiple tracks AND it's a default track).

Like I said, ran out of time to actually get this to work.

Originally Posted by pspzockerscene

Just do it and play around with it.

Just keep in mind that I'm currently working on some other YT parser related stuff so there may be conflicts...but I'm not heavily touching that helper class.

As I suspected, since last playing with this almost two months ago, I haven't had the time to work on this anymore and still don't for the foreseeable future.

I did come to the conclusion that the basic change is probably actually simpler than what I suggested above (this is from my notes from back then): Add a check to addYoutubeStreamData which skips the track if it has audioTrack segment AND audioIsDefault=false, just like the other checks which already exist there.

I see I do have some comments mapping out the different maps, hashmaps, etc., but I didn't figure them out completely and how to parse out the relevant data.

I'm not giving up on this, but I don't know when I can get to this, so I would suggest implementing that (hopefully very simple) change without me.


Also, as a side point, wouldn't it be better to split popular hosters like Youtube into their own subforums under the plugins forum? That way, the conversations would be much easier to follow and you wouldn't have to merge threads into this one mega-thread (which in this case currently has more then 5600 posts).

[enjikari]

Anyone else experiencing Youtube-specific "Account Manager" issues today? I've had to re-verify my YT account 5 times today (export cookie data to clipboard, edit JD2 YT account, paste password, OK). It used to be super rare I'd have to do this, now it's happening multiple times a day? Any ideas?

[dedman155]

When downloading a youtube playlist, it used to be that each video gets their own package and is added into the linkgrabber in their order in the playlist. However recently I noticed that when adding youtube playlists, all of its contents are placed into one package making the videos alphabetically arranged regardless of its placement in the playlist. How do I set it such that the linkgrabber adds the videos in the playlist in their own package in order like before?

Example Playlist: **External links are only visible to Support Staff****External links are only visible to Support Staff**

EDIT: Nevermind, I figured it out. It's in the plugins menu.

[pspzockerscene]

@YNN
We have our reasons to keep all YT related posts in one thread.

@enjikari
There were no changes on our side.