[pspzockerscene]

@Perene
Read the last 2-3 pages of this thread.

[elvis_ef]

Originally Posted by Al-Mel

Hello! I'm having last days an issue with YouTube age restricted videos. Look this example: **External links are only visible to Support Staff**...

If I add this video to JDownloader there is an error message: Error - rOcmsn oT1k Sign in to confirm your age

But where sign in! I'm already logged and the video plays perfectly in YouTube. Don't know where is the problem. Any help? Thanks.

Originally Posted by Jiaz

You have to add your account in JDownloader, Settings->Accounts, via Cookie method, see
**External links are only visible to Support Staff**...

Hey guys.

I've had just the same problem few minutes ago.
I did what is to be done in the link Jiaz provided of course, and all videos (from two YT lists) except age-restricted ones, where imported successfully into my JD.

So I've relogged on my YT account (using Firefox browser) with one of the addons ("Step 3 option 3: Cookie-Editor (All browsers)") installed. So it worked when Ive pasted my cookie into the password field. It worked but only for not restricted videos.

What I did to make it work, I did the "re-login" again. And then it worked with all videos.

Just wondering, if I login using my browser, and click all videos (one-by-one) with accepting age restricted videos manually, if the JSON cookie would have these information ? So then if I copy it, there would be no problem.

Because if my cookie expired, I would not have any option to re-add videos without log-in into my account again and copying access cookie again. But it still worked but not for restricted-ones. Weird..

[pspzockerscene]

Merged YT threads.

[Meetea]

Is there a way to get LinkGrabber to crawl playlists that only contain shorts? So far it just says it's searching and then closes the dialogue box without adding anything. I like to have these playlists with videos numbered so they can play in order, so this throws things off a little.
Example playlist: **External links are only visible to Support Staff****External links are only visible to Support Staff**

Another issue I've encountered involves adding duplicates. I have "LinkCollector.dupemanagerenabled" unchecked, but playlists still get screwed up in two ways. The first is by omission. In the playlist below, multiple tracks are repeated (tracks 11 and 80, to name one example. The total tracklist is 94, but it only adds 73 videos. My playlist items are numbered, so duplicates are not a problem in this case.
Playlist URL: **External links are only visible to Support Staff****External links are only visible to Support Staff**
The second way is the numbering. If I crawl a channel and then add a playlist from that channel, the track numbers will change in the playlist. Crawling the channel below will add all videos from the channel, but then adding the playlist will change the tracklist numbers from "1., 2., 3." to "6., 7., 8.," which interrupts my flow if I am doing multiple channels or a channel with several playlists. In some cases, channels have unlisted videos or deleted videos that are still contained in the playlist (allowing me to search for them on Wayback), so I find just adding a playlist quicker than checking if every video in it is public.
Channel URL: **External links are only visible to Support Staff****External links are only visible to Support Staff**
Playlist URL: **External links are only visible to Support Staff****External links are only visible to Support Staff**

[pspzockerscene]

Originally Posted by Meetea

Is there a way to get LinkGrabber to crawl playlists that only contain shorts?

Yes.
Thanks for your report, I've just fixed that.
During testing though I noticed that I only got 100 video items even though the playlist claims to contain 210 items.
I haven't checked if that happened due to duplicates or due to the YT pagination serverside not working.

Originally Posted by Meetea

I have "LinkCollector.dupemanagerenabled" unchecked, but playlists still get screwed up in two ways[...]

Originally Posted by Meetea

The second way is the numbering. If I crawl a channel and then add a playlist from that channel, the track numbers will change in the playlist. Crawling the channel below will add all videos from the channel, but then adding the playlist will change the tracklist numbers from "1., 2., 3." to "6., 7., 8.," which interrupts my flow[...]

Yeah that's due to the nature of our system or, trying to keep the answer simple:
JD was specifically designed to detect- and ignore duplicates.
Making it e.g. add dupes of a playlist multiple times with different positions to specifically avoid dupe detection would require a lot of work and even then, it may not be desired by all users.
You might need to resort to other tools specifically designed to download from youtube.

For all code changes mentioned in this reply, the following information applies:
Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!
---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

-psp-

[Rainer Humbug]

Since today YouTube is throwing the error:

Content offline! Error: Sign in to confirm you're not a bot

Is there a workaround for this or do we now have to rip videos using a Google-account?

[Thinkerbelle]

Originally Posted by Rainer Humbug

Since today YouTube is throwing the error:

Content offline! Error: Sign in to confirm you're not a bot

Is there a workaround for this or do we now have to rip videos using a Google-account?

Was this an age restricted video?
Because you need to log in to watch this so YouTube can verify your age. And JD can only download this when you are logged in.
However, at the moment, no Downloader can download age-restricted videos from YouTube - at least none of the 6 downloaders I have installed.

I also had this problem before that JD asked me to log in for non-age restructed videos, but an hour later, they were loading without the log in. So if it is no age restricted video, you may just have to wait.

[Rainer Humbug]

No, this is definitely new behavior from YouTube.

I use YouTube almost exclusively via JDownloader and daily.

Censorship and monitoring of which biunique user watch narrative-critical videos via age verification has been known to me for a long time.

This seems to be another level of escalation or just a protection move against serial bot-downloads.

[pspzockerscene]

Just a quick reminder about all currently known YT problems:

• Age restricted videos may not be downloadable at all (even with account supplied in JD)
• Whenever the error "Sign in to confirm you’re not a bot" happens and you need to login, downloads may fail for the same reasons, age restricted download fails so an age restrict download fix would fix this problem as well.
• There may still be problems with crawling shorts-playlists (I'm waiting for feedback)

[Meetea]

Thanks for your report, I've just fixed that.
During testing though I noticed that I only got 100 video items even though the playlist claims to contain 210 items.
I haven't checked if that happened due to duplicates or due to the YT pagination serverside not working.

Thank you, that did the trick. It adds the shorts just fine now. I'm not sure why it won't go past 100 though. Even when I load the playlist in my browser, it still only allows me to load 100 videos when I scroll down. There are no duplicates either; going to the channel's Shorts panel shows many more videos (which are distinguishable by a different thumbnail). Must be the pagination problem ¯\_(ツ)_/¯

Other thing with the dupes not adding to playlists... Not really a big deal, and I understand it not being a priority.

[pspzockerscene]

I'm still not saying I found a youtube bug but:

- for me, there is no pagination for that playlist in browser (first list of items you see == final list of items)
- The last videoIUD of that playlist in my browser ends with "rjWLnfU" and this is also the last one in the list of video items JD finds

Are you absolutely sure that that playlist contains more than 100 unique items?
Maybe use another tool that can extract the videoIDs to compare the results e.g. popular open source tool "yt-dlp".

[Meetea]

When using yt-dlp, I get this output:

[download] Downloading playlist: 本日の黒猫亭
...
WARNING: [youtube:tab] Incomplete data received. Retrying (3/3)...
[youtube:tab] PLzlR4ojTSLlq4xgOVUuiC2mT4bm9yL6E4 page 1: Downloading API JSON
WARNING: [youtube:tab] Incomplete data received. Giving up after 3 retries
[youtube:tab] Playlist 本日の黒猫亭: Downloading 0 items of 210
[download] Finished downloading playlist: 本日の黒猫亭

So it seems there are 210 items, but yt-dlp doesn't want to grab any of them. There are 210 shorts in the channel's Shorts tab, so I'm guessing the remaining videos are the ones listed in that tab.
Strangely, if I view it via "Play all" (**External links are only visible to Support Staff****External links are only visible to Support Staff**) then it shows 200 videos in the playlist and loads the remaining 10 when I click on the bottom video. Using that video's URL doesn't make LinkGrabber crawl that far though. Final ID in the playlist is "heVBXZjmDS4"

[pspzockerscene]

Okay then it seems like something is off with that playlist.
When I'm adding the "/@channel-CENSORED/shorts" link, I'am indeed getting 210 unique results.

You can also add all (273) items of the whole profile either via the profile playlist or just add the link "/@channel-CENSORED" (without "/shorts" at the end) to JD.
Be sure to check this setting before:
Settings -> Plugins -> YT -> Profile crawl mode -> "Playlist 'uploads of user'"

[Meetea]

Yeah, profile crawl looks like the better option. Thankfully there are no videos in that playlist that are unlisted. Some channels have unlisted/deleted videos that can only be found in their playlists.

[pspzockerscene]

I mean you can always skip that crawl step and manually crawl the individual videoIDs.
Example way how to do this:
https://support.jdownloader.org/know...orted-websites
The main problem with this is that now they will be crawled without the playlist context so information like the playlist position will be missing.

[bugnotme]

i was told to report this, thus here i am.

main problem is *VIDEONUMBER* literally does not work on youtube.

example/issue one:

"0001"
"0005"
"0006"
"0007"
"0008"
(works normally for awhile)
"0027"
"0060"
"0062"

...this youtube playlist was 23 items...
and its also out of order, the second video in the playlist got numbered 0018.

log id: 06.11.24 15.39.42 <--> 06.11.24 16.01.48 jdlog://0656411370661/



example/issue two:

"0001"
"0002"
""
""
""
"0006"

it just... doesnt do the thing? it should number the videos. it does not number the videos.

seems to happen much more often with playlists over 25 videos?

log id: 06.11.24 16.03.19 <--> 06.11.24 16.20.20 jdlog://2656411370661/



the only way it seems to mostly work is if i reboot after every download/linkgrab.

**External links are only visible to Support Staff****External links are only visible to Support Staff**

usually breaks in the first 4 playlists, sometimes takes till number 6.

if it matters, yes i do have a connected google account.

.

unrelated issue[?] three:

also i dont suppose you recently fixed anything related to videos that can only download in 360p?

everything is currently working, and i dont have any logs, but i saw some weird shit recently.

i downloaded this playlist just fine about 6 months ago in 1080p.

middle of last month it refused to download outside of 360p and a specific audio bitrate.

between last month and today its started working again.

**External links are only visible to Support Staff****External links are only visible to Support Staff**

every other video/playlist i tried to download last month worked fine, login required or otherwise, it was very specifically this one that would not work.

i dont think either of us like it when google starts doing some weird crap like that.

[pspzockerscene]

Your log contains an error which was fixed yesterday.
Update your JD, try again and post a fresh log if the issue still exists.

Some thoughts regarding the wrong numbers:
This might be a cache bug inside our YT plugin:
See in order to save requests, the plugin is caching items internally, together with all of their respective properties.
Did you maybe add multiple playlists which contained "overlapping" items on different positions?
Or did you maybe add some videos without playlist context and then after a short time, add the same items again within a playlist context?

Originally Posted by bugnotme

everything is currently working, and i dont have any logs, but i saw some weird shit recently.
[...]
middle of last month it refused to download outside of 360p and a specific audio bitrate.

Read the last few pages of this thread.
TL;DR
This was fixed. If you still run into such problems, provide logs.

[pspzockerscene]

Bug 1: Fixed
When an item was added with playlist context and then again as part of another playlist, the cached playlist position was used, resulting in wrong positions.

Bug 2: Work in progress
When a playlist contains multiple items which fail for various reasons - most commonly age restricted items but user does not have an account, only the first failed item appeared as a dummy item.
Other successfully crawled items were still named correctly with the correct positions but because the user is unable to see the failed items, it appeared as if they were just randomly missing.

Bug 3: [not a bug]
Just a reminder that due to the internals/nature of JDownloader, unique video items can only be in the linkgrabber once by default.
This may also lead to _missing_ items when you add two playlist that both contain the exact same videos but at different positions.
Deeper explanation, see the following post and above:
https://board.jdownloader.org/showth...734#post540734
To effectively disable this duplication check, you need to disable the following two advanced settings:

Youtube.crawldupecheckenabled

and:

LinkCollector.dupemanagerenabled

@Meetea
Coming back to your last post:
My first reply was wrong! It is possible to do what you are trying to do.
See point 3 of this post.
With these settings, you should be able to add the same video multiple times to your linkgrabber, also when it is contained in multiple playlists.

[bugnotme]

Originally Posted by pspzockerscene

Your log contains an error which was fixed yesterday.
Update your JD, try again and post a fresh log if the issue still exists.

Some thoughts regarding the wrong numbers:
This might be a cache bug inside our YT plugin:
See in order to save requests, the plugin is caching items internally, together with all of their respective properties.
Did you maybe add multiple playlists which contained "overlapping" items on different positions?
Or did you maybe add some videos without playlist context and then after a short time, add the same items again within a playlist context?


Read the last few pages of this thread.
TL;DR
This was fixed. If you still run into such problems, provide logs.

i did indeed add multiple playlists that share atleast a couple videos, and that issue is not fixed.

07.11.24 15.56.48 <--> 07.11.24 16.09.33 jdlog://6856411370661/



and just to clarify from my last post:

issue2, it would indeed download the files, it just wouldnt consistently label them with a playlist position number, instead having it blank. i didnt intend to imply that nothing would be downloaded. im not sure if its bad/good luck but reproducing this issue is massively harder today on the current patch. you may have unwittingly fixed this one?



as for the 360p issue, dont worry, if it comes back and doesnt go away after an hour ill definitely complain about it.

[pspzockerscene]

Originally Posted by bugnotme

i did indeed add multiple playlists that share atleast a couple videos, and that issue is not fixed.

Did you read the part "Bug 3" of my last post?
Did you change your JDownloader settings accordingly?

Originally Posted by bugnotme

i didnt intend to imply that nothing would be downloaded

I didn't mean to imply to say that you said this.
I just posted all bugs that I observed during testing.
I foundmore than just the ones you've reported.

Originally Posted by bugnotme

you may have unwittingly fixed this one?

We are currently working on some more YT related problems.
Please wait for us to finish and release our changes.
Once released, I will come back to this thread and wait for further feedback.

[Meetea]

With these settings, you should be able to add the same video multiple times to your linkgrabber, also when it is contained in multiple playlists.

Yeah I'm able to add multiple playlists containing the same items, so that works.
And I'll have to check out those browser extensions too. Those look useful. Thanks again.

[bugnotme]

Originally Posted by pspzockerscene

Did you read the part "Bug 3" of my last post?
Did you change your JDownloader settings accordingly?

i did read "bug 3", that is not the problem i am having. (i did try it though, you cant say i didnt make the attempt.)

i am not trying to add multiple playlists to the linkgrabber tab at the same time.

i am having issues because the *VIDEONUMBER* formatting option does not work consistently unless i reboot the program between operations.



just so we're clear, this is the problem/reproduction-steps/timeline as i know it:

1 i add a playlist to linkgrabber.

2 i start downloading that playlist.

3 i start linkgrabbing another playlist now that the first one is downloading and no longer in the linkgrabber tab. these playlists have a couple common items.

4 the *VIDEONUMBER* function stops working correctly on the second playlist, giving them no values (turns out this wasnt accidentally fixed) or incorrect values (seemingly from the first playlist).

5 first playlist finishes downloading. all videos in the second playlist have since shown up in linkgrabber as intended, but are not numbered correctly.

Originally Posted by pspzockerscene

I didn't mean to imply to say that you said this.
I just posted all bugs that I observed during testing.
I foundmore than just the ones you've reported.

okay, just wanted to make sure we're on the same page.

Originally Posted by pspzockerscene

We are currently working on some more YT related problems.
Please wait for us to finish and release our changes.
Once released, I will come back to this thread and wait for further feedback.

wilco, see you later tm.

you guys are infinitely better then the clowns i deal with over on github that take 3 months to acknowledge a ticket.

[scenic]

Not sure if this is new, but apparently there are now YouTube videos with multiple audio tracks.

Example: **External links are only visible to Support Staff****External links are only visible to Support Staff**

The issue is that JDownloader always downloads the English audio version. However, in this case, the English track is not the original one.

Is this a known issue?

Is there a way to adjust this setting?

[pspzockerscene]

Originally Posted by bugnotme

i am having issues because the *VIDEONUMBER* formatting option does not work consistently unless i reboot the program between operations.

Just to confirm: I clearly understood your problem.
Nevertheless please wait for us to finish and release our next set of YT changes.
We will notify you in this thread.

Originally Posted by bugnotme

you guys are infinitely better then the clowns i deal with over on github that take 3 months to acknowledge a ticket

Without trying to defend strangers [I don't know which github specifically you mean]:
A lot of projects on github are hobby projects run by small teams or single developers.
They often don't find the time for "end user support".

Originally Posted by scenic

Is this a known issue?

Yes. Search for "audio" in the last 2-10 pages of this thread.

[pspzockerscene]

Hi there,

With today's update, the feature "Download Playlist Cover" has been implemented.

It is enabled by default.
You can disable it under: Settings -> Plugins -> YT -> Allowed Media Types -> Type -> Playlist cover image.

The cover file names are based on the set "Package name for videos that are part of a playlist."

Further changes:
- Fixed some potentially missing information for custom filename tags: number of videos of playlist/channel, playlist creator name, playlist description
- Problems mentioned here may be fixed now

Have a nice weekend!

Related closed tickets:

EDIT

@bugnotme
If you can still reproduce any of the issues you previously reported, please report them again.
Include fresh logs and example links.

[r-n-l]

Hi

I noticed that:

1. after disabling dupe manager for linkgrabber, playlist contents from youtube are not added;

2. links are once added as new items in the list, and other times as another subitem in an existing item (as is the case when adding another host for a file).

best regards,
R.

[bugnotme]

Originally Posted by pspzockerscene

Hi there,

With today's update, the feature "Download Playlist Cover" has been implemented.

It is enabled by default.
You can disable it under: Settings -> Plugins -> YT -> Allowed Media Types -> Type -> Playlist cover image.

The cover file names are based on the set "Package name for videos that are part of a playlist."

Further changes:
- Fixed some potentially missing information for custom filename tags: number of videos of playlist/channel, playlist creator name, playlist description
- Problems mentioned **External links are only visible to Support Staff**... may be fixed now

Have a nice weekend!

Related closed tickets:

EDIT

@bugnotme
If you can still reproduce any of the issues you previously reported, please report them again.
Include fresh logs and example links.

yeah, so um. i cant reproduce those issues, because now i have a new one.

linkgrabber just straight up doesnt work anymore?

16.11.24 03.31.36 <--> 16.11.24 03.33.00 jdlog://3676411370661/

single videos are fine, but playlists are not.

seemingly all playlists, but this is the one i tested first.

**External links are only visible to Support Staff****External links are only visible to Support Staff**

i have touched absolutely no settings since updating the program.

[Jiaz]

@r-n-l: issue is fixed with latest update

[Jiaz]

@bugnotme: playlist support is fixed with latest update a few minutes ago.

[r-n-l]

Thank you.

[bugnotme]

playlists are indeed working again, and after brief testing ive failed to reproduce the other issues ive mentioned.

im not sure its actually gone, but if nothing else its happening dramatically less often today.

.

...though are you sure the playlist cover image download thing actually works? because despite it apparently defaulting to enabled ive not actually seen it happen when linkgrabbing playlists.

here a log where i linkgrabbed a playlist and did not see any cover image, incase this is a bug. yes 'playlist cover image' is allowed in the plugin media types.

16.11.24 18.19.49 <--> 16.11.24 18.22.39 jdlog://7776411370661/

ps, i am losing my goddamn mind trying to post this comment and i wouldnt be surprised if somehow it made 4 different posts instead of 1.

[Jiaz]

@bugnotme: please provide example link, then we can check.
Cover may fail as we had limited testing with playlists with custom cover. Still might be work to do for this work reliable. I took quick peek at log and could see that the playlist crawler did crawl thumb of first video as no custom cover was set? but this one was defined as wrong type (cover vs thumbnail). so example link would help

[bugnotme]

Originally Posted by Jiaz

@bugnotme: please provide example link, then we can check.
Cover may fail as we had limited testing with playlists with custom cover. Still might be work to do for this work reliable. I took quick peek at log and could see that the playlist crawler did crawl thumb of first video as no custom cover was set? but this one was defined as wrong type (cover vs thumbnail). so example link would help

oh, this feature is explicitly for CUSTOM playlist icons?

nevermind then, the playlists i had tried it on were just using the thumbnail from like the first video in them.

my apologies for wasting your time.

[Jiaz]

Originally Posted by bugnotme

oh, this feature is explicitly for CUSTOM playlist icons?

Sorry, not was I meant. I was trying to say that currently only custom images are supported and those that take cover images, still need some work So best would be to provide example link for testing

[Student im ersten Jahr]

Crawling for Download runs for example 27 minutes and shows 0 shorts found all the time. Why?
Example "short" Link:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

[Jiaz]

@Student im ersten Jahr: Please provide a log

[Student im ersten Jahr]

Originally Posted by Jiaz

@Student im ersten Jahr: Please provide a log

25.11.24 00.56.03 <--> 25.11.24 11.17.32 jdlog://6896411370661/

[pspzockerscene]

@Student im ersten Jahr
Make sure that debug mode is enabled and provide screenshots of: Settings -> Plugins -> YT

[Student im ersten Jahr]

Debug Mode, is ON all the time.

I only see such a message for a while, but the process continues endlessly for a long time 0 results in the list.

[pspzockerscene]

Please post a screenshot of:
Settings -> Advanced Settings -> LinkCrawler.addretrycrawlertasks3

According to your logs, result-vikdeos are found but they cannot be crawled because "Video unavailable".
Can you watch them in your browser?