[In progress] Youtube Issue/Suggestions/Questions thread

[Jiaz]

Originally Posted by bohort

Why do I get these differences on the same files ? Is there some config on JDownloader to adapt the final size, that I have not on my side?

You cannot just compare 1080p, aac you have to take a look deeper into it.
1080p with what video codec? with what bitrate? aac with what bitrate? you may use mediainfo to check those details/differences?
Just took a look and the smaller version is lowest bitrate vp09 codec while jd grabs the higher bitrate mp4 codec

[bohort]

Hello,
Here the requested infos:
JDownloader:

yt-dlp:

I don't know how to interpret them.

[Jiaz]

Originally Posted by bohort

I don't know how to interpret them.

Your screenshots confirm my findings

Originally Posted by Jiaz

Just took a look and the smaller version is lowest bitrate vp09 codec while jd grabs the higher bitrate mp4 codec

[bohort]

Ok, thanks for explaining.
Is it possible to choose lowest bitrate vp09 codec in jd? I don't see it in the selector.

[Jiaz]

@bohort: see variant column, the dropdown menu, and choose VP9 codec. Alternative see Settings->Plugins->youtube.com and deselect H264 from Video Codec selection

[bohort]

Originally Posted by Jiaz

@bohort: see variant column, the dropdown menu, and choose VP9 codec. Alternative see Settings->Plugins->youtube.com and deselect H264 from Video Codec selection

Thank you!

[m.fessler]

Originally Posted by pspzockerscene

My work on the YT crawler has been finished for now.
I've closed pretty much all tickets related to the channel/playlist crawler.

Short feedback and a big thank you:
No more missing Youtube videos!

[Lucretius0000]

it does work now, i cant thank you enough for fixing it now, no more file not found errors and i can see the space for each playlist is used on the hdd too

cheers and the crawler is super fast as i watch the binding of isaac repentance and enter the gungeon for example, yes i still watch those among other indie games

this program is essential to me, unfortunately my family doesnt understand the concept yet of donating to random online people so i cant do that , hope you understand

[pspzockerscene]

Thanks for your nice feedback @m.fessler and Lucretius0000.

[Matts76]

I have a group a YouTube links that linkgrabber won't recognize. I'm just curious if this is a known issue or just on my side.

[pspzockerscene]

Merged YT threads.
@Matts76
Your report contains nearly zero information.

Please post your log-ID here
If your bugreport is about a specific website which JD supports via plugin, please also provide example URLs which can be used to reproduce the issue you are having.

Bitte poste deine Log-ID hier.
Falls dein gemeldetes Problem ein Problem mit einer Webseite ist, die per Plugin unterstützt wird, stelle bitte zusätzlich Testlinks zur Verfügung, mit denen sich dein Problem nachstellen lässt.

-psp-

[Matts76]

Originally Posted by Matts76

I have a group of YouTube links that linkgrabber won't recognize. I'm just curious if this is a known issue or just on my side.

Here's some sample links and the log file.

**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

04.09.23 23.47.22 <--> 04.09.23 23.47.24 jdlog://4357311370661/

When I try to load these the wheel that appears on the bottom right of the program starts but then disappears quick and won't detect the link.

[pspzockerscene]

Please enable debug mode and provide another logID.

Please post your log-ID here
If your bugreport is about a specific website which JD supports via plugin, please also provide example URLs which can be used to reproduce the issue you are having.

Bitte poste deine Log-ID hier.
Falls dein gemeldetes Problem ein Problem mit einer Webseite ist, die per Plugin unterstützt wird, stelle bitte zusätzlich Testlinks zur Verfügung, mit denen sich dein Problem nachstellen lässt.

-psp-

[Matts76]

Ok here's the new log

04.09.23 23.46.36 <--> 05.09.23 00.12.58 jdlog://6557311370661/

[pspzockerscene]

I can't see any YT crawl activity in that log.
Please make sure to add at least one of your previously posted example links in the session which you will then upload.

[NNM]

I would like to get information about YouTube license (Creative Commons or Youtube Standard License) in the filename. Is there a way to do it? Currently I see no way of activating it in the plugin settings.

[pspzockerscene]

So far there is no way to get this information via JDownloader.

[Matts76]

Originally Posted by pspzockerscene

I can't see any YT crawl activity in that log.
Please make sure to add at least one of your previously posted example links in the session which you will then upload.

This One should have it

07.09.23 23.36.40 <--> 07.09.23 23.37.05 jdlog://9957311370661/

[pspzockerscene]

@Matts76
Your new log still doesn't show any YT activity.
Please make sure that debug mode is enabled and provide a fresh logID.

[Matts76]

I checked that debug was activated and tried the links for that log. The linkcrawler symbol shows up but doesn't scan for links and goes off

[pspzockerscene]

I'm offline for the weekend soon.
If you want we can make a teamviewer session next week and look into this.

One last thing you could try:
If this is configuration related:

1. Close JDownloader
2. Rename your cfg folder e.g. to "cfg_2".
3. Start JDownloader and check if the problem persists.
   If it persists: Problem is not config related.
   If the problem is gone: Problem was config related.
   Simply delete the newly created "cfg" folder and rename the old one to "cfg" to continue with your old config.

[Matts76]

Yes I'll give that a try next time I'm on and let you know. Thank you.

[Matts76]

I didn't get to try the config folder fix yet but I did find a workaround. So the links weren't recognized when I tried the copy paste option but when I use the add new links option and paste them in that window and use deep link analysis they get added to link grabber. I'm not sure why but it works.

[goldensun87]

Why is there a warning for the Google cookie login now?

[pspzockerscene]

Originally Posted by goldensun87

Why is there a warning for the Google cookie login now?

Context:
https://board.jdownloader.org/showthread.php?t=93906

[NNM]

Originally Posted by pspzockerscene

So far there is no way to get this information via JDownloader.

Is this a planned feature to have the information about license? I think it is a very important one if you are archiving/downloading YouTube videos.

[pspzockerscene]

Currently it's not planned but if you provide some example links I may look into it.

[JDownloadFan]

**External links are only visible to Support Staff****External links are only visible to Support Staff**

It only happens with the Community channel, but occasionally the videos will download with German audio, and not English. I'm not aware of any language settings for the YT plugin.

Oddly, it's not all videos - it seems random as to which DL with the German audio

[pspzockerscene]

Merged YT threads.

@JDownloadFan
A setting for YT audio track doesn't exist yet but we are aware that the demand exists.
References:
https://board.jdownloader.org/showth...868#post521868
Ticket:

[HLX]

JDownload has an option to add the date of youtube videos by adding for example *DATE_TIME[yyyy-MM-dd]* or a variation of it.

I noticed a while ago (maybe 2 months ago) that some youtube videos add the wrong date. When the date is wrong, I have seen that it is wrong by only 1 day. However, today I found the date of a video to be wrong by 3 days.

One example is this link:
**External links are only visible to Support Staff****External links are only visible to Support Staff** , it is supposed to have a date of September 12, but JDownloader says September 15.

Fortunately, this problem doesn't happen very often and I can manually correct the date, but some times I add a lot of videos at once and I might not notice when it happens, so it would be nice if this bug could be fixed. The correct date is very helpful to me because the videos I watch have an specific order.

Thank you

[HLX]

As additional info, I just found out that it seems to happen with all the videos that were streamed live instead of uploaded, so I'm going to have to correct a lot of dates :(

[pspzockerscene]

Merged YT threads.

@HLX
Looks like technically the date you see in JD is correct.
Explanation:
Looks like this video was a live-stream before so now it is a recorded livestream.
There are multiple dates:
publishDate -> 2023-09-15
uploadDate -> 2023-09-15

Then there is a map of "liveBroadcastDetails" with items:
isLiveNow -> false
startTimestamp -> 2023-09-12T23:59:58+00:00
endTimestamp -> 2023-09-13T07:00:34+00:00

So I don't know if the uploader then later decided to upload the video, resulting in the upload date of 2023-09-15 or if this was the result of the YT system, auto-uploading it after the livestrea has ended(?)

So the question is: Would you still like to get that date in JD?
If yes:
Thoughts on possible solutions:
- Add new tags: DATE_LIVESTREAM_START and DATE_LIVESTREAM_END
- And/or: Add new tag: DATE_PUBLISHED_AUTO (i nthis case, use lowest of all values)
- or: Setting: "For livestreams: Use end-date as published date"

Let me know your opinion on my thoughts.

[HLX]

Thank you for the very quick answer. I personally would pick the the DATE_LIVESTREAM_START as the correct date. This is because some channels that I'm suscribed to stream at night, and they some times finish after 00:00

Example:
They start one stream at September 21 at 23:30 and finish at 00:30 of the next day
They start another stream at September 22 at 22:00 and finish at 23:00 of the same day

If I used DATE_LIVESTREAM_END, I would end up with 2 videos with a date of September 22, but if I used DATE_LIVESTREAM_START instead I would end up with one video of Sep 21 and one of Sep 22, which for me personally would be the right dates.

My question now becomes what happens if the stream gets published days later because he forgets (I thought streams were published automatically right after the stream ends). I would personally pick the lowest date as you suggested.

Lastly, I'm using *DATE_TIME[yyyy-MM-dd]* as part of the file name, so I don't know if the new tag would duplicate dates. With this info in mind, the setting option that you mentioned "For livestreams: Use end-date as published date" seems like the best option, but making it "use start-date as published date" instead of end date. Maybe an option to select between the two if you prefer, but my personal opinion is that the DATE_LIVESTREAM_START is the correct one

P.S. You are amazing for providing support, really

[pspzockerscene]

Sounds like an idea.

I will probably add something like DATE_LIVESTREAM_START, DATE_LIVESTREAM_END and DATE_AUTO.
As always, I won't provide any ETA.

Ticket:

[HLX]

I'm sorry to write again but I found new information regarding this subject and I believe it's worth mentioning

Less than 3 weeks ago I added multiple news & politics channels from youtube to my jdownloader and a few days later I started downloading some videos from them. This file in particular ended up with the filename "2022-09-11" (yes, 2022, which is the correct year).

However, I was checking the dates and this particular video was streamed live on youtube on 2022-09-12 instead (not the 11). The weird thing is that jdownloader named it MINUS ONE DAY, but earlier we thought that jd could only name it with PLUS ONE or MORE days, so there is something weird going on.

I added the file again in jdownloader and it nows shows Sept 12 instead of 11 (which was the automatic name weeks ago). Maybe there is something else at play and the solution could be something else?

Here is the link, in case you want to check published date, upload date, stream date etc. It makes no sense that jd named it minus one day, also because this particular channel seems to stream at the middle of the day or in the afternon and for about only 1 hour, not in the middle of the night.

**External links are only visible to Support Staff****External links are only visible to Support Staff**

I also checked and ALL THE VIDEOS from september 2022 and october 2022 downloaded with the wrong date (-1 day) weeks ago. This problem seems to stop at 31 october. After that date, the filenames seems to be fine... Also, If I add the files with the wrong names to JD again, now they show the correct date. Furthermore, as you saw, the link I provided hour ago showed different dates as well. What is this sorcery ??

[pspzockerscene]

Originally Posted by HLX

However, I was checking the dates and this particular video was streamed live on youtube on 2022-09-12 instead (not the 11). The weird thing is that jdownloader named it MINUS ONE DAY, but earlier we thought that jd could only name it with PLUS ONE or MORE days, so there is something weird going on.

There really isn't a lot to it.
You can simply check it yourself:
1. Open any YT video in your browser.
2. View the html code of the current page (in Chrome this works using CTRL + U).
3. Search for "publishDate" and also: "uploadDate".

YT may change their data serverside at any time.

Originally Posted by HLX

Here is the link, in case you want to check published date, upload date, stream date etc. It makes no sense that jd named it minus one day, also because this particular channel seems to stream at the middle of the day or in the afternon and for about only 1 hour, not in the middle of the night.

Checking this one now won't help.

You might want to check using other tools for downloading which mightr use the youtube API -> That might provide more reliable data.

[HLX]

I was able to check that info with the steps you provided, but JDownloader has facilitated me a lot of work for a long time so I would probably not try another tool unless it was absolutely necessary if I had no other options

I will recheck the dates from the streams that I download from time to timem and this forum when I remember to see if there are updates. However, I understand if you are busy with other things and it's ok that you take all the time that you want. I'm honestly not trying to pressure anything and I hope I didn't bother you

Thank you

[pspzockerscene]

All good.
I can't explude JDownloader bugs here but all I'm saying is: JD is simply parsing the dates from youtube so if they are wrong in the end, it's mostly on YT.
If YT was to change their website, the dates would be missing and still wouldn't be wrong so it really looks like they were changed later.

To double-check this you could e.g. save some html files of some newer youtube videos now and, if the bug happens again, you could check if the html/date inside html differs from the version you've saved.

Regarding the additional replacers for recorded livestreams:
Release of those changes will take at least 4 weeks as I will be on vacation soon.

[HLX]

Thank you for your patience on this. If it is alright I can suggest something that might be easier to implement, if you prefer

Instead of adding new tags or a new setting in the configuration menu, JD could check if there is a "startTimestamp" on a youtube video (not the "endTimeStamp"). If this exists, JD can take the date from there instead of "publishDate" or "uploadDate". It just has to follow the Java date/time formatting of our choice. For my videos, I use *DATE_TIME[yyyy-MM-dd]*

The solution is of course up to you, I'm grateful for any solution you choose to implement

[pspzockerscene]

No worries I will implement it in a way that it will work for all users with default settings.
The additional tags are just for users who want to specifically use them.