JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #5681  
Old 02.08.2023, 15:24
alba63 alba63 is offline
Modem User
 
Join Date: Jul 2023
Posts: 2
Default YouTube - video download with JD2 not possible

In the past it was never a problem to download selected resolutions, or only audio with JDownloader2, since 2-3 weeks they are always displayed as "offline content".
Any solutions?
Thanks....

Last edited by alba63; 02.08.2023 at 18:17.
Reply With Quote
  #5682  
Old 02.08.2023, 16:22
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,796
Default

YT Threads zusammengeführt.

@alba63
Ein Doppelpost ist nicht nötig.

Please post your log-ID here
If your bugreport is about a specific website which JD supports via plugin, please also provide example URLs which can be used to reproduce the issue you are having.

Bitte poste deine Log-ID hier.
Falls dein gemeldetes Problem ein Problem mit einer Webseite ist, die per Plugin unterstützt wird, stelle bitte zusätzlich Testlinks zur Verfügung, mit denen sich dein Problem nachstellen lässt.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #5683  
Old 02.08.2023, 22:11
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,796
Default

Next CORE-Update will introduce some more features of the channel/playlist crawler:

- New default + setting: all crawler items will go into a single package. If you wish to go back to the previous behavior, check the plugin settings
- New setting: Playlists: You can now let JD process playlists in reverse order. Thias means if a playlist contains 1000 items, JD can first find all 1000 videoIDs and then start processing from last to first item. This can be useful if you e.g. only want to have the last 100 items of a playlist.

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #5684  
Old 06.08.2023, 22:54
m.fessler m.fessler is offline
Super Loader
 
Join Date: Apr 2020
Posts: 26
Default

Quote:
Originally Posted by wppcproductions View Post
Have you or any other users noticed some files come unavailable and if you force download start it and its works and downloads ok.
Quote:
Originally Posted by bug_reporter_girl View Post
Say I copy 20 links to my clipboard, it may miss 1-2 videos.
Quote:
Originally Posted by Neonight View Post
Seltsam, beim ersten kopieren gingen sie nicht, erst beim kopieren eines anderen Links gehts dann meist wieder.
I can also (still) confirm the issue and it seems to only affect YT links.
The "unavailable problem" is very rare and therefore not a big problem.
The problem of links not being added is much more common and extremely annoying.

Meanwhile, I use an open Notepad window and when I have all the links together I paste them (3-4 times until all were recognized) into JD.

Thanks and greetings,
Martin

Last edited by m.fessler; 06.08.2023 at 23:01.
Reply With Quote
  #5685  
Old 07.08.2023, 06:31
Neonight Neonight is offline
Junior Loader
 
Join Date: Jun 2023
Posts: 10
Default

Bis jetzt funktionieren wieder alle Youtube-Links.

Habs so gemacht:
Im Ereignis-Scripter eine neue Regel angelegt.

[{
"enabled": true,
"logging": false,
"maxDecryptDepth": 1,
"name": "DIRECTHTTP",
"pattern": "htxps://wxw.youtube.com/watch?v=d+",
"rule": "DIRECTHTTP"
}]

---------
bei pattern x durch t und w ersetzen

---------
short-links werden so auch erfasst
"pattern": "htxps://wxw.youtube.com/w",

Als Trigger: Neuer Sammeljob

Last edited by Neonight; 08.08.2023 at 03:47. Reason: shorts
Reply With Quote
  #5686  
Old 09.08.2023, 15:17
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,796
Default

@Neonight
Diese Regel tut genau gar nichts und zwar aus mindestens zwei Gründen:
  1. Du kannst keine Regeln für Link-Pattern erstellen, die bereits von Plugins gehandhabt werden siehe auch Supportartikel zu Linkcrawlerregeln.
  2. Dein Pattern in der Regel ist so oder so falsch: Laut diesem dürften YT videoIDs nur aus Zahlen bestehen ("\\d" = nur Zahlen), was nicht der Fall ist.

Du kannst dieses Problem nicht selbst lösen sondern musst auf einen Fix unsererseits warten oder die Links nacheinander einfügen und immer beobachten, wie viele letztendlich im Linkgrabber auftauchen.

Solltest du nach Einfügen dieser Regel keine Probleme mehr gehabt haben, lag dies ausschließlich am Placebo-Effekt.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #5687  
Old 09.08.2023, 18:28
tafreire tafreire is offline
Junior Loader
 
Join Date: Jan 2017
Location: Brazil
Posts: 10
Default Download "age-restricted" videos from Youtube

Can you implement (please) in JDownloader a button "I am at least 18 years old and I allow that JDownloader download age-restricted videos from Youtube" to JDownloader be able to download any video from Youtube?
Reply With Quote
  #5688  
Old 09.08.2023, 18:30
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,796
Default

Merged YT threads.

@tafreire
That is already possible:
  1. Add a age-verified YT account to JD via Settings -> Account Manager -> Add -> YT
  2. Re-add your age restricted YT links. They should be downloadable now.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #5689  
Old 09.08.2023, 19:40
tafreire tafreire is offline
Junior Loader
 
Join Date: Jan 2017
Location: Brazil
Posts: 10
Default

Quote:
Originally Posted by pspzockerscene View Post
Merged YT threads.

@tafreire
That is already possible:
  1. Add a age-verified YT account to JD via Settings -> Account Manager -> Add -> YT
  2. Re-add your age restricted YT links. They should be downloadable now.
OK. Thx.
Reply With Quote
  #5690  
Old 10.08.2023, 13:22
bug_reporter_girl bug_reporter_girl is offline
I will play nice!
 
Join Date: Jul 2023
Posts: 9
Default

I'm very glad there is so much activity put into the YT plugin lately, so I think this is the perfect time to make a couple of feature requests and improvements that I have been wanting for years. Nothing crazy, I swear!


1. There is a bug when using "*CHANNEL_ID*" as a parameter for package name, it replaces "_" with " ". For example, PewDiePie UUID is "UC-lHJZR3Gqxm24_Vd_AJ5Yw", but the package is named "UC-lHJZR3Gqxm24 Vd AJ5Yw". It would be great if we could have untouched UUIDs in package names for easier management.

2. An option to replace or remove emojis from file names would be nice, as they cause trouble with some file managers. For instance, when using "*CHANNELNAME*" and/or "*VIDEO_NAME*" as parameters for package/file name.

3. A small bug I have encountered rarely, is that ffmpeg will fail to encode videos with very long names, and you are left with an error in the download, and the two files unprocessed (video and audio). Workarround is renaming the file name to something shorter and to reset the download (or merging the video-audio manually). Point 2 would help with this too, as I have seen this bug mainly with videos with a crap ton of emojis in the name. So the simple fix would be to limit the max file name length to whatever is the max for ffmpeg.


That's it. Those are some small improvements that will be nice, but I can live without them.
Just consider them if you can, so don't stress out, please.
Nice changes to the crawler btw. Thank you, guys.
Reply With Quote
  #5691  
Old 10.08.2023, 17:21
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,655
Default

@bug_reporter_girl

1) is a desired behaviour . and _ get renamed to white space. You can disable this globally just not at the plugin level; advanced setting > GeneralSettings.cleanupfilenames

2) I don't see this happening but maybe possible at the event scripter level by checking which char value each char represents and renaming it.

3) think thats a known issue, please wait for psp to respond
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #5692  
Old 10.08.2023, 18:07
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,796
Default

@bug_reporter_girl
Thanks for your feedback!
My work on the YT crawler has been finished for now.
I've closed pretty much all tickets related to the channel/playlist crawler.
There was only one ticket left regarding "include videonumber/playlist position in default filename pattern and when no playlist, then autoremove the pattern".
I'm not sure about that one yet so feel free to provide feedback.
Maybe the most elegant solution would be to let the user define two custom filename patterns: One for items that are part of a playlist and one for "loose" items but at this moment this would make things really ugly since users can define separate filename patterns for each media type (video, audio, image, subtitle, description).
--> Maybe a simple checkbox "Put video position to filename beginning" would be the best way to implement this.


Back to topic; adding to raztokis answer:

2. That is currently not easily possible.
Feel free to at least write down some suggestions about this topic here:
https://board.jdownloader.org/showthread.php?t=90744
-> There is no ETA for this feature-request!
Apart from that, I'd also only point you to the EventScripter.
EventScripter forum thread:
https://board.jdownloader.org/showthread.php?t=70525
EventScripter help article:
https://support.jdownloader.org/Know...event-scripter

3. Yeah it's more or less a known issue.
The issue is not only related to FFmpeg but mostly affects Windows users in general.
There are numerous threads about this issue e.g.:
https://board.jdownloader.org/showthread.php?t=62683
We even got a support article about it:
https://support.jdownloader.org/Know...load-directory

-> But this won't be addressed in the near future although we've started to work on this just recently.
At this moment you need to help yourself with either a Packagizer rule or an EventScripter script.
Modifying download paths and/or filenames is a critical part which needs a lot of testing and thus time.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #5693  
Old 10.08.2023, 19:47
bug_reporter_girl bug_reporter_girl is offline
I will play nice!
 
Join Date: Jul 2023
Posts: 9
Default

Quote:
Originally Posted by raztoki View Post
1) is a desired behaviour . and _ get renamed to white space. You can disable this globally just not at the plugin level; advanced setting > GeneralSettings.cleanupfilenames
I wish I had known that earlier! Thanks, I will try it asap. Why is this considered "desired behavior"? Do . an _ cause troubles in some systems?

Quote:
Originally Posted by pspzockerscene View Post
2. That is currently not easily possible.
Feel free to at least write down some suggestions about this topic here
I will if something comes to my mind.

Quote:
Originally Posted by pspzockerscene View Post
3. Yeah it's more or less a known issue.
The issue is not only related to FFmpeg but mostly affects Windows users in general.
-> But this won't be addressed in the near future although we've started to work on this just recently.
No problem, this issue is very rare, and the workaround is very easy. And it's been there forever, so we can wait whatever it takes. I'm a linux user btw, we are way less than Windows users, so proportionally, fewer reports are also expected.

Thank you both for anwering. Have a nice day!
Reply With Quote
  #5694  
Old 11.08.2023, 01:13
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,655
Default

@bug_reporter_girl
re 1) think its more a flow over from years past were to cover one package name even though mirrors could have different filenames. Else you would end up or used to end up with multiple packages with the same content. Its also easier to read without those chars.

After posting I did recall there is a plugin setting in java class which can be set at the individual plugin level to override, but its not easily assessable by users
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #5695  
Old 11.08.2023, 03:03
FBD's Avatar
FBD FBD is offline
Mega Loader
 
Join Date: Nov 2018
Location: https://web.libera.chat/#jDownloader
Posts: 65
Default

Quote:
Originally Posted by pspzockerscene View Post
Maybe the most elegant solution would be to let the user define two custom filename patterns: One for items that are part of a playlist and one for "loose" items but at this moment this would make things really ugly since users can define separate filename patterns for each media type (video, audio, image, subtitle, description)
Not related to the numbering of videos but the new options are surely confusing some users as apparently the option "Customize Packagename" now only applies to single videos and for playlists jdownloader always uses the playlist name. I have not seen an option to customize that one. A separate option for playlists would be nice, or maybe the customized packagename should be used for both.

And just a visual thing i assume: for me the option "Channel/Playlist crawler group mode" is listed twice in the plugin settings.

Besides that, nice work with that plugin update!
__________________
irc.libera.chat #jDownloader web.libera.chat/#jDownloader
Reply With Quote
  #5696  
Old 11.08.2023, 10:52
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,796
Default

Quote:
Originally Posted by FBD View Post
Not related to the numbering of videos but the new options are surely confusing some users
We didn't get any reports yet but yes I know that changing defaults is never a good idea.
This time though this was an intentional change by me because:
  • Most of our other crawlers will work in a similar way e.g. twitter profile crawler -> all in one package, crawl a cloud-folder -> all in one package
  • Playlists can contain a lot of items so grouping them [into one package [by default] makes sense in my opinion
  • And finally: If you introduce new features but disable them by default, the majority of users won't ever use them (that's my experience at least)

Quote:
Originally Posted by FBD View Post
as apparently the option "Customize Packagename" now only applies to single videos and for playlists jdownloader always uses the playlist name.
I have not seen an option to customize that one.
Ab option to customize this behavior exists:
YT Settings -> Channel/Playlist group mode -> Put each video into a separate package


Quote:
Originally Posted by FBD View Post
A separate option for playlists would be nice, or maybe the customized packagename should be used for both.
Using both in one pattern is problematic because:
  • When crawling a channel, all there really is to choose from is: either: channelname[and channelID]/playlistTitle[and playlistID] and the number of total [crawled] items in that channel/playlist
  • When crawling single videos, none of the above is available but only information about the video itself (except if it was crawled as part of a channel/playlist)
  • This combined with the fact that our "YT filename replacer" does not have any kind of "optional placeholders" makes it nearly impossible to cover both cases in one package name pattern.
    More about this topic:
    https://board.jdownloader.org/showthread.php?t=90744

I'am open for suggestions. What would be your preferred way?

Quote:
Originally Posted by FBD View Post
And just a visual thing i assume: for me the option "Channel/Playlist crawler group mode" is listed twice in the plugin settings.
I just noticed that too. Fixed [with the next CORE-update], thanks!

Quote:
Originally Posted by FBD View Post
Besides that, nice work with that plugin update!
Thanks for your feedback!
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #5697  
Old 11.08.2023, 12:13
FBD's Avatar
FBD FBD is offline
Mega Loader
 
Join Date: Nov 2018
Location: https://web.libera.chat/#jDownloader
Posts: 65
Default

Quote:
Originally Posted by pspzockerscene View Post
We didn't get any reports yet but yes I know that changing defaults is never a good idea.
Had several people asking in chat why their "Customized Packagename" option does not work anymore since the update.

Quote:
Originally Posted by pspzockerscene View Post
Ab option to customize this behavior exists:
YT Settings -> Channel/Playlist group mode -> Put each video into a separate package
It's not the general behavior but the plain *name* of the package. When people have customized the packagename to "*CHANNEL* *PLAYLIST_NAME*" and now crawl a playlist, the packagename still end up being just the playlist name. I meant there is not option to customize that naming.

Quote:
Originally Posted by pspzockerscene View Post
Using both in one pattern is problematic because:
  • When crawling a channel, all there really is to choose from is: either: channelname[and channelID]/playlistTitle[and playlistID] and the number of total [crawled] items in that channel/playlist
  • When crawling single videos, none of the above is available but only information about the video itself (except if it was crawled as part of a channel/playlist)
  • This combined with the fact that our "YT filename replacer" does not have any kind of "optional placeholders" makes it nearly impossible to cover both cases in one package name pattern.
Current behavior is that not available options will be empty. That's fine and even if someone sets the option to "*CHANNEL* -- *PLAYLIST_NAME*" they would end up with "CoolChannelName --" which is still ok even though it doesn't look nice. May only get problematic if users choose to create subfolders by packagename, having spaces or dashes at the beginning or end of folder names is... suboptimal... but still better than just having the playlist name as the packagename hardcoded.

Quote:
Originally Posted by pspzockerscene View Post
I'am open for suggestions. What would be your preferred way?
i'd prefer two options there,
  • "Customized Packagename for single Videos"
    With the same default as before
  • "Customized Packagename for Playlists/Channels"
    Defaulting to "*CHANNEL* *PLAYLIST_NAME*"

The youtube plugin is probably one of the most used and also the one with the most customizing options. Feels wrong not having an option for that - and one more option in the plugin settings will not hurt anyone
__________________
irc.libera.chat #jDownloader web.libera.chat/#jDownloader
Reply With Quote
  #5698  
Old 11.08.2023, 13:29
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,796
Default

I also just got the first report.

Quote:
Originally Posted by FBD View Post
Had several people asking in chat why their "Customized Packagename" option does not work anymore since the update.
As said my changes only really lead to this if users add a channel- or a playlist.

Quote:
Originally Posted by FBD View Post
It's not the general behavior but the plain *name* of the package. When people have customized the packagename to "*CHANNEL* *PLAYLIST_NAME*" and now crawl a playlist, the packagename still end up being just the playlist name. I meant there is not option to customize that naming.
Yes I understand.
As said there is room for improvement but for now, they need to change the mentioned setting to "Put each video into a separate package" and then it will work like before.

Quote:
Originally Posted by FBD View Post
Current behavior is that not available options will be empty. That's fine and even if someone sets the option to "*CHANNEL* -- *PLAYLIST_NAME*" they would end up with "CoolChannelName --" which is still ok even though it doesn't look nice. May only get problematic if users choose to create subfolders by packagename, having spaces or dashes at the beginning or end of folder names is... suboptimal... but still better than just having the playlist name as the packagename hardcoded.
Again: It's not "hardcoded" in that way.
It's a natural result of the new grouping setting.
If the behavior is set to "put all into one package" there needs to be a single package-name.


Quote:
Originally Posted by FBD View Post
i'd prefer two options there,
I agree.

But regarding the reports you need to keep in mind that users will continue to report the package name setting to fail because many of them will probably overlook that "Channels/playlist crawler: Grouping mode" setting.
Maybe it is a good idea to update the auto mode of that setting so if a user includes any video-specific replacements in the playlist package name scheme, that scheme will still be used but videos will be grouped into separate packages again (which would be necessary to make this work).

Quote:
Originally Posted by FBD View Post
Feels wrong not having an option for that - and one more option in the plugin settings will not hurt anyone
I'am absolutely on your side. My main issue here is that I didn't come to any good idea on how to implement this yet.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 11.08.2023 at 13:37.
Reply With Quote
  #5699  
Old 11.08.2023, 14:50
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,796
Default

So here is my next attempt:
I've added two additional settings so you can customize the filenames fir playlists and channels separately.
Screenshot:


By default, those will still be grouped into one package but:
If grouping mode for channels/playlists is set to "auto" and the user defined pattern contains a replacement which is only available for single videos, that pattern will be used as a single video pattern and the grouping will be "auto" depending on the resulting package-names.

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 14.08.2023 at 13:33. Reason: Fixed typo
Reply With Quote
  #5700  
Old 11.08.2023, 15:18
FBD's Avatar
FBD FBD is offline
Mega Loader
 
Join Date: Nov 2018
Location: https://web.libera.chat/#jDownloader
Posts: 65
Default

Quote:
Originally Posted by pspzockerscene View Post
By default, those will still be grouped into one package but:
If groupon mode for channels/playlists is set to "auto" and the user defined pattern contains a replacement which is only available for single videos, that pattern will be used as a single video pattern and the grouping will be "auto" depending on the resulting package-names.
Had to read that a few times to understand, lol. But yeah, that makes a lot of sense.
__________________
irc.libera.chat #jDownloader web.libera.chat/#jDownloader
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 19:54.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.