JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #4281  
Old 30.03.2021, 16:02
elvis_ef's Avatar
elvis_ef elvis_ef is offline
JD Addict
 
Join Date: Oct 2019
Location: Polska
Posts: 154
Post A little workaround to download all YT videos from a channel

This is just a workaround for downloading ALL videos (i.e. more than a 100 restriction) from YOUTUBE.
In a few steps we can achieve this, without big effort:
  1. In Firefox install this addon (Chrome has the same I believe) and enable it (if it's not):
    HTML Code:
    https://addons.mozilla.org/en-US/firefox/addon/regexsearch/
  2. Go to desired YT channel, next go to /videos page (to show a lis of videos).
  3. Scroll down as many times as You can (until You see the last video - a screen will be updated everytime You scroll down) - now all links should be visible.
  4. In the RegexSearch addon (when You click the icon in the extensions list) You will need to enter the regex to detect ALL videos from the channel - You can use for example this one:
    Code:
    href\=\"(\/watch\?v\=[A-Za-z0-9\-\_]+)\"\>
    -this gets all needed links to videos (some videos can be additionally added as it searches for all videos on the page, so some suggested videos could be detected as well, but You can remove them later, does not matter). Before clicking the "search" buttton remember to tick the "Global" radio button - it says that we want ALL results to be detected, not just the first one. And then hit "SEARCH'.
    **External links are only visible to Support Staff**
  5. Copy and pase links (You can hit COPY button) from the field under "Result", and copy into Your favourite text editor (word ? notepad ? whatever). We will need to edit links so the JD crawler will detect them later.
  6. In Your editor replace ALL (depending on the text editor You use, just hit CTRL + H or any other)
    HTML Code:
    /watch
    to :
    HTML Code:
    https :// www . youtube . com/watch
    (To make the link visible I neede to make spaces between dots, sorry, but You don't do this, You need to make it a normal link, without spaces).
  7. The last thing to do, after replacing all links, You need to CTRL + A (select all) and simply CTRL + C (copy to clipboard). Now JD will get links into the list.

If You want, You can prepare some packagizer tools to choose a specific folder or name Your packages in a specific way.
There are probably some other plugins/addons to browsers like Firefox/Chrome etc.. but I did not have time to test or search for the shortest solution. This is my shortest one.

Last edited by elvis_ef; 26.04.2021 at 12:09. Reason: a little note, updated tutorial
Reply With Quote
  #4282  
Old 31.03.2021, 00:41
mav mav is offline
DSL User
 
Join Date: Mar 2021
Posts: 35
Default

Quote:
Originally Posted by Jiaz View Post
@mav: where does this happen? worked fine here and tested videoID in filename as well
Comment for [SU] is misleading - replace space with underscore
actually the opposite happens - underscores are replaced with spaces

SU is usefull for sure, maybe [US] (underscore to space) would be helpful as well

I used [SU] in Package Name:
*CHANNELNAME* *DATE[yyyyMMdd]* *VIDEO_NAME* *VIDEOID[SU]*
Reply With Quote
  #4283  
Old 31.03.2021, 11:54
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,044
Default

@elvis_ef: Thanks for nice step-by-step workaround !
@mav: SU does *replace space with underscore* but for package names there is additional cleanup in use that removes the underscores. You can disable it in Settings->Advanced Settings->GeneralSettings.cleanupfilenames
__________________
JD-Dev & Server-Admin

Last edited by Jiaz; 31.03.2021 at 12:03.
Reply With Quote
  #4284  
Old 31.03.2021, 16:48
rapido rapido is offline
Mega Loader
 
Join Date: Aug 2009
Posts: 65
Default YT Seltsame Anzeige von Links im Linksammler

Seit ein paar Tagen werden einige Links im Linksammler auf diese Weise angezeigt: Siehe Anlage!


Mein Log Protokoll:
21.03.21 20.46.47 <--> 31.03.21 16.41.12 jdlog://3689725302851/
Attached Thumbnails
Linksammler.jpg  
Reply With Quote
  #4285  
Old 31.03.2021, 17:09
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,044
Default

Es fehlen die Titel. Betrifft das alle oder nur bestimmte? Kannst du BspLinks geben?
In den Plugineinstellungen evtl am Dateinamen Pattern was geändert oder Packetverwalter Regel?
__________________
JD-Dev & Server-Admin
Reply With Quote
  #4286  
Old 31.03.2021, 19:02
rapido rapido is offline
Mega Loader
 
Join Date: Aug 2009
Posts: 65
Default

Genau, bei manchen Downloadlinks - nicht bei allen - fehlen die Titel.
Hier ein Beispiel: "**External links are only visible to Support Staff**
Es erscheint im Linksammler: (1080p 30fps H264-128kbit AAC) + (192kbit AAC)

In den Plugeinstellungen am Dateinamen Pattern wurde nichts verändert.
Auch am Paketverwalter nicht.

Last edited by rapido; 31.03.2021 at 19:06.
Reply With Quote
  #4287  
Old 31.03.2021, 21:04
beronz beronz is offline
Ultra Loader
 
Join Date: Jun 2019
Posts: 47
Default

in the last two days i've some problem downloading some of the videos from youtube (i've already found a workaround)

in my subscription tab, i usually copy the link of the videos i'm interested with right click + copy address (for me, it woukl be right click + z)
some of the links are grabbed correctly, other ones are displayed on the grabbing menu as a noname file



the workaround would be copy the links of the video\videos that give this error and then re add them manually after deleting the mp4 noname file that was added before

this are 4 links that give me the error but as i told you before it shows up only if you copy the link from the subscription tab (at least i can assure you that 100% only for that tab)

**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

here's the log

31.03.21 21.03.35 <--> 31.03.21 21.04.25 jdlog://7789725302851/

QUICK EDIT: now the workaround doesn't work at all, the videos aren't grabbed properly even with that.

Last edited by beronz; 31.03.2021 at 22:35.
Reply With Quote
  #4288  
Old 31.03.2021, 23:33
FredCouples FredCouples is offline
DSL Light User
 
Join Date: Apr 2009
Posts: 32
Default No YT files names in the link grabber since today

Since today there's something seriously wrong in regards to downloading YT videos.

1) The video/audio etc. files show up in the link grabber, but without the file names! That makes them unusable unless you copy each single file name onto the links in the link grabber by hand - which takes just too much time. Somehow the hoster sign in the link grabber also changed - now it doesn't say YT but shows the "Google" logo.

2) If somebody could help me getting this fixed - how can you download a whole playlist and KEEP the order in which the playlist lists them - without JD downloading them, let's say into the same folder, in which they show up not in the original order but only alphabetically?

Geez - I hope it's just my stupidity. If not, then YT/Google are seriously cracking down on us downloaders...

I try to attach a screenshot - just (1080p 60fps H264-128kbit AAC) instead of the file name showing up.

Help? Prettyprettyplease? ;-)

Cheers,

FC
Attached Images
File Type: png YT - no file names.png (153.0 KB, 0 views)
Reply With Quote
  #4289  
Old 01.04.2021, 05:36
Transformer Transformer is offline
Vacuum Cleaner
 
Join Date: Mar 2021
Posts: 15
Default

Quote:
Originally Posted by johno4566 View Post
their are way to do it if you use google crome and download a plugin called link knipper



then scoll down to putting of the channels with all the videos you want them tell link knipper to export all the links to txt file thern copy and paste them all into j downloader at once simple how i have been doing for a long time now works well

I didn't find a plugin with this name in Chrome extension store.
Reply With Quote
  #4290  
Old 01.04.2021, 05:41
rapido rapido is offline
Mega Loader
 
Join Date: Aug 2009
Posts: 65
Default

Ein Nachtrag:

Inzwischen erscheinen ALLE Downloadlinks in dem vorgenannten verschlüsselten Modus ohne jeden Titel.
Reply With Quote
  #4291  
Old 01.04.2021, 07:24
mav mav is offline
DSL User
 
Join Date: Mar 2021
Posts: 35
Default

Quote:
Originally Posted by Jiaz View Post
@mav: SU does *replace space with underscore* but for package names there is additional cleanup in use that removes the underscores. You can disable it in Settings->Advanced Settings->GeneralSettings.cleanupfilenames
Thanks for the guidance - disabling GeneralSettings.cleanupfilenames worked.
Reply With Quote
  #4292  
Old 01.04.2021, 08:59
Robbynaish Robbynaish is offline
Junior Loader
 
Join Date: Jan 2018
Posts: 11
Default Youtube problems

Guys,

from this morning every link i import from youtube I get only a general srt and mp4 file, instead of the name of the video

Till yesterday it was working perfectly, today all video I try to import i get this (last 2 lines)



I upgraded Ijdwonlader at last version...

Thanks
Reply With Quote
  #4293  
Old 01.04.2021, 08:59
DubioserKerl DubioserKerl is offline
Baby Loader
 
Join Date: Apr 2021
Posts: 7
Default

Hallo!

Ich habe das selbe Problem. Ich habe es auch im Support Chat angesprochen, und nicht alle Benutzer scheinen das Problem zu haben.

Sehr verdächtig.

Edit: English Translation:

I have the same problem. I already mentioned it in the support chat, and it seems that not all users have this problem. Very suspicious.

Last edited by DubioserKerl; 01.04.2021 at 10:23.
Reply With Quote
  #4294  
Old 01.04.2021, 09:40
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 66,455
Default

Merged YT threads...

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #4295  
Old 01.04.2021, 10:59
JDmurphy JDmurphy is offline
Fibre Channel User
 
Join Date: Mar 2012
Posts: 120
Default

Quote:
Originally Posted by FredCouples View Post
1) The video/audio etc. files show up in the link grabber, but without the file names! That makes them unusable unless you copy each single file name onto the links in the link grabber by hand - which takes just too much time.
Came here to report this, now to confirm this. More specifically, for me:

*DATE*
*CHANNEL*
*TITLE*
do not get parsed

*ID*
*RESOLUTION*
*FPS* (etc)
do still get parsed

Interestingly, this started a long time ago but I could usually fix it by simply adding the same link once again. Over the course of yesterday it became worse and today title/channelname parsing - as well as playlist/channel parsing! - finally stopped working completely.*

Quote:
Somehow the hoster sign in the link grabber also changed - now it doesn't say YT but shows the "Google" logo.
Also confirmed ... I didn't even notice :D (it happened to other plugin icons before so I basically ignore it)

Quote:
2) If somebody could help me getting this fixed - how can you download a whole playlist and KEEP the order in which the playlist lists them
Settings » Plugins » youtube.com » Filename for Video files (sic!)
use *VIDEONUMBER* or *PLAYLIST_POSITION*
use *VIDEONUMBER[000]* for triple digit numbers

Recommendation:
I used the above earlier but then switched to
*DATE[yyMMdd]*
which is way more helpful (and the key feature that makes JD2 - as far as it works, see persistent playlist issue discussed above - still superior to 4k VD which doesn't even have numbering ).

Quote:
without JD downloading them, let's say into the same folder, in which they show up not in the original order but only alphabetically?
When using
*DATE[yyMMdd]* *CHANNEL* • *TITLE*
or
*CHANNEL* *DATE[yyMMdd]* • *TITLE*
you don't even need folders anymore.

The cherry on top, for me personally, would be the ability to parse channel names and convert them to initialisms - examples:
Linus Tech Tips —> LTT
ImperialJedi —> IJ

This could even be automated, but unfortunately would fail in many cases - examples:
Half as Interesting —> HI (instead of HaI)
JayzTwoCents —> JTC
JayzTwoCars —> also JTC
Czardus —> C (unusable)
Bitwit —> B (unusable)

Therefore a user defined lookup table for the channel name conversions would be inevitable.

Quote:
Geez - I hope it's just my stupidity. If not, then YT/Google are seriously cracking down on us downloaders...
In case you are referring to 1)
Youtube has given the JD devs a hard time by screwing around with title and date formats ever since. [* For example, during writing this I discovered channel parsing for some channels works (again?), but for my major channels it still doesn't.]
In case you are referring to 2)
Browsing the plugin settings and advanced settings always has something up its sleeve ;>

Quote:
Help? Prettyprettyplease? ;-)
Welcome! :o)

P.S.: As for the double blank lines above, I spent 10 minutes on trying everything possible to get them out, but the stoopit editor keeps inserting them.
P.P.S.: I "solved" it by switching from Wysiwyg to Source mode.

Edith: Apparently during my writing already some confirming peeps arrived ;D

Last edited by JDmurphy; 01.04.2021 at 11:30.
Reply With Quote
  #4296  
Old 01.04.2021, 11:08
JDmurphy JDmurphy is offline
Fibre Channel User
 
Join Date: Mar 2012
Posts: 120
Default

Quote:
Originally Posted by DubioserKerl View Post
I already mentioned it in the support chat, and it seems that not all users have this problem. Very suspicious.
Seemingly it depends on the specific channel - at least for me the playlist/channel parsing issue does - but this also could result in inconsistent user reports.


Edith again: For the channels where channel parsing looked like it still worked or worked again, only the "parse channel?" confirmation dialog appears - yet in any case only the link grabber icon pops up for a few seconds and then nothing happens.

Last edited by JDmurphy; 01.04.2021 at 11:24.
Reply With Quote
  #4297  
Old 01.04.2021, 11:30
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 66,455
Default

Fixed and update is live.

YT has added a new "consent" banner/page you see when first accessing it (e.g. via private browser window).
(This may only get displayed for some countries.)

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist

Last edited by pspzockerscene; 01.04.2021 at 11:40.
Reply With Quote
  #4298  
Old 01.04.2021, 12:12
JDmurphy JDmurphy is offline
Fibre Channel User
 
Join Date: Mar 2012
Posts: 120
Default

Quote:
Originally Posted by pspzockerscene View Post
Fixed and update is live.
Fix for channel parsing confirmed (but still has previous bugs, see below).

Fix for playlist parsing confirmed (but seems to have unrelated issues).


channel parsing

In case a package for a channel download already exists, in some cases (I couldn't figure out let alone reproduce what it depends on => thus no logfile) new links get added on top instead of alphabetically sorted or added below.

I am aware of the fact that as as soon as you mess around with the link order within a package manually, automatic sorting-in of new links doesn't work anymore.
Therefore I made sure to not touch the package at all (after repeatedly setting the sort order to "by name") yet newly parsed links get added on top.

Possible solutions:
1) always adhere to the last sort order applied when adding new links
2) if that's impractical, always add new links at the bottom not on top


playlist parsing

The intended behavior seems to be to include single files that already exist in "Various Files" into a matching package once the latter is created automatically by downloading multiple files of the same source.
In my case, the custom package name is:
*CHANNEL* - *PLAYLIST_NAME*
Hence single existing files or single files added later don't get included in this package automatically since they don't meet the criteria for automated consolidation even if they are downloaded by means of a combined video/playlist URL.

Suggestion:
Download single files that are parsed from a combined video/playlist link
(watch?v=xxxxxxxxxxx&list=yyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyy)
into a package according to the "costomized package name" user setting.
Automated consolidation should then work by itself without further fixes.


Edit: typo fix

Last edited by JDmurphy; 01.04.2021 at 12:22.
Reply With Quote
  #4299  
Old 01.04.2021, 12:21
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 66,455
Default

Quote:
Originally Posted by JDmurphy View Post
Suggestion:
Download single files that are parsed from a combined video/playlist link
(watch?v=xxxxxxxxxxx&list=yyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyy)
into a package according to the "costomized package name" user setting.
Automated consolidation should then work by itself without further fixes.


Edit: typo fix
You should be able to do this via Packagizer rule(s).
If not, please provide example URLs.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #4300  
Old 01.04.2021, 12:25
JDmurphy JDmurphy is offline
Fibre Channel User
 
Join Date: Mar 2012
Posts: 120
Default

Quote:
Originally Posted by pspzockerscene View Post
You should be able to do this via Packagizer rule(s).
Imma try this in case making this default gets denied.
Since I don't see any downside in making this default,
the suggestion was to make this the default behavior.


How about the sorting issue related to channel parsing?
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 03:28.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2023, Jelsoft Enterprises Ltd.