JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 03.10.2019, 11:43
SMS SMS is offline
DSL Light User
 
Join Date: Jun 2019
Posts: 30
Default YouTube plugin: start crawling in the middle

Some YouTube channels have over ten thousand videos, and crawling them takes many hours.

It would be great to tell the LinkGrabber to crawl the YouTube channel starting from video 5000 for example, in order to resume an earlier crawl, or if I'm interested in older videos first.

Or are there special YouTube links that hide the first 4999 videos, maybe something like channel/.../video_list?start_position=5000 or so?

I don't want to have to plan days in advance. I want to be able to start crawling anytime, and resume anytime.

Unimportant details:
Spoiler:
I don't always have so many consecutive hours to crawl a huge YouTube channel (for example the computer crashes, or I have to reboot). Also I can't leave the computer running overnight, and hybernation causes additional problems: coming out of hybernation doesn't always work on my computer; the internet is not immediately connected after hybernation, and possibly this causes some links to be dismissed as offline and not added to the LinkGrabber.
Reply With Quote
  #2  
Old 03.10.2019, 11:58
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 68,318
Default

Sounds like this request is connected to https://board.jdownloader.org/showthread.php?t=81757 ?
So once it would be possible to pause/resume crawling, then this won't be needed anymore, would it?
__________________
JD-Dev & Server-Admin
Reply With Quote
  #3  
Old 03.10.2019, 16:24
SMS SMS is offline
DSL Light User
 
Join Date: Jun 2019
Posts: 30
Default

This feature would also be cool for other situations, for example downloading only old videos of a channel. Currently doing that requires waiting for the complete crawl, and including the date into the file naming pattern even if one doesn't want the date in the file name.
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 10:09.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.