#1
|
|||
|
|||
YouTube plugin: start crawling in the middle
Some YouTube channels have over ten thousand videos, and crawling them takes many hours.
It would be great to tell the LinkGrabber to crawl the YouTube channel starting from video 5000 for example, in order to resume an earlier crawl, or if I'm interested in older videos first. Or are there special YouTube links that hide the first 4999 videos, maybe something like channel/.../video_list?start_position=5000 or so? I don't want to have to plan days in advance. I want to be able to start crawling anytime, and resume anytime. Unimportant details:
Spoiler:
I don't always have so many consecutive hours to crawl a huge YouTube channel (for example the computer crashes, or I have to reboot). Also I can't leave the computer running overnight, and hybernation causes additional problems: coming out of hybernation doesn't always work on my computer; the internet is not immediately connected after hybernation, and possibly this causes some links to be dismissed as offline and not added to the LinkGrabber.
|
#2
|
||||
|
||||
Sounds like this request is connected to https://board.jdownloader.org/showthread.php?t=81757 ?
So once it would be possible to pause/resume crawling, then this won't be needed anymore, would it?
__________________
JD-Dev & Server-Admin |
#3
|
|||
|
|||
This feature would also be cool for other situations, for example downloading only old videos of a channel. Currently doing that requires waiting for the complete crawl, and including the date into the file naming pattern even if one doesn't want the date in the file name.
|
Thread Tools | |
Display Modes | |
|
|