#1
|
|||
|
|||
YouTube plugin: start crawling in the middle
Some YouTube channels have over ten thousand videos, and crawling them takes many hours.
It would be great to tell the LinkGrabber to crawl the YouTube channel starting from video 5000 for example, in order to resume an earlier crawl, or if I'm interested in older videos first. Or are there special YouTube links that hide the first 4999 videos, maybe something like channel/.../video_list?start_position=5000 or so? I don't want to have to plan days in advance. I want to be able to start crawling anytime, and resume anytime. Unimportant details:
Spoiler:
I don't always have so many consecutive hours to crawl a huge YouTube channel (for example the computer crashes, or I have to reboot). Also I can't leave the computer running overnight, and hybernation causes additional problems: coming out of hybernation doesn't always work on my computer; the internet is not immediately connected after hybernation, and possibly this causes some links to be dismissed as offline and not added to the LinkGrabber.
|
Thread Tools | |
Display Modes | |
|
|