LinkGrabber: save and resume crawl state
Some links take a day or more to crawl (for example huge YouTube channels with over ten thousand videos).
Sometimes the computer crashes, or has to be rebooted, or the internet disconnects, or I have to switch to a different computer with JDownloader Portable, etc., and then the crawling has to start all over again. The crawling attempt can waste many weeks.
Is it possible to save the state of a running Linkgrabber and resume later?
|