View Single Post
  #4  
Old 30.07.2020, 18:10
eMuse eMuse is offline
Junior Loader
 
Join Date: Dec 2019
Posts: 14
Default

By "max simultan crawl instances", do you mean Settings -> Advanced Settings -> Link Crawler: Max Threads -> 1, and then restarting? Yes, this largely solves the problem (95% success after first crawl, 99% after adding a second crawl, 100% after 3rd or 4th crawl, which is much better than before).

So it can't be individually set for this specific website, and you won't include it in the plugin settings, i.e. users should realize on their own that some items are missing in the LinkGrabber? Then maybe let the links with 503 error explicitly appear in the LinkGrabber, so that users know that those are missing?

Thanks!

Last edited by eMuse; 30.07.2020 at 18:26.
Reply With Quote