Thread: [User feedback required] Checking the status of a crawler.
View Single Post
  #2  
Old 25.11.2021, 17:43
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 63,127
Default

Hi,
Quote:
Originally Posted by woolf View Post
Is there any way to check what are those "stuck" links?
No.
All you can do is cancel crawl processes by rightclicking on the crawler icon -> Cancel

Quote:
Originally Posted by woolf View Post
Is there any gui "queue" of links being processed?
We had a progress bar a while back but it has been removed for various (good) reasons.
Some crawlers have good logging of their progress so you could check your "logs" folder manually (located in your JD install dir).

Quote:
Originally Posted by woolf View Post
For example I copy 100 links and 95 are already added to linkgrabber by crawler so I know there are still 5 missing, but I can't find out which exactly are those to copy and try download them manually.
How would a status help in this case?
JD will re-process all of them but it will not add duplicates to your linkgrabber by default.
So if you e.g. re-add a big twitter profile and you're only waiting for JD to find some items you haven't added last time, indeed you won't know the progress until new URLs show up in your linkgrabber.

While you can't do much here is what you can do:
1. When re-adding big items such as profiles, delete all previously added items from your linkgrabber (or at least move them to the downloadlist) so you can see the added links ("as a progress") live in your linkgrabber.
2. Some plugins have special settings to speed-up the crawl- and/or linkchecking process.
Check if that is possible for the website you're adding links from, see Settings -> Plugins -> Search for the website you're using (no result = no settings available for that website/plugin).
3. For some websites (rare case), you can e.g. define the order to add items or the page/date to start from.
There is no documentation for this so you will ask us separately for each website or look it up in our source code.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote