[Solved] Linkgrabber / Crawling slower than previous

[snuffleupagus]

Hi,

So I absolutely love jdownloader, amazing work on this. But one thing I noticed is that when I initially used it and recent usage there is an issue with how quickly it parses the clipboard copied items. I don't recall having this issue even with the LinkCollector: Do Link Check enabled in ex 1 bu recently it's extremely slower than previously experienced.

ex. 1
- have about 300 lines in an excel file and only of those 52 have urls with the others are blank.
- in theory it should parse those in less than 30 seconds or so (including link checks) but it's taking considerably longer time.

ex. 2
- have my sms history with embedded URLs
- it's about ~5300 lines
- 896 occurrences of URLs (web site links, social media links, YouTube, etc)

I'd say an hour at most or less. It's going on for 12hrs.

I used https://board.jdownloader.org/showthread.php?t=58776
and disabled as it shared in the thread... Go into the expert settings, type in "LinkCollector: Do Link Check" --> Disable that

Question is there a way to reduce the time significantly?? 12+ for 5k lines seems like something isn't working as intended.

All I want is to parse the urls embedded in the text file quicker.