[lezboyd]

I am using JDownloader2 (JD2) to download imagesets from vipr.im.

Things worked smoothly in the past, but recently I have noticed a high level of dropped connections while downloading (links load into JD2 just fine, but errors occur after starting download). Errors thrown include "Final Destination Link is not an image" , "Try Restarting this link again" , "Unknown Host error" (sic). All of these are usually solved by resetting the download link. However, if you are downloading a set of 120 pics and this keeps occurring, you are basically playing whack-a-mole within JD2, instead of an unattended download.

I am sure this is server-side, not because of me or JD2, since (a) all other hosts work fine, (b) this started happening recently with vipr.im, which was usually pretty stable in the past.

Anyone know why this may be happening, or facing the same issue?

[Jiaz]

Please provide example links and a log, see
https://support.jdownloader.org/Know...d-session-logs
and post shown logID here. Wait for error to happen and then create the log

[lezboyd]

Here is the log:

07.09.21 20.30.10 <--> 07.09.21 20.47.00 jdlog://1457825302851/

Example Links: Downloaded this whole set:

**External links are only visible to Support Staff****External links are only visible to Support Staff**

[Jiaz]

@lezboyd: Cloudflare protection kicks in and causes the issue
see https://board.jdownloader.org/showthread.php?t=83712
There is not much you can do about. I will set a request limit in plugin, maybe that helps

[lezboyd]

Update: I am no longer getting errors while downloading from vipr.im. I suppose cloudflare was kicking in and dropping concurrent connections. Now that you have limited request limit to one at a time, at least the downloads are now unattended and without errors.

Thanks. Issue Solved indeed.

[pspzockerscene]

Thanks for your feedback!

-psp-

[lezboyd]

Update 2 : The "one file at a time" change has got rid of the connection dropping while downloading, for sure, but it has also had the side-effect of loading links into LinkGrabber excruciatingly slow.

Is there any way the links can be made to load faster into Linkgrabber, while downloading can still happen "one at a time"? There was never any connection dropping while loading into LinkGrabber.

[Jiaz]

@lezboyd: can you provide some example links/galleries with vipr.im links? then we can check/update the plugin

[lezboyd]

Test case: I loaded one gallery into the Linkgrabber, then started downloading it. While that gallery was being downloaded in the Downloads tab, I loaded 5 more of these galleries in LinkGrabber tab, using the Add New Links option, with about a min in between each gallery (the time taken to copy the links from the browser and then using the add new links option in JD2, etc.)

It took 23 minutes to load all the links from the first gallery of these 5 galleries into Linkgrabber while a download was ongoing in the downloads tab, and multiple galleries were loaded in Linkgrabber.

Gallery Links:

**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

[pspzockerscene]

I don't see a way to check them without running into rate-limits again.
Usually such XFS websites have a "mass linkchecking" feature which can be used to check up to 50 links at the same time but theirs seems to be broken:
vipr.im/?op=checkfiles

You could go ahead and disable linkchecking globally whenever you want to add a lot of those URLs:
Settings -> Advanced Settings ->

LinkCollector: dolinkcheck

--> Disable this

You should not permanently leave this disabled as JD will not look for filename/size/status as long as this is enabled.

-psp-

[Jiaz]

@pspzockerscene: I was able to speedup and reduce the number of requests by half
@lezboyd: wait for next plugin update, you should notice a significant/time by half speed up

[pspzockerscene]

Originally Posted by Jiaz

@pspzockerscene: I was able to speedup and reduce the number of requests by half

Thanks indeed I've overlooked that...