JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 05.06.2019, 19:05
taychive taychive is offline
I will play nice!
 
Join Date: Feb 2019
Posts: 8
Default WatchFolder crawljob skipping some download links. As individual jobs they all work.

Hello,

I have i have a script on another computer that is generating crawljob files and placing them in the JDownerloader2's watch folder. Depending on other unrelated factors in the script, it may put up to 12 different download jobs in a single crawljob file.

It seemed like everything was working but now under closer inspection i am noticing that there are some links that will not get parse if included in a multi-download crawjob file. However if i put each download into individual crawljob files then all the links get parsed.

In this crawljob file JDownloader2 will not download the url ending in "vAw". The only way i can download this is to put it in its own crawljob file.

I do not understand what is special about that download job and why it doesn't work yet other similar crawljobs with 12 unique links in the same format and options work fine.

Sorry for the weird links. This is just what was at the top of my error list that demonstrates the intermittent problem i am having.

Last edited by Jiaz; 05.06.2019 at 19:34.
Reply With Quote
  #2  
Old 05.06.2019, 19:34
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 66,134
Default

will be fixed with next update. rate limiting by mega and too *fast* crawling caused issue in plugin
__________________
JD-Dev & Server-Admin
Reply With Quote
  #3  
Old 13.06.2019, 23:44
taychive taychive is offline
I will play nice!
 
Join Date: Feb 2019
Posts: 8
Default

Sorry I cannot verify if the problem is fixed since the original links are offline now and i only happened to noticed them out of chance. I will take it as a good sign that i have not seen the issue again and leave this as solved unless i can find the problem again.

Thanks for taking a look!
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 22:43.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2019, Jelsoft Enterprises Ltd.