JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 09.05.2024, 14:44
StefanM's Avatar
StefanM StefanM is offline
JD Legend
 
Join Date: Oct 2020
Posts: 722
Default Unsuccessful download attempt skipped after how many seconds - adjustable??

Is there a setting, how long JD tries to download a file until it gives up and moves on with other files?

Scenario
I have a very great number of pending links in a folder/package in the downloads pane. I start downloads for all of them using the Force Download Start command. This command is set to a maximum of 10 files simultaneously.

Now, when JD tries to download from URLs which don't respond, it looks to me, as if JD waits almost forever before it moves on with other URLs.

I would like to adjust this time/timeout.

How do I do this? (in Advanced Settings I guess)
Reply With Quote
  #2  
Old 11.05.2024, 17:44
StefanM's Avatar
StefanM StefanM is offline
JD Legend
 
Join Date: Oct 2020
Posts: 722
Default

Quote:
Originally Posted by StefanM View Post
Is there a setting, how long JD tries to download a file until it gives up and moves on with other files?
...
Should have better asked this in the German section?
Reply With Quote
  #3  
Old 12.05.2024, 01:38
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,668
Default

Far as I recall its not a user defined option. Might be a little different controlling / retry stuff for force mode but I can't guarantee Im correct. You could do some tests like: If they are all on the same hoster, you could use the option max sim dl per host or 'domain rules' (advanced settings), and not using force start and consider setting a higher priority for the package/downloads to manipulate in that fashion.
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #4  
Old 12.05.2024, 10:11
StefanM's Avatar
StefanM StefanM is offline
JD Legend
 
Join Date: Oct 2020
Posts: 722
Default

Quote:
Originally Posted by raztoki View Post
Far as I recall its not a user defined option.
Thanks for answering. I can only hope you're wrong.

Quote:
Originally Posted by raztoki View Post
Might be a little different controlling / retry stuff for force mode but I can't guarantee Im correct. You could do some tests like: If they are all on the same hoster, you could use the option max sim dl per host or 'domain rules' (advanced settings), and not using force start and consider setting a higher priority for the package/downloads to manipulate in that fashion.
No, this won't help. Maybe I did not explain my problem clear enough:

Let's say I have 1,000 files in the downloads list.
Let's say I have JD set to 10 downloads at any one time.
JD starts with the first 10 files, everything is fine.

Now JD comes to links where the response time is extremely slow. Once it has come to 10 of such files/links, to me it seems as if JD waits for forever, instead of skipping those links after a certain timeout.

And what I would like to do is adjusting this timeout.
Hope that Jiaz or Pspzockerscene can help.
Reply With Quote
  #5  
Old 12.05.2024, 12:02
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,668
Default

Well it was clear for the component that you gave, one had to make assumptions from that.

Further assumptions
This does kinda reminds me of a polish user that has had issues on and off for years; Along the lines of socket/connection timeout issues have caused issues. Either from misconfigured settings on his side (20 : 20 ; max chunks:max sim dl) or combination of decrypter + hoster work, or with over loaded wan, or site is punishing you due to the load that you're generating (doesn't give errors just stops responding).

If downloads are balanced across multiple host providers then this is most likely on your side
Slow response times due to high latency on your end (typically due to your wan being saturation). JD doesn't really deal well with socket issues well overall. Specially on decrypter side, for example a complex task can fail at the first socket issue, halt and not retry. Download side (hoster) it will retry, but this task will take time as error timeouts timeframes need to expire.

Sure we can wait for Jiaz or Psp to respond further =]


raztoki
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]

Last edited by raztoki; 12.05.2024 at 12:15.
Reply With Quote
  #6  
Old 12.05.2024, 15:49
StefanM's Avatar
StefanM StefanM is offline
JD Legend
 
Join Date: Oct 2020
Posts: 722
Default

Quote:
Originally Posted by raztoki View Post
...or site is punishing you due to the load that you're generating (doesn't give errors just stops responding).
This could very well be the reason.

Quote:
Originally Posted by raztoki View Post
If downloads are balanced across multiple host providers then this is most likely on your side
Agreed. But do you have any advice on how to achieve this?

Afaik, downloads are being performed in alphabetical order of the links. So, it would start with e.g.

siteA.com/folder1/file1
siteA.com/folder1/file2
siteA.com/folder1/file3
...
siteA.com/folder2/file1
siteA.com/folder2/file2
siteA.com/folder2/file3
...
when done with siteA, JD would continue with siteB
...
siteB.com/folder1/file1
siteB.com/folder1/file2
siteB.com/folder1/file3
...
siteB.com/folder2/file1
siteB.com/folder2/file2
siteB.com/folder2/file3
...
when done with siteB, JD would continue with siteC
and so on.


And your recommendation would be to jump between the sites:
siteA, siteB, siteC,...

But how can I force JD to "jump" this way?
Reply With Quote
  #7  
Old 13.05.2024, 01:36
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,668
Default

no real way with default jd other than utilising some of the existing features
you could do it via micro management on your part with priorities
highest =a, high = b, normal c
else you could just use
use max sim per host rules
so 10 max sim dl
5 max sim per host, it will download half from the first two available hosts in your list.

Both priorities and max sim per host wouldn't ensure it wouldn't jump to third host c before a or b is finished due to race conditions or time restrictions preventing progression of a or b

alternatively you could create maybe event scripter script and program it in a fashion to do this micro management on your behalf. disabling all downloads, and enabling it when it meets your conditions. ensuring it does as you wish vs how jd is made to work

raztoki
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #8  
Old 13.05.2024, 16:08
StefanM's Avatar
StefanM StefanM is offline
JD Legend
 
Join Date: Oct 2020
Posts: 722
Default

Quote:
Originally Posted by raztoki View Post
5 max sim per host, it will download half from the first two available hosts in your list.
Thanks for all your ideas. But how do I set 5 simultaneous downloads per host?

In Advanced Settings I only can enable or disable Max Downloads Per Host.
Reply With Quote
  #9  
Old 18.05.2024, 12:03
StefanM's Avatar
StefanM StefanM is offline
JD Legend
 
Join Date: Oct 2020
Posts: 722
Default Timeout bei erfolglosen Downloadversuchen

Da ich im englischen Support-Bereich mit meiner Frage nicht so recht weitergekommen bin, frage ich heute hier noch einmal:

Gibt es eine Einstellung, wie lange JD versucht, eine Datei herunterzuladen, bis er aufgibt und den Download mit den nächsten Dateien fortsetzt?

Szenario
Ich habe z.B. 1.000 zum Download anstehende Links in einem Ordner/Package im Downloadbereich. Ich starte die Downloads. Einstellung: max.10 Downloads gleichzeitig.

Wenn JD nun versucht, von Adressen herunterzuladen, die zwar erreichbar sind, aber (wegen Überlastung?) keine Daten senden, sieht es für mich so aus, als würde JD eine Ewigkeit warten, bevor er mit anderen Adressen fortfährt.

Zum Teil hängt JD tatsächliche dauerhaft fest. Nur durch "disable" dieser Adressen kann der Download von anderen Adressen fortgesetzt werden.

Ich möchte daher ein Timeout einstellen bzw. anpassen.

Wie mache ich das?


EDIT NACHTRAG:
Habe nach dem Stichwort Timeout gesucht, bin aber nicht wirklich fündig geworden unter den 38 Ergebnissen.

Und diese Einstellung bezieht sich ja wohl nur darauf, wenn ich über einen Proxy arbeite?
GeneralSettings: Proxy Host Ban Timeout
Das Default Timeout 900000 verstehe ich als 900 sec.???

Last edited by StefanM; 18.05.2024 at 12:34.
Reply With Quote
  #10  
Old 18.05.2024, 14:45
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 81,024
Default

Nochmals hier: Ich hab das Thema auf dem Schirm, nur noch keine Zeit gefunden. Den Thread nochmals wiederholen hilft hier net
__________________
JD-Dev & Server-Admin
Reply With Quote
  #11  
Old 19.05.2024, 04:20
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,668
Default

Quote:
Originally Posted by StefanM View Post
Thanks for all your ideas. But how do I set 5 simultaneous downloads per host
In the download tab, right hand bottom corner screwdriver x crescent/spanner there are four settings in which you can define, chunks, max sim dl, max sim per host, and speed limit or you can access it also right clicking on speed graphic location (top right)

Quote:
Originally Posted by StefanM View Post
In Advanced Settings I only can enable or disable Max Downloads Per Host.
advanced should all settings that are available within the GUI and additional which are not, both enable and the int value is present but for some reason enable/disable has different naming of the key structure GeneralSettings.
GeneralSettings.maxdownloadsperhostenabled
GeneralSettings.maxsimultanedownloadsperhost
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #12  
Old 19.05.2024, 11:01
StefanM's Avatar
StefanM StefanM is offline
JD Legend
 
Join Date: Oct 2020
Posts: 722
Default

Quote:
Originally Posted by raztoki View Post
In the download tab, right hand bottom corner...
Thanks!
Found it here:
GeneralSettings.maxdownloadsperhostenabled
GeneralSettings.maxsimultanedownloadsperhost

in the meantime.

The default setting is "off" which means "unlimited".
Changing it to e.g. 5 per host didn't really help.

And Jiaz told me that he will take a look at my issue.

To me at looks like the result of some kind of host overload. The host answers "that much" that JD stays with the "not uploading" host. And I cannot see, which causes JD
  • to finally continue with another address after minutes or even hours
  • or even not continuing at all, hanging forever that is
In the latter case, the only way for JD to continue is to disable those downloads/addresses manually.

Maybe with my problem I can encourage Jiaz to add some adjustable timeout, as there are so many different adjustable timeouts already in "advanced settings".

By the way:
Do you know of any document which contains more detailed information about those different settings, than the "?" does in advanced settings?

Last edited by StefanM; 19.05.2024 at 14:22.
Reply With Quote
  #13  
Old 19.05.2024, 14:01
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,668
Default

yes by default its off. ok, at least you tried.

Error messages sound a vague maybe lost in translation?

See what Jiaz comes up with =]

documentation, there isn't any really.
The only well documented parts of JD is the my/jd API, has excellent design and documentation, congrats goes to the two behind it.
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]

Last edited by raztoki; 19.05.2024 at 14:04.
Reply With Quote
  #14  
Old 27.05.2024, 14:47
StefanM's Avatar
StefanM StefanM is offline
JD Legend
 
Join Date: Oct 2020
Posts: 722
Default

Quote:
Originally Posted by Jiaz View Post
Nochmals hier: Ich hab das Thema auf dem Schirm, nur noch keine Zeit gefunden. Den Thread nochmals wiederholen hilft hier net
Since my German thread has just been closed by PSP, I'm sending my friendly reminder now here. Just in case it has been forgotten...
Reply With Quote
  #15  
Old 27.05.2024, 14:49
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 72,961
Default

Team: Reminder - thread was pushed here.

The current retry logic is not ideal and also there aren't too many settings to let the user influence it.

I also do't want to provide a too detailed descriptions here since items can fail due to a lot of different reasons so without logs and example URLs it is nearly impossible to tell why your downloads fail and which retry behavior gets appended.
Also while you assume that your downloads are running into a timeout, I would still like to have logs.
I've made a lot of wrong assumptions in the past so I'm counting on logs when it comes to analysis of such problems!
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 22:38.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.