JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #21  
Old 02.05.2020, 10:05
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 67,320
Default

In case your JDownloader is installed with bundled one. You've got rename the java/jre folder so the launcher will use the system installed java
__________________
JD-Dev & Server-Admin
Reply With Quote
  #22  
Old 23.06.2020, 11:39
thetoad thetoad is offline
Tornado
 
Join Date: Jan 2014
Posts: 228
Default longer read timeout?

so as we know, rapidgato has an issue due to the way they rate limit and delays between "packets" get longer and longer as time goes on.

I have my read timeout said to the max (10 minutes I believe) and after 13-14GB it consistently errors out with a read timeout.

any chance the max can be increased?
Reply With Quote
  #23  
Old 23.06.2020, 13:07
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 54,410
Default

Hi,

we currently got a readtimeout of 120 seconds for rapidgator - that should be more than enough ...

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
How to create a log || Wie man einen Log erstellt
Captcha FAQ EN || Captcha FAQ DE || Erste Schritte & Tutorials
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #24  
Old 23.06.2020, 17:02
thetoad thetoad is offline
Tornado
 
Join Date: Jan 2014
Posts: 228
Default

I thought that was 640KB?

it's not. for me. as I wrote, having consistent issues on an 18GB file that is always dying around the 13-14GB mark (yes, in free mode, have a work around and lots of patience) and per my observation its gaps between "packets" grows longer and longer as the file gets larger.

I've been forcing those large ones to only be downlaoded without a proxy.

14.06.20 17.15.59 <--> 23.06.20 18.01.29 jdlog://9457025302851/
Reply With Quote
  #25  
Old 24.06.2020, 12:09
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 54,410
Default

Quote:
Originally Posted by thetoad View Post
I thought that was 640KB?
??

Youg log contains a lot of these exceptions:
Code:
0:Socks(SOCKS5:)null|EndPoint:rapidgator.net:443|Exception:org.appwork.utils.net.socketconnection.Socks5SocketConnection$Socks5AuthException: ERROR:1
Also your log does indeed contain read timeouts but again:
Why do you think it makes sense to allow higher timeouts than 120 seconds?
Would 180 seconds be better for you?
Have you ever tried it via browser using the same proxies?
Maybe rapidgator just stops sending data sometimes ...

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
How to create a log || Wie man einen Log erstellt
Captcha FAQ EN || Captcha FAQ DE || Erste Schritte & Tutorials
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #26  
Old 25.06.2020, 08:16
thetoad thetoad is offline
Tornado
 
Join Date: Jan 2014
Posts: 228
Default

yes, my logs are huge, because I download a lot. I'm not complaining about the proxy connections (I think the proxy connections worsen the rapidgator issue, as no traffic for extended periods of time cause the proxy side to timeout itself).

This is without proxies.

My observation is that the longer a free rapidgator download goes, the longer it pauses and hence induces a timeout.

i.e. before I motivated you to extend the default timeout, I'd get timeouts on even 1-2GB files constantly, once you changed that, it stopped.

When I moved it to 5 minutes, I was able to download 5GB files consistently, but ~10GB were causing problems

when I moved it to 10 minutes I was then able to download ~10GB files consistently.

I can't easily move it beyond that (perhaps hacking the json config directly?), but its now always failing in the 13-14GB range. I'd like to try it with a 20 minute timeout and see what happens.

you maybe right that it doesn't change anything, but I'd like to be able to prove that. I'm not asking to change the rapidgator setting, I'm asking to change the limit in the advance settings.

it could also be that I'm totally wrong about the advance setting and my analysis is off
Reply With Quote
  #27  
Old 25.06.2020, 13:17
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 54,410
Default

I've added a plugin setting for the next update so you can define the read-timeout yourself:

Please also keep in mind that we're open source so you can simply grab our code, do all kinds of experiments and check back if you found something we should officially change and release for all users

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
How to create a log || Wie man einen Log erstellt
Captcha FAQ EN || Captcha FAQ DE || Erste Schritte & Tutorials
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist

Last edited by pspzockerscene; 25.06.2020 at 13:20.
Reply With Quote
  #28  
Old 25.06.2020, 13:31
thetoad thetoad is offline
Tornado
 
Join Date: Jan 2014
Posts: 228
Default

so from what I understand, the the http read timeout doesn't impact this? does that do anything (or does this override it?)
Reply With Quote
  #29  
Old 25.06.2020, 13:42
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 54,410
Default

What do you mean?
The alread existing advanced setting?

No - the plugin overrides this as it is already using a non-default value.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
How to create a log || Wie man einen Log erstellt
Captcha FAQ EN || Captcha FAQ DE || Erste Schritte & Tutorials
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #30  
Old 25.06.2020, 13:49
thetoad thetoad is offline
Tornado
 
Join Date: Jan 2014
Posts: 228
Default

ok, then perhaps my analysis was wrong. I'll experiment with the setting and see if I can complete a the ~19GB file once its available. will take a few days at at 100kbps
Reply With Quote
  #31  
Old 25.06.2020, 14:00
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 54,410
Default

I've updated it to allow max. 5 minutes - serverside it is uncommon to allow connections to be open for such huge amounts of time e.g. >5 minutes.

Your issue might either be your proxy or RG itself is killing the connection.
Also, so far you're the only user who reported this kind of issue.

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
How to create a log || Wie man einen Log erstellt
Captcha FAQ EN || Captcha FAQ DE || Erste Schritte & Tutorials
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #32  
Old 25.06.2020, 15:18
thetoad thetoad is offline
Tornado
 
Join Date: Jan 2014
Posts: 228
Default

I might be the only user who is able to download 10-20GB links over a free account regularly from rapidgator
Reply With Quote
  #33  
Old 25.06.2020, 15:19
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 54,410
Default

Quote:
Originally Posted by thetoad View Post
I might be the only user who is able to download 10-20GB links over a free account regularly from rapidgator
I doubt it.
__________________
JD Supporter, Plugin Dev. & Community Manager
How to create a log || Wie man einen Log erstellt
Captcha FAQ EN || Captcha FAQ DE || Erste Schritte & Tutorials
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #34  
Old 25.06.2020, 15:28
thetoad thetoad is offline
Tornado
 
Join Date: Jan 2014
Posts: 228
Default

and here I thought I was the only one crazy enough to try and download a 20GB at 100kbps (which is somewhat the equivalent of what I did 2+ decades ago of download 1+GB over a 56k modem)
Reply With Quote
  #35  
Old 07.07.2020, 12:22
thetoad thetoad is offline
Tornado
 
Join Date: Jan 2014
Posts: 228
Default

wondering what happened? do plugin updates not happen semi regularly anymore? old experince was that a few days after a commit was made to a plugin, jd2 would get upgraded.
Reply With Quote
  #36  
Old 07.07.2020, 12:26
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 54,410
Default

Sorry, we're busy with other stuff currently - please be patient and wait.

This has been the only disruption for a long time now.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
How to create a log || Wie man einen Log erstellt
Captcha FAQ EN || Captcha FAQ DE || Erste Schritte & Tutorials
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #37  
Old 08.07.2020, 11:53
thetoad thetoad is offline
Tornado
 
Join Date: Jan 2014
Posts: 228
Default

no problem, was just wondering.
Reply With Quote
  #38  
Old 12.07.2020, 00:19
thetoad thetoad is offline
Tornado
 
Join Date: Jan 2014
Posts: 228
Default

so, I'm about 12+GB into my download and my stop watch measured delays between "packets" has increased to about 2m15s (at aroud the 6GB mark it was about half that). about 16 hours to go. will check in the morning to see what the gap is. hopefully it will be able to complete now. but perhaps something else will impact it. (18GB at 100kbps takes a really really long time)
Reply With Quote
  #39  
Old 12.07.2020, 08:57
thetoad thetoad is offline
Tornado
 
Join Date: Jan 2014
Posts: 228
Default

now 15+GB through and the delay between "packets" is clos to 2m50s (when I say [packets, I don't mean individual pakcets, its more like bursts, i.e. gets the average download bac k to 100KBps).

also, after some period of time (maybe 1 day?) it seems to allow me to download from the same IP again (i.e. was able to start another download in browser), while JD2 won't let me start another one.

Last edited by thetoad; 12.07.2020 at 09:00.
Reply With Quote
  #40  
Old 12.07.2020, 15:42
thetoad thetoad is offline
Tornado
 
Join Date: Jan 2014
Posts: 228
Default

close to 17.5 GB in, and the delay between bursts is now about 3m15s

I think this indicates that my hypothesis was correct, and one should either make the timeout dynamic (i.e. start off with a timeout of 60s, constantly readjust to delta between bursts +60s or make the max even longer than the 300s it currently maxes at. (i.e. I'd expect at 40GB to need longer than 300s between burstsat the growth rate I'm seeing)
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 07:07.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.