JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 21.09.2019, 15:53
djmakinera djmakinera is offline
JD Legend
 
Join Date: May 2010
Location: Poland
Posts: 8,342
Default Connection-Timeout - How to increase (Advanced Setting)?

Advanced connection settings.

Connection-Timeout- How to increase?

Deep search HTML pages


How to increase the loading time of any page when the page loads very slowly.
JD2 refuses to continue parsing because the default time is too short.
No example links, because it is private.

Code:
Connection-Timeout: 20000ms
Read-Timeout: 60000ms
----------------Request-------------------------
-------------Not Connected Yet!-----------------

----------------Response Information------------
-------------Not Connected Yet!------------------


	at jd.http.Browser.openRequestConnection(Browser.java:1744)
	at jd.http.Browser.openRequestConnection(Browser.java:1553)
	at org.jdownloader.plugins.components.antiDDoSForDecrypt.openAntiDDoSRequestConnection(antiDDoSForDecrypt.java:326)
	at jd.plugins.decrypter.LinkCrawlerDeepHelper.openCrawlDeeperConnection(LinkCrawlerDeepHelper.java:148)
	at jd.plugins.decrypter.LinkCrawlerDeepHelper.openConnection(LinkCrawlerDeepHelper.java:74)
	at jd.controlling.linkcrawler.LinkCrawler.openCrawlDeeperConnection(LinkCrawler.java:1047)
	at jd.controlling.linkcrawler.LinkCrawler.crawlDeeperOrMatchingRule(LinkCrawler.java:1232)
	at jd.controlling.linkcrawler.LinkCrawler$18.crawling(LinkCrawler.java:1813)
	at jd.controlling.linkcrawler.LinkCrawlerRunnable.run_now(LinkCrawlerRunnable.java:118)
	at jd.controlling.linkcrawler.LinkCrawlerRunnable.run(LinkCrawlerRunnable.java:49)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
	at java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketException: Connection reset
	at java.net.SocketInputStream.read(Unknown Source)
	at java.net.SocketInputStream.read(Unknown Source)
	at java.net.SocketInputStream.read(Unknown Source)
	at org.appwork.utils.net.httpconnection.HTTPConnectionUtils.readheader(HTTPConnectionUtils.java:251)
	at org.appwork.utils.net.httpconnection.HTTPConnectionImpl.connectInputStream(HTTPConnectionImpl.java:981)
	at org.appwork.utils.net.httpconnection.HTTPConnectionImpl.sendRequest(HTTPConnectionImpl.java:1570)
	at org.appwork.utils.net.httpconnection.HTTPConnectionImpl.connect(HTTPConnectionImpl.java:901)
	at org.appwork.utils.net.httpconnection.HTTPConnectionImpl.finalizeConnect(HTTPConnectionImpl.java:1150)
	at jd.http.Request.connect(Request.java:334)
	at jd.http.Request.connect(Request.java:321)
	at jd.http.Browser.openRequestConnection(Browser.java:1697)
	... 12 more
Reply With Quote
  #2  
Old 24.09.2019, 11:08
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 66,134
Default

Caused by: java.net.SocketException: Connection reset
the other side/something inbetween has closed/killed the connection. has nothing to do with timeouts
__________________
JD-Dev & Server-Admin
Reply With Quote
  #3  
Old 24.09.2019, 13:02
djmakinera djmakinera is offline
JD Legend
 
Join Date: May 2010
Location: Poland
Posts: 8,342
Default

Quote:
Originally Posted by Jiaz View Post
Caused by: java.net.SocketException: Connection reset
the other side/something inbetween has closed/killed the connection. has nothing to do with timeouts

I don't know what all the advanced settings are for, but sometimes they are really helpful.
This is quite an old problem with refuset connections for slow loading pages. But it can be solved this way.
The page loads just slowly or you need to refresh it sometimes. For testing I increased this value and analyzes it without any problems.
This Test only for "Deep Search" html page.

20000 ms(default) ---> 12000ms (new)
Screen:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #4  
Old 24.09.2019, 13:06
djmakinera djmakinera is offline
JD Legend
 
Join Date: May 2010
Location: Poland
Posts: 8,342
Default

Quote:
Originally Posted by Jiaz View Post
Caused by: java.net.SocketException: Connection reset
the other side/something inbetween has closed/killed the connection. has nothing to do with timeouts
The page can load even in a minute, so the default setting of 20 seconds is too short.
Reply With Quote
  #5  
Old 24.09.2019, 13:14
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 66,134
Default

Connection Reset can't be fixed with higher Read-Timeout! You have no control when/why a Connection-Reset happens. Please learn how TCP works
__________________
JD-Dev & Server-Admin
Reply With Quote
  #6  
Old 24.09.2019, 13:24
djmakinera djmakinera is offline
JD Legend
 
Join Date: May 2010
Location: Poland
Posts: 8,342
Default

JD2 - what makes you think you can't. You can, you can only not know how many attempts JD2 makes.

1 attemps read? 2 attemps read? Other?

The site or server is just VERY SLOW and that's it.
Increasing TimeOut - however, it helps if it doesn't help it wouldn't try to analyze(CRAWL), but I can see that it analyzes, although it takes a long time, but it works!
Reply With Quote
  #7  
Old 24.09.2019, 13:40
djmakinera djmakinera is offline
JD Legend
 
Join Date: May 2010
Location: Poland
Posts: 8,342
Default

Jiaz

If you've ever used Google Chrome or had a situation like this:

Message: "Page Not Responding"
"Wait" button
"Close page" button

It's just that JD2 probably doesn't support "Waiting for a new request connection" and rejects the connection, so analyzing in this case may fail and will return an error
Reply With Quote
  #8  
Old 24.09.2019, 14:07
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 66,134
Default

Connection-Reset = the TCP Connection is closed, can no longer be used. A new connection/request is required.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #9  
Old 24.09.2019, 14:07
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 66,134
Default

Quote:
Originally Posted by djmakinera View Post
It's just that JD2 probably doesn't support "Waiting for a new request connection" and rejects the connection, so analyzing in this case may fail and will return an error
Please learn how TCP/HTTP works. thanks!
__________________
JD-Dev & Server-Admin
Reply With Quote
  #10  
Old 24.09.2019, 15:37
djmakinera djmakinera is offline
JD Legend
 
Join Date: May 2010
Location: Poland
Posts: 8,342
Default

It sometimes happens that the page does not load but after refreshing F5 everything will work again You never have any influence on the connections between the server. It's just that JD2 recognizes that it can't connect to the site. Maybe you should manually add the link again every time to try to parse the html link again.

The setting has a big impact anyway, if you reduce Time-out them each page will not be analyzed.
Reply With Quote
  #11  
Old 24.09.2019, 15:56
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 66,134
Default

Quote:
Originally Posted by djmakinera View Post
The setting has a big impact anyway, if you reduce Time-out them each page will not be analyzed.
Of course, but the default 20 secs should be more than enough. and this is about read-timeout and NOT about connection reset.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #12  
Old 24.09.2019, 18:44
djmakinera djmakinera is offline
JD Legend
 
Join Date: May 2010
Location: Poland
Posts: 8,342
Default

Code:
This site is unreachable.
The xxxx server needed too much time to respond.

ERR_CONNECTION_TIMED_OUT
Therefore, several attempts are needed and the connection time is very long, over one or two or three minute...
Reply With Quote
  #13  
Old 24.09.2019, 18:56
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 66,134
Default

ERR_CONNECTION_TIMED_OUT is NOT a connection reset.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #14  
Old 24.09.2019, 19:37
djmakinera djmakinera is offline
JD Legend
 
Join Date: May 2010
Location: Poland
Posts: 8,342
Default

Quote:
Originally Posted by Jiaz View Post
ERR_CONNECTION_TIMED_OUT is NOT a connection reset.

I get this information in Google Chrome.
But in a few seconds the page loads automatically (correctly)
What's this all about?
Reply With Quote
  #15  
Old 24.09.2019, 20:02
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 66,134
Default

That means that the website in question is very unstable and unresponsive
__________________
JD-Dev & Server-Admin
Reply With Quote
  #16  
Old 24.09.2019, 20:24
djmakinera djmakinera is offline
JD Legend
 
Join Date: May 2010
Location: Poland
Posts: 8,342
Default

With the default 20 seconds parsing does not work


Code:
----------------ConnectionExceptions-------------------------
0:Workaround for ConnectTimeout(Normal): 20000>19999
1:Too Fast ConnectTimeout(Normal): 1->Wait 1999
Reply With Quote
  #17  
Old 25.09.2019, 11:24
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 66,134
Default

Well, in that case that website is VERY slow (when it takes more than 20 seconds for normal TCP connect) and you have to increase default connection timeout
__________________
JD-Dev & Server-Admin
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 13:59.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2019, Jelsoft Enterprises Ltd.