JDownloader Community - Appwork GmbH
 

Notices

Reply
 
Thread Tools Display Modes
  #1  
Old 22.06.2019, 13:16
Cyberavater Cyberavater is offline
JD Legend
 
Join Date: Feb 2019
Posts: 732
Default Download interruption on some hosters

LogID: 22.06.19 16.14.40 <--> 22.06.19 16.16.07 jdlog://4254086935451/
Reply With Quote
  #2  
Old 24.06.2019, 14:43
Cyberavater Cyberavater is offline
JD Legend
 
Join Date: Feb 2019
Posts: 732
Default

@jiaz Can you plz look at this?
Reply With Quote
  #3  
Old 24.06.2019, 15:10
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

I would say sort of rate limiting on the host trial....
Caused by: java.io.EOFException: empty HTTP-Response
You should limit max number of connections/chunks, you use 20 chunks and looks like 4-5 are possible, all further connections result in connection issues
__________________
JD-Dev & Server-Admin
Reply With Quote
  #4  
Old 24.06.2019, 16:27
Cyberavater Cyberavater is offline
JD Legend
 
Join Date: Feb 2019
Posts: 732
Default

There were 3 issues, were all caused by *20 chunks*? (As it also contains the log for https://board.jdownloader.org/showpo...3&postcount=16)
Also, can you add a feature which would prevent using more than necessary chunks?
I've just set it to 20 by thinking that, if speed requires it could use all it wants without asking me
Reply With Quote
  #5  
Old 24.06.2019, 17:50
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

For the trials... link, there are many
java.io.EOFException: empty HTTP-Response
which is very likely caused by too many connections

On nopy.to there is
Caused by: java.net.SocketException: Connection reset
either local or remote firewall/av killed the connection.
that causes your download interruptions

and then you've somehow added some sort of blob link?! which of course also fails
__________________
JD-Dev & Server-Admin
Reply With Quote
  #6  
Old 24.06.2019, 18:09
Cyberavater Cyberavater is offline
JD Legend
 
Join Date: Feb 2019
Posts: 732
Default

Quote:
Originally Posted by Jiaz View Post
For the trials... link, there are many
java.io.EOFException: empty HTTP-Response
which is very likely caused by too many connections
Can you add a feature which would automatically stop requesting too many connections after one failure (i.e if the server denies connection after requesting the 6th chunk can't it automatically stop requesting?)

Quote:
Originally Posted by Jiaz View Post
On nopy.to there is
Caused by: java.net.SocketException: Connection reset
either local or remote firewall/av killed the connection.
that causes your download interruptions
Do have any suggestions that I should follow to prevent this?

Quote:
Originally Posted by Jiaz View Post
and then you've somehow added some sort of blob link?! which of course also fails
I exactly don't know/remember how it was added, so let's ignore this till I get more info on it.

P.S. Thanks for your time to look/work on my issues.
Reply With Quote
  #7  
Old 24.06.2019, 18:51
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

Quote:
Originally Posted by Cyberavater View Post
Can you add a feature which would automatically stop requesting too many connections after one failure (i.e if the server denies connection after requesting the 6th chunk can't it automatically stop requesting?)
With the old core that's not possible because the old core has a static chunking, means that the file is split into x chunks and those are downloaded. Code doesn't support dynamic changing the number of chunks at later point, only reduce to 1 chunk. The *still in development* core I'm working on will support that feature
__________________
JD-Dev & Server-Admin
Reply With Quote
  #8  
Old 24.06.2019, 18:58
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

please provide some more nopy example links, so I can do some tests on my site to find out if those are caused by their server/firewall or your local system/firewall
__________________
JD-Dev & Server-Admin
Reply With Quote
  #9  
Old 24.06.2019, 19:13
Cyberavater Cyberavater is offline
JD Legend
 
Join Date: Feb 2019
Posts: 732
Default

Quote:
Originally Posted by Jiaz View Post
With the old core that's not possible because the old core has a static chunking, means that the file is split into x chunks and those are downloaded. Code doesn't support dynamic changing the number of chunks at later point, only reduce to 1 chunk. The *still in development* core I'm working on will support that feature
Looking forward to that.


Quote:
Originally Posted by Jiaz View Post
please provide some more nopy example links, so I can do some tests on my site to find out if those are caused by their server/firewall or your local system/firewall
Already given here; https://board.jdownloader.org/showth...092#post441092
But I'll post them here anyway, Example Links;
1. **External links are only visible to Support Staff****External links are only visible to Support Staff**
2. **External links are only visible to Support Staff****External links are only visible to Support Staff**

P.S. It's worth mentioning that you might need to try multiple times to reproduce this issue.
Reply With Quote
  #10  
Old 25.06.2019, 15:14
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

I could not reproduce any error with nopy, downloaded both files 20 times
__________________
JD-Dev & Server-Admin
Reply With Quote
  #11  
Old 25.06.2019, 17:14
Cyberavater Cyberavater is offline
JD Legend
 
Join Date: Feb 2019
Posts: 732
Default

LOL, 20 times that's so much! It used to happen to me around 3rd times or so. I guess just ignoring it, for the time being, might be wise since fixing an issue without reproducing it is almost impossible. Thanks for the time tho.
Reply With Quote
  #12  
Old 25.06.2019, 17:39
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

In case you got access to different machine, it might be worth testing on it.
also check downloads in browser if they are affected as well, might help to find the cause of it
__________________
JD-Dev & Server-Admin
Reply With Quote
  #13  
Old 25.06.2019, 20:24
Cyberavater Cyberavater is offline
JD Legend
 
Join Date: Feb 2019
Posts: 732
Default

Will do. Again, thanks for your time much appreciated.
Reply With Quote
  #14  
Old 25.06.2019, 20:33
Cyberavater Cyberavater is offline
JD Legend
 
Join Date: Feb 2019
Posts: 732
Default

Upon retrying on browser and IDM I couldn't reproduce it but in JD2 I still can reproduce this issue (Didn't try on a different machine tho).
Reply With Quote
  #15  
Old 26.06.2019, 10:47
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

In that case you have to check all firewall/av/peer tools on your computer. Yesterday I found out Webshield from a Firewall software to cause such issues.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #16  
Old 26.06.2019, 14:31
Cyberavater Cyberavater is offline
JD Legend
 
Join Date: Feb 2019
Posts: 732
Default

I only use Windows defender (default one given by the windows itself), nothing else.
Reply With Quote
  #17  
Old 26.06.2019, 14:49
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

If you want we can take a look via teamviewer
__________________
JD-Dev & Server-Admin
Reply With Quote
  #18  
Old 26.06.2019, 15:21
Cyberavater Cyberavater is offline
JD Legend
 
Join Date: Feb 2019
Posts: 732
Default

Yes, we can. Or, I can send you video footage if you find that more convenient.
Reply With Quote
  #19  
Old 26.06.2019, 15:40
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

Video footage doesn't help to find the cause on your system/setup. It works fine for me, so must be somehow connected to your system/setup
__________________
JD-Dev & Server-Admin
Reply With Quote
  #20  
Old 26.06.2019, 22:01
Cyberavater Cyberavater is offline
JD Legend
 
Join Date: Feb 2019
Posts: 732
Default

Okay, We can do it the next time we are both online at the same time.

Edit: Can't reproduce after setting chunks to 1. Is it somehow related to that?

Last edited by Cyberavater; 26.06.2019 at 22:03. Reason: New info
Reply With Quote
  #21  
Old 27.06.2019, 12:45
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

Quote:
Originally Posted by Cyberavater View Post
Edit: Can't reproduce after setting chunks to 1. Is it somehow related to that?
less chunks = less requests = less chance to hit any firewall/rate limit
__________________
JD-Dev & Server-Admin
Reply With Quote
  #22  
Old 27.06.2019, 18:06
Cyberavater Cyberavater is offline
JD Legend
 
Join Date: Feb 2019
Posts: 732
Default

Thanks for the clarification. Turns out all the problem was related to max chunk number after all. Again thanks for your time.
Reply With Quote
  #23  
Old 28.06.2019, 11:31
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

You're welcome.
__________________
JD-Dev & Server-Admin
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 23:10.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.