JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 11.04.2011, 09:18
Gweilo's Avatar
Gweilo Gweilo is offline
JD Legend
 
Join Date: Mar 2009
Posts: 726
Default Download aborts at 99.9%

Recently I'm getting downloads abort at 99.9% -- which is very very irritating when the download is not resumeable.

Here for instance an RS download that aborted with "Download not finished. Loaded until now: 104968260/104999999" -- i.e just 31,739 bytes short.

At which point it started all over again.

The problem I is think that JD is not waiting until the download is confirmed complete before breaking the connection. If there is any problem in the last few bytes, it can't recover.

This has happened with Megashares and Rapidshare.
It happens in perhaps 5 or 10% of downloads.

And no, I don't have an antivirus running, and no it's not cosmic rays.

Log: http://jdownloader.org/pastebin/35136

Spoiler:
Code:
GET /cgi-bin/rsapi.cgi?sub=download_v1&dlauth=A8F1F6FF3516722D80B48ED407760219A8A62B0687F897C12F77BE4F8F8FFE97F840B5456854B6524A20A554387C04C9B799E47294F5300EC3F2B275C3FB4A259B16CAA86F47336F53AF0F81E4CAC657ECEC339FD3FF2B55CDBEDD4361EFF6EC52E7D7B2EBCEDADFF70D19D0FCB43F19&bin=1&fileid=454700875&filename=taljo-107-hd.part06.rar HTTP/1.1
Accept-Language: de, en-gb;q=0.9, en;q=0.8
Host: rs502l36.rapidshare.com
Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
Referer: **External links are only visible to Support Staff**
Accept-Encoding: gzip
User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.0.10) Gecko/2009042523 Ubuntu/9.04 (jaunty) Firefox/3.0.10
Connection: close
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
Pragma: no-cache
Cache-Control: no-cache

----------------Response------------------
HTTP/1.1 200 OK
Date: Mon, 11 Apr 2011 05:35:49 GMT
Content-Length: 105000000
Content-Disposition: Attachment; filename=taljo-107-hd.part06.rar
Connection: close
Content-Type: application/octet-stream
Accept-Ranges: bytes


187 11/04/11 1:35:49 PM - FINER [java_downloader] -> Start Download
187 11/04/11 1:35:49 PM - FINER [java_downloader] -> Setup virgin download
187 11/04/11 1:35:49 PM - FINER [java_downloader] -> Start Download in 1 chunks. Chunksize: 105000000
187 11/04/11 1:35:49 PM - FINER [java_downloader] -> Setup chunk 0: Thread[DOwnloadchunk 0 - -1,1,main]
187 11/04/11 1:35:49 PM - FINER [java_downloader] -> Wait for chunks

------------------------  Thread: 188  -----------------------
188 11/04/11 1:35:49 PM - FINER [java_downloader] -> Start Chunk 0 : 0 - -1

------------------------  Thread: 21  -----------------------
21 11/04/11 1:37:14 PM - INFO [java_downloader] -> ByteBufferController: Used: 1000.00 KB Free: 1.95 MB
21 11/04/11 1:47:14 PM - INFO [java_downloader] -> ByteBufferController: Used: 1000.00 KB Free: 1.95 MB
21 11/04/11 1:57:14 PM - INFO [java_downloader] -> ByteBufferController: Used: 1000.00 KB Free: 1.95 MB

------------------------  Thread: 188  -----------------------
188 11/04/11 1:58:51 PM - WARNING [java_downloader] -> Download not finished. Loaded until now: 104968260/104999999
188 11/04/11 1:58:51 PM - SEVERE [java_downloader] -> Error occured: ERROR_DOWNLOAD_FAILED
188 11/04/11 1:58:51 PM - SEVERE [java_downloader] -> A critical Downloaderror occured. Terminate...
188 11/04/11 1:58:51 PM - SEVERE [java_downloader] -> ABBORTED BY USER
188 11/04/11 1:58:51 PM - FINER [java_downloader] -> Chunk finished 0 104968260 bytes

Last edited by Jiaz; 12.04.2011 at 12:02.
Reply With Quote
  #2  
Old 11.04.2011, 10:38
remi
Guest
 
Posts: n/a
Default

I would recommend to :-

1) Set Max.con to 1.

2) Search for rodents with good calculators. Good calculators because they're breaking the connection at exactly the wrong moment.

3) Clean your registry because virus or similar software might have left some traces.

4) Wait for Jiaz' diagnosis, because he knows everything about jD.
Reply With Quote
  #3  
Old 11.04.2011, 12:22
Gweilo's Avatar
Gweilo Gweilo is offline
JD Legend
 
Join Date: Mar 2009
Posts: 726
Default

Quote:
Originally Posted by remi View Post
I would recommend to :-

1) Set Max.con to 1.

2) Search for rodents with good calculators. Good calculators because they're breaking the connection at exactly the wrong moment.

3) Clean your registry because virus or similar software might have left some traces.

4) Wait for Jiaz' diagnosis, because he knows everything about jD.
Max con was already 1.
And in the download documented above, there was only one download running at any time, as all links were on the same host.

I don't have any viruses.
Can you name a virus that would have this effect?

And the problem is that JD is breaking the connection at the wrong moment. Nothing else is going on. If it would just stay connected for one second longer it would be complete.

Last edited by Gweilo; 11.04.2011 at 12:26.
Reply With Quote
  #4  
Old 11.04.2011, 12:52
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,232
Default

jdownloader does not stop connection itself, something in between the connection (firewall,av) is closing the connection before sending the rest of data to jdownloader.

the logfile clearly shows a finished download where not all data got transfered.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #5  
Old 11.04.2011, 12:54
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,232
Default

can you reproduce this, so lets do a teamviewer session and we can look at it together
__________________
JD-Dev & Server-Admin
Reply With Quote
  #6  
Old 11.04.2011, 13:57
remi
Guest
 
Posts: n/a
Cool

Quote:
Originally Posted by Gweilo View Post
I don't have any viruses.
Can you name a virus that would have this effect?
The board is full of examples. Imon is a typical example with its web/http scanner.
Reply With Quote
  #7  
Old 11.04.2011, 14:05
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,232
Default

Quote:
Originally Posted by remi View Post
The board is full of examples. Imon is a typical example with its web/http scanner.
:)
__________________
JD-Dev & Server-Admin
Reply With Quote
  #8  
Old 11.04.2011, 18:26
Gweilo's Avatar
Gweilo Gweilo is offline
JD Legend
 
Join Date: Mar 2009
Posts: 726
Default

Quote:
Originally Posted by Jiaz View Post
jdownloader does not stop connection itself, something in between the connection (firewall,av) is closing the connection before sending the rest of data to jdownloader.

the logfile clearly shows a finished download where not all data got transfered.
The log says "ABBORTED BY USER"
What exactly does that mean if not JD?
-- Do you think I clicked "stop" and then suffered amnesia?

JD is in control of the connection.
It isn't being interrupted by anything.

How could any external process: firewall, virus, or whatever, interrupt several downloads at 99.9% of completion? How could an external process have such exquisite timing? Only JD knows what the size of the download it's getting is. JD is getting ready to break the connection, and it seems it was premature.

Last edited by Gweilo; 12.04.2011 at 10:22.
Reply With Quote
  #9  
Old 11.04.2011, 18:37
Gweilo's Avatar
Gweilo Gweilo is offline
JD Legend
 
Join Date: Mar 2009
Posts: 726
Default

Quote:
Originally Posted by remi View Post
The board is full of examples. Imon is a typical example with its web/http scanner.
Searching the forum, the only post here mentioning "Imon" is yours above.
And elsewhere the only "Imon" I can find is an antivirus from Eset.
If that was what you meant I already said in my first post that "I don't have an antivirus running,"

So just to clarify: I do not have ANY web/http scanner active.
I have Zone Alarm (firewall only).
And the router blocks pings and other such probes.
Both are unchanged for almost 10 years.

Last edited by Gweilo; 12.04.2011 at 10:14.
Reply With Quote
  #10  
Old 12.04.2011, 10:21
Gweilo's Avatar
Gweilo Gweilo is offline
JD Legend
 
Join Date: Mar 2009
Posts: 726
Default

Quote:
Originally Posted by Jiaz View Post
can you reproduce this, so lets do a teamviewer session and we can look at it together
No, it happens irregularly.
If I reset it (or if JD resets it itself) then the second try of the same download usually succeeds.

I can't see any pattern. The last time it was when there was one package with 8 links all on the same server, which is about as simple as you can get. Only one link failed in this way, and that was fine when retried.
Reply With Quote
  #11  
Old 12.04.2011, 12:01
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,232
Default

I have Zone Alarm (firewall only).
voila, read the crc thread, all ppl at the end complaining about crc erros on rs -> the cause IS zonealarm. confirmed by all the users that had crc issues their issues also appeared on rs

so this is solved for me

about the stopping: i mean that something outside java/jd stopped the connection in meaning, send endofline on the connection without sending complete data. voila zonealarm in your case
__________________
JD-Dev & Server-Admin
Reply With Quote
  #12  
Old 12.04.2011, 13:29
Gweilo's Avatar
Gweilo Gweilo is offline
JD Legend
 
Join Date: Mar 2009
Posts: 726
Default

Quote:
Originally Posted by Jiaz View Post
I have Zone Alarm (firewall only).
voila, read the crc thread, all ppl at the end complaining about crc erros on rs -> the cause IS zonealarm. confirmed by all the users that had crc issues their issues also appeared on rs

so this is solved for me

about the stopping: i mean that something outside java/jd stopped the connection in meaning, send endofline on the connection without sending complete data. voila zonealarm in your case
The forum search function finds zero results for "CRC" so I don't know what thread you're referring to.

But I guess it's using the full Zone Alarm antivirus suite, not just the firewall.

Just tell me : how can an external process disconnect JD at 99.9% of the file, several times, and not some random point?

Only JD knows the stage of the download. All the firewall sees is a stream of data.

This is not "solved", it's simply "Person A has a problem and uses ZoneAlarm. Person B has a different problem and uses ZoneAlarm. Thefore both problems are caused by Zonealarm."

That isn't logic.


Quote:
their issues also appeared on rs
I've had the same problem with MU.
Reply With Quote
  #13  
Old 12.04.2011, 13:39
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,232
Default

http://board.jdownloader.org/showthr...ight=zonealarm
eg this thread.

do the test and remove zonealarm from computer and reboot and try again

once again. jd read from a socket, the socket tells eof (=-1) and thats the sign no more data to read. but because rs offers an api we know that more data is waiting, BUT no more data to read = connection closed = something external did intercept the download and not forward ALL data to jdownloader.

do the test and report back.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #14  
Old 12.04.2011, 14:29
remi
Guest
 
Posts: n/a
Default

@Gweilo

I've been using Zone Alarm as a firewall. I dumped it for other reasons (I can't remember why because it's a long time ago) and I'm now using Sygate Personal Firewall.

Note that the board's search engine doesn't search on small words. You need to use an external search engine.
Reply With Quote
  #15  
Old 12.04.2011, 14:33
Gweilo's Avatar
Gweilo Gweilo is offline
JD Legend
 
Join Date: Mar 2009
Posts: 726
Default

Quote:
Originally Posted by Jiaz View Post
http://board.jdownloader.org/showthr...ight=zonealarm
eg this thread.

do the test and remove zonealarm from computer and reboot and try again

once again. jd read from a socket, the socket tells eof (=-1) and thats the sign no more data to read. but because rs offers an api we know that more data is waiting, BUT no more data to read = connection closed = something external did intercept the download and not forward ALL data to jdownloader.

do the test and report back.
That thread is in German and I can't work out what test you are talking about.
Reply With Quote
  #16  
Old 12.04.2011, 14:37
Gweilo's Avatar
Gweilo Gweilo is offline
JD Legend
 
Join Date: Mar 2009
Posts: 726
Default

Quote:
Originally Posted by remi View Post
@Gweilo

I've been using Zone Alarm as a firewall. I dumped it for other reasons (I can't remember why because it's a long time ago) and I'm now using Sygate Personal Firewall.

Note that the board's search engine doesn't search on small words. You need to use an external search engine.
I've never had any problems with it. I don't believe that it has anythng to do with this, and have yet to se any evidence.

There is a whole ZoneAlarm suite of software that may indeed be invasive, but I use a very old version. 3.7, just the firewall. It does what I need and no more.

Last edited by Gweilo; 12.04.2011 at 14:50.
Reply With Quote
  #17  
Old 12.04.2011, 14:47
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,232
Default

why not simply test what i wrote? if it is not zonealarm whats causing this issue, then you can reinstall. this is only a *check if zonearlarm is the one to blame* test
__________________
JD-Dev & Server-Admin
Reply With Quote
  #18  
Old 12.04.2011, 14:52
remi
Guest
 
Posts: n/a
Default

@Gweilo

We both have a scientific background. Why don't you just do what Jiaz proposes? If you don't want to be without a firewall (especially when you don't have one in your router) I would just replace it by another one.
Reply With Quote
  #19  
Old 12.04.2011, 14:55
Gweilo's Avatar
Gweilo Gweilo is offline
JD Legend
 
Join Date: Mar 2009
Posts: 726
Default

Quote:
Originally Posted by Jiaz View Post
why not simply test what i wrote? if it is not zonealarm whats causing this issue, then you can reinstall. this is only a *check if zonearlarm is the one to blame* test
I don't know what test you want me to do.

I cant read German. I Babelfished the thread and the translation didn't make much sense.
Reply With Quote
  #20  
Old 12.04.2011, 14:57
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,232
Default

Quote:
Originally Posted by Jiaz View Post
[url]
do the test and remove zonealarm from computer and reboot and try again

once again. jd read from a socket, the socket tells eof (=-1) and thats the sign no more data to read. but because rs offers an api we know that more data is waiting, BUT no more data to read = connection closed = something external did intercept the download and not forward ALL data to jdownloader.
this.
__________________
JD-Dev & Server-Admin
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 07:21.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.