[mjolnir870]

I have several vpns set up to download from mega. When I start a download session, sometimes the vpns work fine. Other times, some multiple of 10B gets downloaded for a certain file, and then the vpn is marked as failed by jDownloader, even though it's fine. This continues until all the vpns are marked as failed, even though they're fine. The file won't download until I reset the file and delete all data.

Below logs show several downloads that failed with only 10B or 20B downloaded, and 7 vpns marked as failed because of it.

12.08.22 12.10.43 <--> 12.08.22 12.15.35 jdlog://1991035302851/

[Jiaz]

@mjolnir870: according to log the proxy fails to connect to endpoint

-->HTTPProxy:192.168.7.84:43055
-->HTTPProxyIP:192.168.7.84
----------------CONNECTRequest(HTTP)------------
CONNECT gfs214n153.userstorage.mega.co.nz:443 HTTP/1.1
Host: gfs214n153.userstorage.mega.co.nz
Proxy-Authorization: Basic .......
HTTP/1.1 200 OK
Date: Fri, 12 Aug 2022 17:12:29 GMT

Transfer-Encoding: chunked

------------------------------------------------
----------------Request Information-------------
URL: **External links are only visible to Support Staff****External links are only visible to Support Staff**.........
Host: gfs214n153.userstorage.mega.co.nz
Connection-Timeout: 20000ms
Read-Timeout: 60000ms
----------------ConnectionExceptions-------------------------
0:ENDPOINT:java.io.EOFException(empty HTTP-Response)|retrySSL:null
Caused by: java.io.EOFException: empty HTTP-Response
at org.appwork.utils.net.httpconnection.HTTPConnectionImpl.connectInputStream(HTTPConnectionImpl.java:1 101)

the proxy responds with closed connection (Caused by: java.io.EOFException: empty HTTP-Response)

my guess is that this server either had temp. issue or somehow causes issues with your proxy as I can see other mega servers work fine
with the proxy. but JDownloader cannot know/distinguish if the issue on proxy or remote side.


how exactly does your setup look like? I can see several proxy server running, at least different ports? you have a setup where each http proxy
has a different vpn gateway? or maybe docker vpn container?

also I can see that the proxy works for first connection but then the next chunks/connections all fail with same error

Caused by: java.io.EOFException: empty HTTP-Response

this always goes hand in hand with a proxy just providing 10-20 bytes of data. maybe it contains an error message? can you check the file content?
to me it looks like this issue is caused by either your proxy setup (eg some connection limits or other problems) or mega blocking the vpn/proxy endpoint due to to many connections.

also the proxy is kinda *slow* to connect to final server

Request-Time: 1171ms

have you tried to set max connections to 1? have you checked logs of vpn/proxy?

[mjolnir870]

Originally Posted by Jiaz

how exactly does your setup look like? I can see several proxy server running, at least different ports? you have a setup where each http proxy
has a different vpn gateway? or maybe docker vpn container?

I have several docker vpn containers. They are specifically **External links are only visible to Support Staff**gluetun containers.

Originally Posted by Jiaz

also I can see that the proxy works for first connection but then the next chunks/connections all fail with same error

this always goes hand in hand with a proxy just providing 10-20 bytes of data. maybe it contains an error message? can you check the file content?
to me it looks like this issue is caused by either your proxy setup (eg some connection limits or other problems) or mega blocking the vpn/proxy endpoint due to to many connections.

also the proxy is kinda *slow* to connect to final server

I checked the file content of one of the 50 byte files (failed several times) but it was gibberish to me in a text editor. It might be encrypted since it's an incomplete mega download? I attached it in case that helps.

Originally Posted by Jiaz

have you tried to set max connections to 1? have you checked logs of vpn/proxy?

I've set mega to only have 1 download allowed using the domain limit option in settings and it still fails eventually.

The logs of a proxy during a failure look like this:

2022-09-24T01:58:53-05:00 INFO [http proxy] 192.168.1.10:1078 <-> g.api.mega.co.nz:443
2022-09-24T01:58:54-05:00 INFO [http proxy] 192.168.1.10:1085 <-> g.api.mega.co.nz:443
2022-09-24T01:58:54-05:00 INFO [http proxy] 192.168.1.10:1090 <-> gfs214n128.userstorage.mega.co.nz:443
2022-09-24T01:58:55-05:00 INFO [http proxy] 192.168.1.10:1091 <-> gfs214n128.userstorage.mega.co.nz:443
2022-09-24T01:58:59-05:00 INFO [http proxy] 192.168.1.10:1093 <-> g.api.mega.co.nz:443
2022-09-24T01:58:59-05:00 INFO [http proxy] 192.168.1.10:1094 <-> g.api.mega.co.nz:443
2022-09-24T01:59:00-05:00 INFO [http proxy] 192.168.1.10:1095 <-> gfs206n114.userstorage.mega.co.nz:443
2022-09-24T01:59:01-05:00 INFO [http proxy] 192.168.1.10:1096 <-> gfs206n114.userstorage.mega.co.nz:443

[mjolnir870]

So I disabled all proxies and just allowed jdownloader to download directly with multiple downloads, and the same issue happened - files that fail to download after 10B or 20B. Since it's direct, the error message is "Host Problem?" and doesn't mention proxies. Logs below.

24.09.22 02.08.30 <--> 24.09.22 02.11.03 jdlog://9900311370661/

This makes me think the problem is jdownloader not recognizing some timeout from mega, and the disabling of the proxies above was just a byproduct of that issue.

[Jiaz]

@mjolnir870: log without proxy shows that the 2nd connection just fails. the request is answered/closed directly after sending the request. This can either be caused by local/isp/remote site. have you tried using vpn? ans also check local firewall/av to not mess with the connections

Please set max connections to 1 and create new log.
Same error with proxies causes JDownloader to (temp) disable the use of the proxy as JDownloader cannot know if issue is caused by proxy or something else.

[mjolnir870]

Here's a log with only 1 connection: 26.10.22 02.58.26 <--> 26.10.22 03.06.18 jdlog://4860311370661/

Some of the proxies I previously tried used vpns, so I don't think those help. The local firewall/av does not have anything that is interfering with JDownloader.

[Jiaz]

@mjolnir870: Thanks for the log. To me it looks like the remote firewall blocks due to unknown reason (maybe too many connections from ip/ip range...can't tell/don't know)
but the first request works fine and the 2nd (due to 2 chunks) fails
java.io.EOFException: empty HTTP-Response

Originally Posted by mjolnir870

Here's a log with only 1

log shows that you have setup 2 chunks

-> Start Download in 2 chunks.

please check again and create new log with max chunks/connections set to 1

[mjolnir870]

Here's a log with 1 connection, 1 chunk: 26.10.22 14.57.27 <--> 26.10.22 15.10.22 jdlog://0070311370661/

[pspzockerscene]

@mjolnir870
So does it work now?
I'm unable to find any similar errors in this log.

[Jiaz]

@mjolnir870: log looks good, no issues. to me it looks like either your setup/system/environment has issues with multiple connections to mega server.

[mjolnir870]

Originally Posted by pspzockerscene

@mjolnir870
So does it work now?
I'm unable to find any similar errors in this log.

It worked when limiting to 1 connection and 1 chunk, but that kind of defeats a lot of the advantages of jDownloader.

Originally Posted by Jiaz

@mjolnir870: log looks good, no issues. to me it looks like either your setup/system/environment has issues with multiple connections to mega server.

The only other thing I can think of is that I mainly save to an SMB share.

But a new wrinkle: disabling SSL makes the issues entirely disappear for multiple downloads and chunks, downloaded via multiple proxies and vpns. Here's a log for that: 28.10.22 15.09.57 <--> 28.10.22 15.53.59 jdlog://2470311370661/

I'm don't understand how it's a problem with my system if things work perfectly when I disable SSL for mega in jDownloader, but it seems to work for me now.