#1
|
|||
|
|||
Mega.nz download bottleneck
First of all, I realize that my use case is rather extreme but I'd like to mention it anyway.
The scenario: I'm currently using JDownloader on a highspeed connection and want to download ~70GB from Mega. They have an IP-based bandwidth limit of 5(?)GB per [unknown timeframe] after which there is a wait time of 5 or 6 hours. However, there is a short time window in Mega's system where downloads can be started even if the limit was already reached. Since downloads finish with full speed once they have been started, I set JD to start the maximum of 20 simultaneous downloads. This way I managed to briefly reach a download speed of 600 MByte/s (kudos to both JD and Mega for being able to handle that speed). In the end it downloaded 37GB before the bandwidth limit kicked in. The problem: Finished downloads get queued for decryption but still take up a download slot. That means with each finished download the download speed dropped because decrypting was way way slower that downloading. Had JD instead continued to download with full speed and let the decryption catch up later, the downloaded amount could have likely been doubled. Additionally, both the connection and the storage system still had free capacity and could have made good use of more than 20 download threads. Proposed solution(s): 1) Untie the download phase from the decryption phase such that download threads don't get blocked by the decryption queue. I realize this might be architecturally challenging and not high priority. 2) Raise the maximum number of simultaneous downloads from 20 to 40 or something. First world problems, I know |
#2
|
||||
|
||||
1.) Untie the download phase from decryption phase: This will not happen because the result of the decryption phase has influence on the download phase. for example decryption mail fail, or crc error ->mark download as failed and maybe try another available mirror or so
2.) you can do this already yourself with help of so called Domain rules. use board search for it. You can create a rule for mega downloads and specify a higher global download limit. In case you need help with that, just ask again Suggestion: 3.) use multiple JDownloader installations/instances *first world solution* *g*
__________________
JD-Dev & Server-Admin |
#3
|
||||
|
||||
That speed/setup is indeed a first world *problem* :p
__________________
JD-Dev & Server-Admin |
Thread Tools | |
Display Modes | |
|
|