JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 06.05.2018, 05:25
LaughingMan LaughingMan is offline
JD Adviser
 
Join Date: Sep 2009
Posts: 109
Default Mega.nz download bottleneck

First of all, I realize that my use case is rather extreme but I'd like to mention it anyway.

The scenario: I'm currently using JDownloader on a highspeed connection and want to download ~70GB from Mega. They have an IP-based bandwidth limit of 5(?)GB per [unknown timeframe] after which there is a wait time of 5 or 6 hours. However, there is a short time window in Mega's system where downloads can be started even if the limit was already reached.
Since downloads finish with full speed once they have been started, I set JD to start the maximum of 20 simultaneous downloads. This way I managed to briefly reach a download speed of 600 MByte/s (kudos to both JD and Mega for being able to handle that speed). In the end it downloaded 37GB before the bandwidth limit kicked in.

The problem:
Finished downloads get queued for decryption but still take up a download slot. That means with each finished download the download speed dropped because decrypting was way way slower that downloading.
Had JD instead continued to download with full speed and let the decryption catch up later, the downloaded amount could have likely been doubled.
Additionally, both the connection and the storage system still had free capacity and could have made good use of more than 20 download threads.

Proposed solution(s):
1) Untie the download phase from the decryption phase such that download threads don't get blocked by the decryption queue. I realize this might be architecturally challenging and not high priority.
2) Raise the maximum number of simultaneous downloads from 20 to 40 or something.

First world problems, I know
Reply With Quote
  #2  
Old 07.05.2018, 16:50
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 66,134
Default

1.) Untie the download phase from decryption phase: This will not happen because the result of the decryption phase has influence on the download phase. for example decryption mail fail, or crc error ->mark download as failed and maybe try another available mirror or so
2.) you can do this already yourself with help of so called Domain rules. use board search for it. You can create a rule for mega downloads and specify a higher global download limit. In case you need help with that, just ask again
Suggestion:
3.) use multiple JDownloader installations/instances *first world solution* *g*
__________________
JD-Dev & Server-Admin
Reply With Quote
  #3  
Old 07.05.2018, 16:51
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 66,134
Default

That speed/setup is indeed a first world *problem* :p
__________________
JD-Dev & Server-Admin
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 03:07.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2019, Jelsoft Enterprises Ltd.