JDownloader Community - Appwork GmbH
 

Notices

Reply
 
Thread Tools Display Modes
  #1  
Old 18.06.2021, 05:25
almostparallel almostparallel is offline
I will play nice!
 
Join Date: Jun 2021
Posts: 1
Default Extremely slow Mega Decryption

I've got 33TB worth of ISOs to download. I'm getting 500MB/s if there are 10-14 concurrent downloads. The thing is, the decryption is really slow. I know the i/o speeds are not the bottleneck. The queue is full cause of the "Queued for decryption" entries. I just discovered concurrent decryption in the plugin settings, but that doesn't seem to help much too. When decrypting a single file, the increments range from 0.1% to 0.2% at max.

It's running on Ubuntu 20.04 if that helps. Please help. Thanks.
Reply With Quote
  #2  
Old 18.06.2021, 10:57
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

Decryption works on 512kb chunks in front of a 1mb read buffer.
What speed do you get?
You can check with iotop -o command
What are your system specs? Source/Destination drive are the same?
__________________
JD-Dev & Server-Admin
Reply With Quote
  #3  
Old 18.06.2021, 10:58
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

Also please create a log, see https://support.jdownloader.org/Know...d-session-logs
and post shown logID here
__________________
JD-Dev & Server-Admin
Reply With Quote
  #4  
Old 18.06.2021, 11:03
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

I've increased read chunk size to 2mb with next update, please check if it improves the speed
__________________
JD-Dev & Server-Admin
Reply With Quote
  #5  
Old 18.06.2021, 11:45
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,611
Default

maybe variable based on raw filesize?
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #6  
Old 18.06.2021, 11:54
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

@raztoki: more about available memory/max heap size. larger chunks only require more memory
__________________
JD-Dev & Server-Admin
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 19:34.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.