JDownloader Community - Appwork GmbH
 

Notices

Reply
 
Thread Tools Display Modes
  #1  
Old 26.06.2023, 22:56
wrench wrench is offline
I will play nice!
 
Join Date: Jun 2023
Posts: 7
Default Modern VPN with JDownloader broken?

Hello JD Team & Community!
Thank you for this incredible software, I'm just having a little problem that I hope someone can help me with.

System:
  • OS: Linux x64
  • CPU: Intel Haswell Quad Core (No hyperthreading)
  • Java: Latest JDK
Download Speed:
  • 70MB/s
Issue:
  • Loading with VPN using AES-256-GCM cipher (most common) causes 80 - 90% CPU load.
Attempted Solutions:
  • I found the topics about SSL / AES GCM issues with JDownloader and already reinstalled JD / updated Java to the latest version.
  • Lowering Simultaneous Downloads <10 slightly improves CPU load to 75%
  • Downloading via browser with VPN enabled only leads to 50% CPU load.
Question:
  • Is this a hardware or software issue and what else could I try to reduce load?
Reply With Quote
  #2  
Old 27.06.2023, 01:07
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Quote:
Originally Posted by wrench View Post
Question:
  • Is this a hardware or software issue and what else could I try to reduce load?
Hardware issue/limitation.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #3  
Old 27.06.2023, 07:13
wrench wrench is offline
I will play nice!
 
Join Date: Jun 2023
Posts: 7
Default

Quote:
Originally Posted by pspzockerscene View Post
Hardware issue/limitation.
Good evening, thanks for the reply.

I figured as much. :-(

According to **External links are only visible to Support Staff**..., Haswell Quads should still be rated around 400MB/s for AES-256/128-GCM cryptographic processing.

Is there any way I could lower the load by only 10 - 20%? Some clever trick in the software maybe? I have honestly tried everything, apart from overclocking.

Thanks again for the help.
Reply With Quote
  #4  
Old 27.06.2023, 12:50
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,611
Default

other than keep dropping the amount of connections on that hoster (check advanced setting > GeneralSettings.domainrules for maxsimdls outside of global setting && package customiser rule for chunks) that uses said cipher until you find an acceptable cpu loading, I would say most likely not.
JD does have third party cipher option with bouncy castle, not sure if that implementation is better than say Javas internal one? Maybe @notice could respond, personally highly doubt it would be any more efficient.

raztoki
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]

Last edited by raztoki; 27.06.2023 at 13:11.
Reply With Quote
  #5  
Old 27.06.2023, 12:57
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

The easiest solution is to try to download without https.
Some websites do allow this - you should check that.
Because you've read said support article you probably already did thtat though.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #6  
Old 27.06.2023, 13:46
wrench wrench is offline
I will play nice!
 
Join Date: Jun 2023
Posts: 7
Default

Quote:
Originally Posted by raztoki View Post
other than keep dropping the amount of connections on that hoster (check advanced setting > GeneralSettings.domainrules for maxsimdls outside of global setting && package customiser rule for chunks) that uses said cipher until you find an acceptable cpu loading, I would say most likely not.
JD does have third party cipher option with bouncy castle, not sure if that implementation is better than say Javas internal one? Maybe @notice could respond, personally highly doubt it would be any more efficient.
raztoki
Hello @raztoki, thank you for the reply.

Yes I set the chunk size to 1. That's the number right next to simultaneous connections (currently 5) at the bottom right corner in the GUI.

Could you help me find out how to enable this third cipher option? I searched the forum but couldn't find anything.

Quote:
Originally Posted by pspzockerscene View Post
The easiest solution is to try to download without https.
Some websites do allow this - you should check that.
Because you've read said support article you probably already did thtat though.
That's the weird thing, even with HTTP links the cpu load remains about the same, maybe around 60 - 65%. After more careful testing, I also see similar numbers with regular browser downloads now, so I'm pretty sure it's not JDownloader's fault.

Personally, I'm just shocked that my CPU seems to have gotten weak all of a sudden.
Like when did this happen lol?:confused:

I've been using this same processor on Linux for years with countless projects and 0 problems. I never expected that regular Downloads would finally break it.
Reply With Quote
  #7  
Old 27.06.2023, 16:34
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,611
Default

Sorry i did miss your OP mention of VPN and this cipher, if its at the VPN level it be hard to control other than limiting socket connections, as its a layer outside of JD control. JD does support that cipher effectively over the https protocol, you could effectively doing double cipher depending on the hoster configurations.

raztoki
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #8  
Old 27.06.2023, 16:42
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Quote:
Originally Posted by wrench View Post
That's the weird thing, even with HTTP links the cpu load remains about the same, maybe around 60 - 65%. After more careful testing, I also see similar numbers with regular browser downloads now, so I'm pretty sure it's not JDownloader's fault.
Keep in mind that nowdays most websites are enforcing https so changing the link to "http" without double-checking what the website does in the end won't get you any meaningful result.

That also goes for JD plugins that have such a http/https setting: Websites can change over time so the setting won't necessarily help.

Here is a random http directurl for testing:
ping.online.net/1000Mo.dat
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #9  
Old 28.06.2023, 13:01
wrench wrench is offline
I will play nice!
 
Join Date: Jun 2023
Posts: 7
Default

Quote:
Originally Posted by raztoki View Post
Sorry i did miss your OP mention of VPN and this cipher, if its at the VPN level it be hard to control other than limiting socket connections, as its a layer outside of JD control. JD does support that cipher effectively over the https protocol, you could effectively doing double cipher depending on the hoster configurations.

raztoki
I see, so you're saying my CPU has to work twice as hard, because it has to simultaneously do AES-256-GCM encryption on VPN level and AES-256-GCM decryption via SSL.

OK that makes sense. Could you please share a little more information about this other cipher that is supported in JD and how I can enable/use it?

Thanks again for the help you guys, I really appreciate it.:)

Quote:
Originally Posted by pspzockerscene View Post
Keep in mind that nowdays most websites are enforcing https so changing the link to "http" without double-checking what the website does in the end won't get you any meaningful result.

That also goes for JD plugins that have such a http/https setting: Websites can change over time so the setting won't necessarily help.

Here is a random http directurl for testing:
ping.online.net/1000Mo.dat
Yes, my apologies. You were absolutely correct. Looks like HTTPS was still in effect, and with the link you provided load is within 40 - 50%.

The only issue I have is that the hosters I use don't offer HTTP downloads.
I think my last hope might actually be this third cipher that raztoki mentioned.
Would you happen to know about this and how it could be applied?

The support and climate on this forum is incredible. Here in the U.S there is a stereotype that Germans have a tendency to be grumpy lol, but I have been thoroughly reeducated haha.:thumbup:
Reply With Quote
  #10  
Old 28.06.2023, 15:53
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Quote:
Originally Posted by wrench View Post
The support and climate on this forum is incredible. Here in the U.S there is a stereotype that Germans have a tendency to be grumpy lol, but I have been thoroughly reeducated haha.:thumbup:
That stereotype is kinda true for a lot of people but german JDownloader supporters like me are trying not to be grumpy :D

Regarding your question:
Other supporters will need to answer that.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #11  
Old 28.06.2023, 16:48
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,611
Default

Jiaz added a function to let users see cipher use within the connection column, if you double click the connection column whilst actively downloading it should provide you with series of outputs.

else

you can find out in logs if you have it enabled, might need log debug mode if you want to monitor everything (usually only logs errors for memory)
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #12  
Old 29.06.2023, 23:37
wrench wrench is offline
I will play nice!
 
Join Date: Jun 2023
Posts: 7
Default

Quote:
Originally Posted by raztoki View Post
Jiaz added a function to let users see cipher use within the connection column, if you double click the connection column whilst actively downloading it should provide you with series of outputs.

else

you can find out in logs if you have it enabled, might need log debug mode if you want to monitor everything (usually only logs errors for memory)
OK I found this, but how can I use/enable the cipher you mentioned in JDownloader?

I searched everywhere for "bouncy castle cipher JDownloader" but couldn't find anything.

I don't really understand how this would work. If the Hoster uses AES-GCM, how can I somehow change this on the JDownloader side?

Thank you for the tips, I just need a bit more details if that's ok.
Reply With Quote
  #13  
Old 30.06.2023, 04:05
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,611
Default

don't believe you/users can customise which cipher gets used, the server typically controls that.

but there are 'settings > advanced settings > GeneralSettings.preferbouncycastlefortls', that is a 3rd party library
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #14  
Old 30.06.2023, 17:32
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

@wrench
Which Java version are you using?
It would be the best if you would post a logID with preferbouncycastlefortls disabled.

Which exact CPU model do you have?


Please post your log-ID here
If your bugreport is about a specific website which JD supports via plugin, please also provide example URLs which can be used to reproduce the issue you are having.

Bitte poste deine Log-ID hier.
Falls dein gemeldetes Problem ein Problem mit einer Webseite ist, die per Plugin unterstützt wird, stelle bitte zusätzlich Testlinks zur Verfügung, mit denen sich dein Problem nachstellen lässt.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 30.06.2023 at 17:53.
Reply With Quote
  #15  
Old 30.06.2023, 20:32
wrench wrench is offline
I will play nice!
 
Join Date: Jun 2023
Posts: 7
Default

Quote:
Originally Posted by raztoki View Post
don't believe you/users can customise which cipher gets used, the server typically controls that.

but there are 'settings > advanced settings > GeneralSettings.preferbouncycastlefortls', that is a 3rd party library
Ah I see, thank you.

So I tested with this setting on anand there's been a slight improvement.

The CPU load starts out at ~70% and over the course of 30mins will slowly climb and halt at around 87%. During this time I'm loading at full speed. If I restart JDownloader and log out/in, it will start at 70% again.

I'm not sure what's causing it, but I can tell that the longer it's loading the higher my CPU and RAM usage are shooting up.

Would you happen to know of any other settings that might help reduce the load a bit?
Quote:
Originally Posted by pspzockerscene View Post
@wrench
Which Java version are you using?
It would be the best if you would post a logID with preferbouncycastlefortls disabled.

Which exact CPU model do you have?

-psp-
Hey man, I'm using Java 1.8 now, but also tested with JDK 20.
I am trying out all kinds of different settings right now to reduce CPU load. Gonna post a log if that's not too much to ask. You guys have already spent so much time on this, I really appreciate it!
Reply With Quote
  #16  
Old 01.07.2023, 07:19
wrench wrench is offline
I will play nice!
 
Join Date: Jun 2023
Posts: 7
Default

Edit: @psp Sorry, my CPU is the i5 2500K. I mistakenly said Haswell in the OP but just found out it's actually Sandybridge. I have now over clocked this thing to 4.5GHZ to see if there might be some improvement. My wife has already given me a final warning on the fan noise.
Reply With Quote
  #17  
Old 05.07.2023, 18:52
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Quote:
Originally Posted by wrench View Post
My wife has already given me a final warning on the fan noise.
Haha
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 22:35.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.