JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #21  
Old 06.04.2015, 19:53
djmakinera djmakinera is offline
JD Legend
 
Join Date: May 2010
Location: Poland
Posts: 8,223
Default

Not every user can afford a lot of RAM in your system, so will use additional memory from disk - use the cache - any selected drive.
This is not a bad idea. Avoid: "Out Of Memory"
So can use multiple applications at once, and the physical memory will not be missing in the system.
Reply With Quote
  #22  
Old 06.04.2015, 19:53
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 48,649
Default

This just makes everything slow - especially if you do not have an SSD!
__________________

Ad-free installers || Werbefreie Installer
Windows Setup<--JD2 BETA-->Linux Setup x86 || Linux Setup x64 || Mac Setup
-----=>Support Chat<=-----
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #23  
Old 06.04.2015, 19:59
djmakinera djmakinera is offline
JD Legend
 
Join Date: May 2010
Location: Poland
Posts: 8,223
Default

I have a SSD ^^

Please understand well.

Example:
Use of physical memory 2GB RAM + extra Cashe


Last edited by djmakinera; 06.04.2015 at 20:06.
Reply With Quote
  #24  
Old 07.04.2015, 03:05
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 16,155
Default

@djmakinera
Operating system controls RAM and use of 'Swap/Page File' not the application.
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #25  
Old 07.04.2015, 09:04
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 64,713
Default

By default there is no need to change max heap. And power users can do this manually.
And no, OS does swap/memory handling.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #26  
Old 07.04.2015, 11:20
djmakinera djmakinera is offline
JD Legend
 
Join Date: May 2010
Location: Poland
Posts: 8,223
Default

Jiaz



1mln links - Use of RAM max?

Example:
-Xmx7000M ?
-Xmx10000M ?

I'll test

Last edited by djmakinera; 07.04.2015 at 11:25.
Reply With Quote
  #27  
Old 07.04.2015, 11:28
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 16,155
Default

I really don't see a heavy user needing more than 2gb
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #28  
Old 07.04.2015, 11:31
djmakinera djmakinera is offline
JD Legend
 
Join Date: May 2010
Location: Poland
Posts: 8,223
Default

raztoki & Jiaz -
but I just want to test
for millions of links, what setting '-Xmx????', please tell me

Last edited by djmakinera; 07.04.2015 at 11:33.
Reply With Quote
  #29  
Old 07.04.2015, 11:41
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 64,713
Default

For millions of links I suggest as much memory as possible
Millions of links -> power user -> I suggest at least 4-6 Gbyte
__________________
JD-Dev & Server-Admin
Reply With Quote
  #30  
Old 07.04.2015, 11:44
djmakinera djmakinera is offline
JD Legend
 
Join Date: May 2010
Location: Poland
Posts: 8,223
Default

Quote:
Originally Posted by Jiaz View Post
Millions of links -> power user -> I suggest at least 4-6 Gbyte

+/- 200k links
-Xmx6500M
-Xmx7000M
(GUI crashes), but it still works Crawling
Reply With Quote
  #31  
Old 07.04.2015, 11:59
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 64,713
Default

The GUI does not crash. It freezes because of other stuff. Too many workload on gui. I'm still working on that one. A threadump would help me a lot in this case. Just create 2-3 threaddumps and send via email
__________________
JD-Dev & Server-Admin
Reply With Quote
  #32  
Old 07.04.2015, 12:17
djmakinera djmakinera is offline
JD Legend
 
Join Date: May 2010
Location: Poland
Posts: 8,223
Default

Quote:
Too many workload on gui.
while crawling more links are added to a single package, too many workload on CPU.

Quote:
Just create 2-3 threaddumps and send via email
ok.

High CPU usage when downloading
The higher the "Uptime" = the load increases CPU or RAM

Thread Dump 1
http://jdownloader.org/pastebin/133633
Thread Dump 2
http://jdownloader.org/pastebin/133635
Thread dump 3
http://jdownloader.org/pastebin/133636




Last edited by Lram32; 20.09.2015 at 03:28. Reason: merged multiple posts
Reply With Quote
  #33  
Old 22.04.2015, 03:58
zittigna zittigna is offline
Junior Loader
 
Join Date: Apr 2015
Posts: 10
Default

Can you find any correlation between cpu load and package size?
I mean, can you see differences having just one enabled package with less than 100 files and one with ~2000 files?
Reply With Quote
  #34  
Old 22.04.2015, 10:50
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 64,713
Default

2 of those 3 threaddumps are from jvisualvm and not from JDownloader.
Please create several thread dumps from JDownloader
I can also offer you live help via teamviewer if you like
__________________
JD-Dev & Server-Admin
Reply With Quote
  #35  
Old 22.04.2015, 11:17
djmakinera djmakinera is offline
JD Legend
 
Join Date: May 2010
Location: Poland
Posts: 8,223
Default

Quote:
Originally Posted by Jiaz View Post
Please create several thread dumps from JDownloader
how?
10?
20?
100?

Uptime on my screen was 6-7 hours.
can not reproduce if Uptime is very small.
Reply With Quote
  #36  
Old 22.04.2015, 11:19
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 64,713
Default

the thread dumps that are linked are from JVisualVm
How: just click create thread dump 3-4 times then 3-4 tabs open and voila, you can copy/paste them or send via email
__________________
JD-Dev & Server-Admin
Reply With Quote
  #37  
Old 22.04.2015, 11:21
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 64,713
Default

I can also offer teamviewer
__________________
JD-Dev & Server-Admin
Reply With Quote
  #38  
Old 22.04.2015, 11:25
djmakinera djmakinera is offline
JD Legend
 
Join Date: May 2010
Location: Poland
Posts: 8,223
Default

but only when the load is high?
because at the moment is low

is inclined to believe that the load is high in specific cases where the set I
Remove finished downloads: immediately
Downloading small files and deleting url list takes in rapidly <= causes high load disk I/O ?

Last edited by djmakinera; 22.04.2015 at 11:30.
Reply With Quote
  #39  
Old 22.04.2015, 11:32
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 64,713
Default

Yes, this is indeed the case. Link remove -> refresh list/refresh gui/refresh internal states -> lot of cpu usage. With help of thread dumps I can try to optimize all this for ppl like (many many many links )
__________________
JD-Dev & Server-Admin
Reply With Quote
  #40  
Old 25.04.2015, 08:40
djmakinera djmakinera is offline
JD Legend
 
Join Date: May 2010
Location: Poland
Posts: 8,223
Default

http://jdownloader.org/pastebin/133659
http://jdownloader.org/pastebin/133660


Spoiler:





Starting... Freeze

avoid freeze - does not work if there is an error 504
avoid freeze - work if there is an


Spoiler:



Spoiler:

Last edited by djmakinera; 25.04.2015 at 09:44.
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 05:01.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2019, Jelsoft Enterprises Ltd.