#1
|
|||
|
|||
swap file? high RAM usage
how to solve high RAM usage?
I use -Xmx24576m with 32GB RAM how to configure swap file usage to decrease high RAM usage? EDIT does anyone need more details? Last edited by verheiratet1952; 09.12.2021 at 16:26. |
#2
|
|||
|
|||
Quote:
sorry?! |
#3
|
||||
|
||||
@verheiratet1952: you allow java to use max 24GB of heap memory, why?
of course windows will then start to swap out memory of other stuff. how many links do you have in list? you can also tweak java to free(give back to OS) unused memory, please use google/search for the correct JVM parameters. but in first place you should not provide that amount of memory without really have to. I'm ready to further analyse the memory usage and try to optimize/reduce it
__________________
JD-Dev & Server-Admin |
#4
|
|||
|
|||
Quote:
we already had the same conversation about RAM please see https://board.jdownloader.org/showthread.php?t=86151 you told me to assign RAM manually "You can also use -Xmx24g instead of -Xmx24576m" I also made some static pagefile.sys on a M.2 using NVMe PCIe 3.0 for best speed performance... to answer your questions: -how many links do you have in list? the biggest one is about 4mio image links with nearly 90k folders where I do add/update new images/folders daily/weekly... I need to have all those links to prevent duplicates... I do always save CFG folder with its downloadlist and linkcollector ZIPs... just as an example: if I start JD with those 4mio links and its 90k folders it has at about 10GB usage at the beginning, but it gets higher and higher within few hours while crawling new content... or when just downloading files and dont run linkcrawler... Last edited by verheiratet1952; 17.12.2021 at 17:22. |
#5
|
||||
|
||||
@verheiratet1952: sorry, yes, I remember
would it be possible to send me a copy of such a large list, so I can do testing/optimization on a *real world* list. eg upload to mega and send me link to support@jdownloader.org It would really help me a lot getting hands on a real large list and not create dummy ones myself as they do not reflect *real usage*
__________________
JD-Dev & Server-Admin |
#6
|
|||
|
|||
Quote:
you should have 2 emails from transfer website for large files... subject is thread 494979 |
#7
|
|||
|
|||
Quote:
JD info |
#8
|
||||
|
||||
@verheiratet1952: thanks, I will try to find simple/easy to implement optimizations to reduce memory usage for such large lists.
__________________
JD-Dev & Server-Admin |
#9
|
|||
|
|||
Quote:
it takes some time to reach heap level after starting JD, as said before.... |
#10
|
||||
|
||||
@verheiratet1952: did not work on it yet and first goal is to reduce overal memory consumption for the links which helps to reduce memory pressure and usage
__________________
JD-Dev & Server-Admin |
#11
|
|||
|
|||
Quote:
but you downloaded downloadlist and linkcollector zips? the website does NOT store that long... |
#12
|
||||
|
||||
yes, I have them both. Thanks again for your help!
__________________
JD-Dev & Server-Admin |
#13
|
||||
|
||||
@verheiratet1952: thanks again for your help. with this list I was able to massiv reduce memory consumption in runtime. still doing tests and trying to reduce memory usage even more. I'm sure you'll notice the reduction in memory usage instantly!
__________________
JD-Dev & Server-Admin |
#14
|
|||
|
|||
Quote:
I use multiOS Version where I can assign JAVA... better to have 2 oder 3 JAVA installs that I can assign those if running more than only one JD at the same time? Last edited by verheiratet1952; 22.12.2021 at 20:07. |
#15
|
||||
|
||||
@verheiratet1952: I will finally release the update by tomorrow and it will contain the optimizations as well.
__________________
JD-Dev & Server-Admin |
#16
|
|||
|
|||
Quote:
better to have 2 oder 3 JAVA installs that I can assign those if running more than only one JD at the same time? |
#17
|
||||
|
||||
@verheiratet1952: every JDownloader is the same. Only different way to start (JDownloader.jar, .exe Launcher...) Doesn't really matter which one you use.
__________________
JD-Dev & Server-Admin |
#18
|
|||
|
|||
because of shortcut to assign max RAM and what JAVA if there is more than just one installed...
|
#19
|
||||
|
||||
@verheiratet1952:
JDownloader.jar: -double click will start with default JVM configuration and system installed Java -you can create shortcut/batch/script to start with different JVM and configuration, eg Quote:
or if you like also different JVM versions JDownloader.exe: -depends on the *age* of the launcher(exe) but in case there are .vmoptions files, you can place custom configuration in there, see https://support.jdownloader.org/Know...vmoptions-file -the launcher(exe) will use the JVM from java or jre subfolder relative to its location. You can do multiple installations of JDownloader and then each launcher will use its own .vmoptions and JVM
__________________
JD-Dev & Server-Admin |
#20
|
||||
|
||||
Update is live!
__________________
JD-Dev & Server-Admin |
Thread Tools | |
Display Modes | |
|
|