JDownloader Community - Appwork GmbH
 

Notices

Reply
 
Thread Tools Display Modes
  #1  
Old 23.07.2021, 21:17
Student im ersten Jahr Student im ersten Jahr is offline
Black Hole
 
Join Date: Nov 2020
Posts: 281
Default “insufficient memory for the Java Runtime Environment ”

When downloading from proza.ru direct links - memory usage is very high.
Will 10 GB RAM and 99% CPU be used so much for 94 K links?

There is a problem with the settings with this hosting.
-Not all packages fully completed are removed automatically:

Issue Setting:

Remove finished downloads: when package is ready

Issue2:
I click STOP download, does not respond to commands, still downloads.

Also, when I try to manually remove packages, the window with the message about the removal of files does not appear, or there is a huge delay.

this problems did not occur before, not so long ago I am experiencing these problems.

23.07.21 22.19.17 <--> 23.07.21 22.44.32 jdlog://9925825302851/

Image:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Example Url:
Spoiler:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Last edited by Student im ersten Jahr; 24.07.2021 at 17:48.
Reply With Quote
  #2  
Old 26.07.2021, 20:13
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

@Student im ersten Jahr

You don't have 94k links in list but

375k + 264k = 639k
[jd.controlling.downloadcontroller.DownloadController$7(run)] -> LinkList found: 5876/375273
[jd.controlling.linkcollector.LinkCollector$17(run)] -> CollectorList found: 5260/264722
__________________
JD-Dev & Server-Admin
Reply With Quote
  #3  
Old 27.07.2021, 14:13
Student im ersten Jahr Student im ersten Jahr is offline
Black Hole
 
Join Date: Nov 2020
Posts: 281
Default

After all, CPU memory usage occurs only on this server.
Small files put a strain on the ZIP file, and it takes time to answer such small files.
Even for soundcloud and other servers, there are no such loads for jd! JD2 requires more than 10GB and that's why it runs so slow. NEEDS 30 LB 40GB RAM. I tested it with the smallest link packages. After four hours of downloading, it uses 16 GB of RAM.
The problem is that memory is not freed (JAVA). If you know to free up memory (released), please enter the parameters on the forum.

Last edited by Student im ersten Jahr; 27.07.2021 at 14:17.
Reply With Quote
  #4  
Old 27.07.2021, 17:36
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

Quote:
Originally Posted by Student im ersten Jahr View Post
After four hours of downloading, it uses 16 GB of RAM.
The problem is that memory is not freed (JAVA). If you know to free up memory (released), please enter the parameters on the forum.
1.) your JDownloader was limited to 10GB of heap memory, so it cannot use 16GB
2.) JDownloader doesn't free memory by default. It's allowed up to max heap memory. If you want java to free memory, then you have to tweak your JVM parameter
__________________
JD-Dev & Server-Admin
Reply With Quote
  #5  
Old 27.07.2021, 17:37
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

Quote:
Originally Posted by Student im ersten Jahr View Post
Small files put a strain on the ZIP file, and it takes time to answer such small files
It's not about the files but just about the huge number of links.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #6  
Old 28.07.2021, 15:04
Student im ersten Jahr Student im ersten Jahr is offline
Black Hole
 
Join Date: Nov 2020
Posts: 281
Default

JD can use more than 10G B. I have a cache/virtual memory set on a 40 GB SSD
Reply With Quote
  #7  
Old 28.07.2021, 16:17
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

@Student im ersten Jahr: It depends on your java memory settings. Your JDownloader installation, according to your screenshot, is limited to max 10GB of heap memory. So JDownloader/Java cannot use 16GB in total. If you want to use more, then you have to modify your jvm parameters
__________________
JD-Dev & Server-Admin
Reply With Quote
  #8  
Old 28.07.2021, 21:44
Student im ersten Jahr Student im ersten Jahr is offline
Black Hole
 
Join Date: Nov 2020
Posts: 281
Default

If you want java to free memory, then you have to tweak your JVM parameter

I would like these parameters?
Reply With Quote
  #9  
Old 29.07.2021, 13:11
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

see
stackoverflow.com/questions/30458195/does-gc-release-back-memory-to-os
geekyhacker.com/2019/01/04/jvm-does-not-release-memory/
__________________
JD-Dev & Server-Admin
Reply With Quote
  #10  
Old 29.07.2021, 14:09
Student im ersten Jahr Student im ersten Jahr is offline
Black Hole
 
Join Date: Nov 2020
Posts: 281
Default

Don't expect him to understand this as I'm not an advanced user.
Reply With Quote
  #11  
Old 29.07.2021, 14:55
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

@Student im ersten Jahr: I'm sorry but a user with nearl 700 thousand links in list and having to deal with that much memory/space...what else is a power/advanced user?
Read those articles and it will also give you the details how to tweak jvm parameter.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #12  
Old 30.07.2021, 07:09
Student im ersten Jahr Student im ersten Jahr is offline
Black Hole
 
Join Date: Nov 2020
Posts: 281
Default

Jiaz - It is impossible that I have 700k. It is rather exaggerating.
https://postimg.cc/gallery/BFwVj28


Some functions (including instability) do not work in JD2. This malfunction is due to an error.
Attached Files
File Type: rar replay_pid14684.rar (47.2 KB, 2 views)
Reply With Quote
  #13  
Old 30.07.2021, 10:20
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

@Student im ersten Jahr: I took the info directly from your last given log.
Your screenshots show lower number, around 400k now becuase you have either filtered or removed some entries.
Once you've hit memory limits and even go out-of-memory, no gurantees.

I've given every information you need to tweak your setup (jvm paramters, JD parameters...heap settings...) now go ahead and tweak it for your own use case but no longer waste our time on repeating topics
__________________
JD-Dev & Server-Admin
Reply With Quote
  #14  
Old 30.07.2021, 11:17
Student im ersten Jahr Student im ersten Jahr is offline
Black Hole
 
Join Date: Nov 2020
Posts: 281
Default

pspzockersce gave me some advanced setups - it really helped.
Only this setting has stopped working or is taking up a lot of RAM. 99% cpu 10gb ram+
My setting:
https://postimg.cc/R3JyNQ5g
Reply With Quote
  #15  
Old 30.07.2021, 11:20
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

You should also reduce the interval of writing list to disk
https://board.jdownloader.org/showpo...5&postcount=47
__________________
JD-Dev & Server-Admin
Reply With Quote
  #16  
Old 02.08.2021, 12:56
Student im ersten Jahr Student im ersten Jahr is offline
Black Hole
 
Join Date: Nov 2020
Posts: 281
Default “insufficient memory for the Java Runtime Environment ”

My computer is low on memory? Even at 50% RAM (task manager) it shows to close Javaw.exe is automatically closed due to lack of virtual memory. Although I already have 13 GB set and that's enough for me. Java is of course part of the JD2 application. Jdownloader idle shifts everything to virtual memory. I don't download JD2 files, it doesn't parse anything and doesn't add links! And JDownloader increases memory usage instead of released. On Stack Overflow (website), some users have a similar problem. I found a partial solution, a few Gb memory is released if I clean the Java cache manually. My question is how to auto clean unused cache?
After cleaning, the usage from 12 Gb decreased to 7 GB! So it helps keep the PC in better control of the computer's resources.

C:\Users\My\AppData\LocalLow\Sun\Java\Deployment\cache

Windows info:
https://i.stack.imgur.com/tymHb.png

Good parameter?
javaw.exe" -Xms256m -Xmx11G -XX:+UseG1GC -XX:MaxGCPauseMillis=200r -jar

https://www.oracle.com/webfolder/tec...ted/index.html

Last edited by Student im ersten Jahr; 02.08.2021 at 13:04.
Reply With Quote
  #17  
Old 02.08.2021, 17:01
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

@Student im ersten Jahr:
That "cache" folder is not used at all by JDownloader/its bundled java.

You have not specified any of the mentioned JVM parameters to free unused memory and *give back* to os. Did you even read the links?

Please read those links, read them carefully and try to understand what they are telling you and then setup those JVM for your own personal use case!

Quote:
Originally Posted by Jiaz View Post
I've given every information you need to tweak your setup (jvm paramters, JD parameters...heap settings...) now go ahead and tweak it for your own use case but no longer waste our time on repeating topics
__________________
JD-Dev & Server-Admin
Reply With Quote
  #18  
Old 02.08.2021, 17:27
Student im ersten Jahr Student im ersten Jahr is offline
Black Hole
 
Join Date: Nov 2020
Posts: 281
Default

I set it up and it work. Now the usage by JD2 is low that when eg lower RAM usage this message pops up!
I will only run JD2 in IDLE (I will wait 12 hours (NO DOWNLOAD START/NO CRAWLER JOB!!)
It will accumulate a lot of garbage for 12 hours, the only salvation is to restart JD2 frequently to regain memory.
Reading the articles will not change anything if you do not understand the concepts at a higher level.
Reply With Quote
  #19  
Old 02.08.2021, 17:52
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

@Student im ersten Jahr: JVM will not free any memory when you don't tell (via JVM Parameter) that it should. explained here, https://board.jdownloader.org/showpo...86&postcount=9
IDLE doesn't mean that no memory is required!
Your use of JDownloader is far far far away from *normal* usage, so get yourself together and start reading/learning yourself and not wasting time of support again and again.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #20  
Old 02.08.2021, 18:43
Student im ersten Jahr Student im ersten Jahr is offline
Black Hole
 
Join Date: Nov 2020
Posts: 281
Default

I see. The topic can be closed because it is finally impossible to fix it. Just repeating message. Endlessly popping up many windows errors and running out of computer resources. Only a hard restart of the computer.

https://postimg.cc/KkQ9fpgY

Last edited by Jiaz; 02.08.2021 at 19:19.
Reply With Quote
  #21  
Old 02.08.2021, 19:19
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

Those dialogs mean that you want to start JVM with more memory/heap that your system can provide. Virtual Memory/Swap does NOT increase your available System Memory.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #22  
Old 02.08.2021, 20:26
Student im ersten Jahr Student im ersten Jahr is offline
Black Hole
 
Join Date: Nov 2020
Posts: 281
Default

I was able to run JD2, but in 2 minutes JD2 error again. See this additional information.
I have 16GB + 4GB (20 GB) of physical memory installed in my system.
I turned off all other processes for the test.

https://postimg.cc/s10LLJcN

I have 20 GB of RAM but cannot use when
VM13GB / 20GB RAM = 0.65
Max. 65% = 13 GB RAM.
So somewhere that missing ~ 7GB is leaking Memory.(probaly, maybe..)

Last edited by Student im ersten Jahr; 02.08.2021 at 20:36.
Reply With Quote
  #23  
Old 03.08.2021, 19:26
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

@Student im ersten Jahr: I'm sorry but I don't understand what you are trying to tell me
Screenshot shows that Java is using max heap of 8GB and currently allocated 4,27GB of memory.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #24  
Old 03.08.2021, 19:28
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

Quote:
Originally Posted by Student im ersten Jahr View Post
I have 20 GB of RAM but cannot use when
VM13GB / 20GB RAM = 0.65
Max. 65% = 13 GB RAM.
So somewhere that missing ~ 7GB is leaking Memory.(probaly, maybe..)
No idea what you are talking about! VM13GB? what do you mean by that?
__________________
JD-Dev & Server-Admin
Reply With Quote
  #25  
Old 03.08.2021, 20:11
Student im ersten Jahr Student im ersten Jahr is offline
Black Hole
 
Join Date: Nov 2020
Posts: 281
Default

A very well-known topic among users where "Mappedfile" and Stadby takes most RAM.
I just checked in RamMap and it turns out that Mappedfile consumes most RAM memory.
I did not change anything in the system, so I do not know why this problem now occurs?

https://postimg.cc/7JhfBYHP

**External links are only visible to Support Staff****External links are only visible to Support Staff**

Edit:
his will help me find the memory leak problem
memory-leak-where-did-my-memory

**External links are only visible to Support Staff****External links are only visible to Support Staff**

Last edited by Student im ersten Jahr; 03.08.2021 at 20:20.
Reply With Quote
  #26  
Old 03.08.2021, 20:24
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

MappedFile = applications that memory map files. JDownloader doesn't use memory mapped files.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #27  
Old 04.08.2021, 00:02
Student im ersten Jahr Student im ersten Jahr is offline
Black Hole
 
Join Date: Nov 2020
Posts: 281
Default

Quote:
Originally Posted by Jiaz View Post
JDownloader doesn't use memory mapped files.
Look: https://postimg.cc/PCPVpGkZ

------------------

Jdownloader it's Java. It is obvious that the bug is with Java, but JDownloader is related to it.
But let's leave it at that. I have a small program. I haven't used it for a long time, but I checked the system status and it turned out that for some reason, I was turned on again this tweak..
https://i.postimg.cc/Vk77MNHc/Screen...t-11-01-PM.png

"Always Keep Windows Kernel In Memory".


I turned this feature off again. We'll see...
Reply With Quote
  #28  
Old 04.08.2021, 13:34
Student im ersten Jahr Student im ersten Jahr is offline
Black Hole
 
Join Date: Nov 2020
Posts: 281
Default

The Windows kernel memory manager component manages the physical memory of the operating system.
Disabling this function meant that messages that indicated the problem with exhausting computer resources have stopped appearing. And all the more problems with the exhaustion of physical or virtual memory - officially solved.
Reply With Quote
  #29  
Old 04.08.2021, 14:08
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

@Student im ersten Jahr: JDownloader doesn't use memory mapped files. Yes, Java does support them, but they are not used in JDownloader.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #30  
Old 04.08.2021, 14:09
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

Quote:
Originally Posted by Student im ersten Jahr View Post
The Windows kernel memory manager component manages the physical memory of the operating system.
Disabling this function meant that messages that indicated the problem with exhausting computer resources have stopped appearing. And all the more problems with the exhaustion of physical or virtual memory - officially solved.
thanks for the feedback!
__________________
JD-Dev & Server-Admin
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 17:35.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.