JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #41  
Old 11.05.2021, 09:54
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 71,489
Default

It is easy if you don't make it too complicated. You know the html you want to search URLs in, so it's very easy. You don't have to parse any URL out there, just those you are interested in
__________________
JD-Dev & Server-Admin
Reply With Quote
  #42  
Old 23.07.2021, 20:17
Student im ersten Jahr Student im ersten Jahr is offline
Fibre Channel User
 
Join Date: Nov 2020
Posts: 116
Default

When downloading from proza.ru direct links - memory usage is very high.
Will 10 GB RAM and 99% CPU be used so much for 94 K links?

There is a problem with the settings with this hosting.
-Not all packages fully completed are removed automatically:

Issue Setting:

Remove finished downloads: when package is ready

Issue2:
I click STOP download, does not respond to commands, still downloads.

Also, when I try to manually remove packages, the window with the message about the removal of files does not appear, or there is a huge delay.

this problems did not occur before, not so long ago I am experiencing these problems.

23.07.21 22.19.17 <--> 23.07.21 22.44.32 jdlog://9925825302851/

Image:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Example Url:
Spoiler:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Last edited by Student im ersten Jahr; 24.07.2021 at 16:48.
Reply With Quote
  #43  
Old 26.07.2021, 19:13
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 71,489
Default

@Student im ersten Jahr

You don't have 94k links in list but

375k + 264k = 639k
[jd.controlling.downloadcontroller.DownloadController$7(run)] -> LinkList found: 5876/375273
[jd.controlling.linkcollector.LinkCollector$17(run)] -> CollectorList found: 5260/264722
__________________
JD-Dev & Server-Admin
Reply With Quote
  #44  
Old 27.07.2021, 13:13
Student im ersten Jahr Student im ersten Jahr is offline
Fibre Channel User
 
Join Date: Nov 2020
Posts: 116
Default

After all, CPU memory usage occurs only on this server.
Small files put a strain on the ZIP file, and it takes time to answer such small files.
Even for soundcloud and other servers, there are no such loads for jd! JD2 requires more than 10GB and that's why it runs so slow. NEEDS 30 LB 40GB RAM. I tested it with the smallest link packages. After four hours of downloading, it uses 16 GB of RAM.
The problem is that memory is not freed (JAVA). If you know to free up memory (released), please enter the parameters on the forum.

Last edited by Student im ersten Jahr; 27.07.2021 at 13:17.
Reply With Quote
  #45  
Old 27.07.2021, 16:36
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 71,489
Default

Quote:
Originally Posted by Student im ersten Jahr View Post
After four hours of downloading, it uses 16 GB of RAM.
The problem is that memory is not freed (JAVA). If you know to free up memory (released), please enter the parameters on the forum.
1.) your JDownloader was limited to 10GB of heap memory, so it cannot use 16GB
2.) JDownloader doesn't free memory by default. It's allowed up to max heap memory. If you want java to free memory, then you have to tweak your JVM parameter
__________________
JD-Dev & Server-Admin
Reply With Quote
  #46  
Old 27.07.2021, 16:37
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 71,489
Default

Quote:
Originally Posted by Student im ersten Jahr View Post
Small files put a strain on the ZIP file, and it takes time to answer such small files
It's not about the files but just about the huge number of links.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #47  
Old 28.07.2021, 14:04
Student im ersten Jahr Student im ersten Jahr is offline
Fibre Channel User
 
Join Date: Nov 2020
Posts: 116
Default

JD can use more than 10G B. I have a cache/virtual memory set on a 40 GB SSD
Reply With Quote
  #48  
Old 28.07.2021, 15:17
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 71,489
Default

@Student im ersten Jahr: It depends on your java memory settings. Your JDownloader installation, according to your screenshot, is limited to max 10GB of heap memory. So JDownloader/Java cannot use 16GB in total. If you want to use more, then you have to modify your jvm parameters
__________________
JD-Dev & Server-Admin
Reply With Quote
  #49  
Old 28.07.2021, 20:44
Student im ersten Jahr Student im ersten Jahr is offline
Fibre Channel User
 
Join Date: Nov 2020
Posts: 116
Default

If you want java to free memory, then you have to tweak your JVM parameter

I would like these parameters?
Reply With Quote
  #50  
Old 29.07.2021, 12:11
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 71,489
Default

see
stackoverflow.com/questions/30458195/does-gc-release-back-memory-to-os
geekyhacker.com/2019/01/04/jvm-does-not-release-memory/
__________________
JD-Dev & Server-Admin
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 12:16.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2021, Jelsoft Enterprises Ltd.