JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #761  
Old 28.09.2017, 13:57
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 15,652
Default

you are going in circles again, please read this thread in relation to directories with lot of content.

raztoki
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #762  
Old 08.10.2017, 17:56
djmakinera djmakinera is offline
JD Legend
 
Join Date: May 2010
Location: Poland
Posts: 7,340
Default Create logs (not working) + other serious bug [ONLY MEGA.CO.NZ]

08.10.17 16.53.38 <--> 08.10.17 16.42.20 jdlog://6642714015941/
**External links are only visible to Supporters****External links are only visible to Supporters**

Can not download files from ONLY mega.co.nz (several concurrent downloads)
causes JD2 failures and freezes and logs also can not be sent


ISSUE 1:
Create logs (not working)

java.lang.RuntimeException: jd.http.Browser$BrowserException
at org.jdownloader.jdserv.JDServUtils.upload(JDServUtils.java:47)
at org.jdownloader.jdserv.JDServUtils.uploadLog(JDServUtils.java:26)
at org.jdownloader.jdserv.JDServUtils.uploadLog(JDServUtils.java:22)
at jd.gui.swing.jdgui.menu.actions.sendlogs.LogAction.onNewPackage(LogAction.java:69)
at org.appwork.utils.logging2.sendlogs.AbstractLogAction.createPackage(AbstractLogAction.java:233)
at jd.gui.swing.jdgui.menu.actions.sendlogs.LogAction.createPackage(LogAction.java:53)
at org.appwork.utils.logging2.sendlogs.AbstractLogAction$2.run(AbstractLogAction.java:157)
at org.appwork.utils.swing.dialog.ProgressDialog$4.run(ProgressDialog.java:254)
Caused by: jd.http.Browser$BrowserException
at jd.http.Browser.openRequestConnection(Browser.java:1649)
at jd.http.Browser.openRequestConnection(Browser.java:1466)
at org.jdownloader.jdserv.JDServUtils.upload(JDServUtils.java:39)
... 7 more
Caused by: java.net.SocketException: Connection reset by peer: socket write error
at java.net.SocketOutputStream.socketWrite0(Native Method)
at java.net.SocketOutputStream.socketWrite(Unknown Source)
at java.net.SocketOutputStream.write(Unknown Source)
at org.appwork.utils.net.CountingOutputStream.write(CountingOutputStream.java:73)
at org.appwork.utils.net.CountingOutputStream.write(CountingOutputStream.java:73)
at jd.http.requests.PostFormDataRequest.write(PostFormDataRequest.java:156)
at jd.http.requests.PostFormDataRequest.postContent(PostFormDataRequest.java:96)
at jd.http.requests.PostFormDataRequest.postRequest(PostFormDataRequest.java:121)
at jd.http.Request.connect(Request.java:332)
at jd.http.Request.connect(Request.java:320)
at jd.http.Browser.openRequestConnection(Browser.java:1606)
... 9 more



Download mega.co.nz = LEAK MEMORY + HIGH CPU !!!
VERY LOW PERFORMANCE AND FREEZING OF APPLICATIONS DURING MEGA.CO.NZ <===(ONLY HOST)
Reply With Quote
  #763  
Old 09.10.2017, 04:00
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 15,652
Default

post download mega decrypts
this takes cpu cycles
since you always downloading entire internet / using JDownloader outside of normal use it will take time. In this case your system can not keep up, sockets have issue connecting/writing

raztoki
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #764  
Old 09.10.2017, 09:37
djmakinera djmakinera is offline
JD Legend
 
Join Date: May 2010
Location: Poland
Posts: 7,340
Default

I only download a few files at the same time and JD2 crash!
This is a bug in mega.co.nz. It uses too many HeapSize or buffer
With other hosting I have no problems.
How to solve the problem?

Only one file downloaded simultaneously = works correctly.
Several files at the same time = High HeapSize & crash jd2

So JD2 only supports one file at a time ( max 1 simultaneous) ???

Quote:
Originally Posted by raztoki View Post
since you always downloading entire internet
40 files.
**External links are only visible to Supporters****External links are only visible to Supporters**
40 files is the entire internet. ?
Of course not, so why are you suggesting that? See how high the stack is, it's a bug !!!

Probably because JD2 currently uses too little physical memory.
so there is a stack overflow.
developers set to permanent a lower value 247.50MB, so I have to start with other values in the parameter, because dynamic stacking does not work.
For some unspecified reason mega.co.nz requires a larger buffer/heap size/more physical memory etc..

Code:
1.8.0.144(32bit) (247.50MB/247.50MB/247.50MB)

Last edited by raztoki; 09.10.2017 at 10:26. Reason: four conseq posts merged
Reply With Quote
  #765  
Old 09.10.2017, 14:09
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 52,120
Default

You should know that 256MB heap is NOT enough memory for
404 packages/19176 links! There is no mem leak and there is no issue. You cannot expect JDownloader to work properly if you don't provide enough memory.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #766  
Old 09.10.2017, 16:20
djmakinera djmakinera is offline
JD Legend
 
Join Date: May 2010
Location: Poland
Posts: 7,340
Default

I can not listen to these absurdities.
Why for vk.com 10000+ (and even more - seriously) works perfectly.
But for mega.co.nz 40 files (YES 40 FILES !!!!) (but CONDITION IS ONE MULTIPLE simultaneous downloads) uses a great GB of memory???


NOTE:Just restarting JD2 will save you from a big leaked memory while downloading - but only for a moment)

Set: 10 chunkt
Set 10 simultaneous
= slow performance mega.co.nz and crash
Reply With Quote
  #767  
Old 09.10.2017, 16:37
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 52,120
Default

JDownloader only can use max 256MB of memory (you can tell from your logs).
But I guess it's time for a new ban. I don't need you to tell me stuff you don't know about.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #768  
Old 09.10.2017, 16:39
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 52,120
Default

Quote:
Originally Posted by djmakinera View Post
NOTE:Just restarting JD2 will save you from a big leaked memory while downloading - but only for a moment)
This sentence alone shows that you STILL have no idea what you are talking about. Sad to see since we've explained you several times about memory/heap memory.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #769  
Old 09.10.2017, 16:53
djmakinera djmakinera is offline
JD Legend
 
Join Date: May 2010
Location: Poland
Posts: 7,340
Default

Okay, first issue.
Why is JD2 crashing when downloading files from mega.co.nz?
08.10.17 13.03.13 <--> 08.10.17 16.42.20 jdlog://5413714015941/
**External links are only visible to Supporters****External links are only visible to Supporters**


------------------------Thread: 23:UncaughtExceptionHandler.log-----------------------
--ID:23TS:1507473726675-10/8/17 4:42:06 PM - [jd.SecondLevelLaunch$7(uncaughtException)] -> Uncaught Exception in: 23=AWT-EventQueue-0|Java heap space
--ID:23TS:1507473728347-10/8/17 4:42:08 PM - [] -> java.lang.OutOfMemoryError: Java heap space

------------------------Thread: 812:UncaughtExceptionHandler.log-----------------------
--ID:812TS:1507473740837-10/8/17 4:42:20 PM - [jd.SecondLevelLaunch$7(uncaughtException)] -> Uncaught Exception in: 812=DownloadChunkRAF:[A1] Dj Xtorsion - Just Be you.mp3|Java heap space
--ID:812TS:1507473740837-10/8/17 4:42:20 PM - [] -> java.lang.OutOfMemoryError: Java heap space
Reply With Quote
  #770  
Old 09.10.2017, 16:58
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 52,120
Default

Java is out of memory with 256MB and 19138 links. There is barley memory available to work with. Java does not have enough free heap left for garbage collection and that's why it fails with OutOfMemoryError.
Restart your JDownloader and provide a screenshot of your About dialog. It shows how much memory is left to work with
__________________
JD-Dev & Server-Admin
Reply With Quote
  #771  
Old 09.10.2017, 17:08
djmakinera djmakinera is offline
JD Legend
 
Join Date: May 2010
Location: Poland
Posts: 7,340
Default

nEW CORE JD2 Java:/MB / /MB /2gb HEAP MAX(DEFAULT SETTING)Heap size=Crash JD2
Work Download




OLD JD CORE Java:/MB /MB /256mb HEAP MAX.
Failure (DEFAULT SETTING)

You do not need a screen because the window is all black.
Reply With Quote
  #772  
Old 09.10.2017, 17:13
djmakinera djmakinera is offline
JD Legend
 
Join Date: May 2010
Location: Poland
Posts: 7,340
Default

Quote:
Originally Posted by Jiaz View Post
Java is out of memory with 256MB and 19138 links. There is barley memory available to work with. Java does not have enough free heap left for garbage collection and that's why it fails with OutOfMemoryError.
Restart your JDownloader and provide a screenshot of your About dialog. It shows how much memory is left to work with
OutOfMemoryError is a known bug in Windows and even released patches (hotfix) for some systems.
Alternatively PROGRAM WHEN REPORTS ABOUT LACK OF MEMORY NP. When I use 83% of physical memory, I've reported it to some developers, but it's an unbelievably difficult error to fix.

https://support.microsoft.com/en-us/...ge-number-of-p
Reply With Quote
  #773  
Old 09.10.2017, 17:17
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 52,120
Default

OMG. you still haven't understood what this OutOfMemoryError is and that it does NOT come from windows...I'm giving up.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #774  
Old 09.10.2017, 17:24
djmakinera djmakinera is offline
JD Legend
 
Join Date: May 2010
Location: Poland
Posts: 7,340
Default

I use 23% of physical memory in my memory (12 GB RAM), and I'm not interested in using 100% memory (out of memory) because it's crap jd2.
The heap size in JD2 is high when download mega.co.nz? so it crashes.
Well, it looks like mega.co.nz uses more heap than my favorite VK server.

My suggestion:
tion:Return to old JD2 settings: Default is ~2048 MB (~2GB) Max. Heap
Reply With Quote
  #775  
Old 09.10.2017, 17:29
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 52,120
Default

Please tell me where you check heap size? I'm very curious how you check that value ?
Do you even know what java heap is? How it works?
It has nothing to do with mega or vk or anything else. 256MB max heap is NOT ENOUGH for thousands of links + gui + enough room for java to garbage collection.
Of course it works fine when you provide more heap, that is no surprise.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #776  
Old 09.10.2017, 17:39
djmakinera djmakinera is offline
JD Legend
 
Join Date: May 2010
Location: Poland
Posts: 7,340
Default

Download Master resumes without any problem, without using a lot of RAM.
Zero problems for multiple connections.

Check stack/heap size in JDK application by downloading multiple files simultaneously (not just one at a time)
Generating too many errors in milliseconds.

Last edited by Jiaz; 09.10.2017 at 17:46.
Reply With Quote
  #777  
Old 09.10.2017, 17:47
djmakinera djmakinera is offline
JD Legend
 
Join Date: May 2010
Location: Poland
Posts: 7,340
Default

Generating large logs with BUGS error, and error and error and error and error and error and error and error and error in a second causes a large CPU usage and a stack OVErflow (High Hepa Size use)
Reply With Quote
  #778  
Old 09.10.2017, 17:48
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 52,120
Default

Quote:
Originally Posted by djmakinera View Post
Download Master resumes without any problem, without using a lot of RAM.
Zero problems for multiple connections.
Fine, then we can finally stop supporting you. I will talk to team about no longer providing support.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #779  
Old 03.11.2017, 20:20
djmakinera djmakinera is offline
JD Legend
 
Join Date: May 2010
Location: Poland
Posts: 7,340
Default Bug: Please wait: Parsing Clipboard content

03.11.17 19.15.06 <--> 03.11.17 19.17.24 jdlog://1831914015941/

Code:
Please wait: Parsing Clipboard content
I added only 2343 links and it takes a long time (!) And nothing adds...
Probably freeze.


Reply With Quote
  #780  
Old 04.11.2017, 15:09
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 52,120
Default

It was just a gui bug, already fixed
__________________
JD-Dev & Server-Admin
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 06:28.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.9
Copyright ©2000 - 2018, Jelsoft Enterprises Ltd.