JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 02.07.2016, 15:12
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,451
Default "File already exists" / simultaneous problem

Max. +/- 10-30 simultaneous does not always work - if the "File already exists"

but sometimes it works, but not always, and I do not know why.

02.07.16 15.05.36 <--> 02.07.16 15.06.55 jdlog://1325135891641/

Reply With Quote
  #2  
Old 04.07.2016, 11:01
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 72,672
Default

What exactly does not work?
'File already exists' has nothing to do with 'Max simultan downloads'.
The number of concurrent downloads that are running is highly depending on
-file sizes
-number of links in package/download list
-speed of download
__________________
JD-Dev & Server-Admin
Reply With Quote
  #3  
Old 04.07.2016, 14:25
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,451
Default

The problem is that only for a certain period of time the SpeedCheck is satisfactory to ignore existing files and later the speed decreases.

So to check for example. 10k-30k existing files on a disk requires a very, very long time!
I wonder whether this problem occurs only in the new core, and the old core is similar speedcheck, I'll have to test/compare
Reply With Quote
  #4  
Old 04.07.2016, 16:56
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,451
Default

Quote:
'File already exists' has nothing to do with 'Max simultan downloads'.
It is important in speed!

20000 files:
Simultaneous 20 -> ~30 minutes (SKIP)
Simultaneous 1 -> ~5 hours (SKIP)






Test Old Core..


Well it works correctly with 20 simulation (much quickly skip existing "smal" files)
but only in the old version:unsure:


Reply With Quote
  #5  
Old 04.07.2016, 17:45
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,451
Default

What set SKIP EXISTING files on disk (Not mirror link!)

Code:
GeneralSettings.onskipduetoalreadyexistsaction
[ ]
[ ]
[ ]
Reply With Quote
  #6  
Old 05.07.2016, 12:05
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 72,672
Default

I'm sorry but WHAT is the problem? Please stay focused and stay at one topic!
__________________
JD-Dev & Server-Admin
Reply With Quote
  #7  
Old 05.07.2016, 12:07
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 72,672
Default

The larger the package, the more time it takes!

Download start -> First check if there are mirrors in package! -> then check if the file exists on disk -> start downloading

First check if there are mirrors in package!-> 30k links in package -> each single link has to check again and again against 30k-1 links

then check if the file exists on disk-> this can be slow if you have large archives
__________________
JD-Dev & Server-Admin
Reply With Quote
  #8  
Old 05.07.2016, 12:09
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 72,672
Default

Wait for next core Update. I will optimize start/stop of many small files
__________________
JD-Dev & Server-Admin
Reply With Quote
  #9  
Old 05.07.2016, 13:41
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 72,672
Default

Update is live. I've tested with 10k 0 byte files, very fast
__________________
JD-Dev & Server-Admin
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 05:54.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2021, Jelsoft Enterprises Ltd.