#1
|
|||
|
|||
"File already exists" / simultaneous problem
Max. +/- 10-30 simultaneous does not always work - if the "File already exists"
but sometimes it works, but not always, and I do not know why. 02.07.16 15.05.36 <--> 02.07.16 15.06.55 jdlog://1325135891641/ |
#2
|
||||
|
||||
What exactly does not work?
'File already exists' has nothing to do with 'Max simultan downloads'. The number of concurrent downloads that are running is highly depending on -file sizes -number of links in package/download list -speed of download
__________________
JD-Dev & Server-Admin |
#3
|
|||
|
|||
The problem is that only for a certain period of time the SpeedCheck is satisfactory to ignore existing files and later the speed decreases.
So to check for example. 10k-30k existing files on a disk requires a very, very long time! I wonder whether this problem occurs only in the new core, and the old core is similar speedcheck, I'll have to test/compare |
#4
|
|||
|
|||
Quote:
20000 files: Simultaneous 20 -> ~30 minutes (SKIP) Simultaneous 1 -> ~5 hours (SKIP) Test Old Core.. Well it works correctly with 20 simulation (much quickly skip existing "smal" files) but only in the old version:unsure: |
#5
|
|||
|
|||
What set SKIP EXISTING files on disk (Not mirror link!)
Code:
GeneralSettings.onskipduetoalreadyexistsaction [ ] [ ] [ ] |
#6
|
||||
|
||||
I'm sorry but WHAT is the problem? Please stay focused and stay at one topic!
__________________
JD-Dev & Server-Admin |
#7
|
||||
|
||||
The larger the package, the more time it takes!
Download start -> First check if there are mirrors in package! -> then check if the file exists on disk -> start downloading First check if there are mirrors in package!-> 30k links in package -> each single link has to check again and again against 30k-1 links then check if the file exists on disk-> this can be slow if you have large archives
__________________
JD-Dev & Server-Admin |
#8
|
||||
|
||||
Wait for next core Update. I will optimize start/stop of many small files
__________________
JD-Dev & Server-Admin |
#9
|
||||
|
||||
Update is live. I've tested with 10k 0 byte files, very fast
__________________
JD-Dev & Server-Admin |
Thread Tools | |
Display Modes | |
|
|