JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #21  
Old 17.06.2015, 09:41
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 67,541
Default

What CLI tool do you use? Maybe you can setup to ignore/not highlight sparse files.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #22  
Old 17.06.2015, 09:42
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 67,541
Default

@MrGonzo: Thanks for feedback and no worry, it will be default enabled
__________________
JD-Dev & Server-Admin
Reply With Quote
  #23  
Old 17.06.2015, 18:09
nickles nickles is offline
Baby Loader
 
Join Date: Nov 2013
Posts: 9
Default

The tool is Take Command (though I could configure this). However, I see no sense in haven e.g. PDF file carrying the P flag after they were downloaded successfully (which leaves them in a "non-sparse" state and creates some overhead for the OS in handling them). I wouldn't mind this change, if it could only be turned off with a advanced setting...
Reply With Quote
  #24  
Old 17.06.2015, 18:23
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 67,541
Default

I don't know what P Flag means. But in JDownloader the file is either default os or default+sparse. For example default on NTFS is compression on. I still don't understand the issue though
__________________
JD-Dev & Server-Admin
Reply With Quote
  #25  
Old 19.06.2015, 15:58
nickles nickles is offline
Baby Loader
 
Join Date: Nov 2013
Posts: 9
Default

P stands for sparse.
Please also have a look at this thread https://code.google.com/p/libtorrent.../detail?id=419
Reply With Quote
  #26  
Old 19.06.2015, 16:03
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 67,541
Default

__________________
JD-Dev & Server-Admin
Reply With Quote
  #27  
Old 17.06.2016, 23:14
MrGonzo's Avatar
MrGonzo MrGonzo is offline
JD Legend
 
Join Date: Dec 2010
Posts: 536
Question

Hi guys

Sorry to reopen an oldy lol but Ive been noticing lately that ive had to stop and start a big DLs sometimes now to get it to finish DLing at max speed.

So my question is....it looks like u added an of/off switch to the sparseing of chunks to fix this cooldown problem.....or whatever lol

I just wanna know what should i search for in the advanced setting so I can make sure this is set "on" for me?

Last edited by MrGonzo; 17.06.2016 at 23:15. Reason: add
Reply With Quote
  #28  
Old 25.06.2016, 16:37
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 67,541
Default

i'm sorry but there is no option yet to disable sparse. will work on this next week.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #29  
Old 26.06.2016, 02:35
MrGonzo's Avatar
MrGonzo MrGonzo is offline
JD Legend
 
Join Date: Dec 2010
Posts: 536
Default

Thanks Jiaz....please let me know here or PM when uve added the on/off switch for it lol
Reply With Quote
  #30  
Old 26.06.2016, 12:11
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 67,541
Default

I will post here once the tickets are done
__________________
JD-Dev & Server-Admin
Reply With Quote
  #31  
Old 04.11.2018, 16:12
lj8787 lj8787 is offline
Baby Loader
 
Join Date: Mar 2016
Posts: 7
Default

Quote:
Originally Posted by raztoki View Post

Typically when this happens on slow write devices it can take several minutes to preallocate, in which the download stops after ~8-10MB (on the systems I've used). On Virtual Disks say from VM or USB or Network drives these tasks can even be slower than a standard physical drive.


raztoki
Sorry to bump a very old thread, but it's relevant to this post. I am noticing terribly slow transfer speeds in a VirtualBox Windows 7 Guest when saving files to a shared drive from the Host. If I download something in JDownloader to the same drive but outside of the VM environment, the pre-allocation is almost instant and the file download doesn't pause at all. In the VM though, saving to the same drive on the Host, it can pause for a very long time, even on smaller files. I know running 1 chunk fixes the issue, but it also means terrible download speed from Real-Debrid (about 600Kbps I'm getting, per chunk). Is there an explanation as to why pre-allocating is so slow over networked drive in the VM? I'd love to be able to fix it. It's certainly not a drive speed bottleneck...

I should also note I've tried disable TCP Offloading in Device Manager and in the Registry, but that had no effect.

Appreciate any help.
Reply With Quote
  #32  
Old 28.04.2020, 09:24
MrGonzo's Avatar
MrGonzo MrGonzo is offline
JD Legend
 
Join Date: Dec 2010
Posts: 536
Default

Sorry to bring this issue up again...

Im not having to "start-stop-start" as much these days...but there seems to be an issue mostly near the end of a DL from about-85-95+%, the chunks start falling off quickly, killing DL speed. A lot of the time these days I have to stop the DL in the 85-95% completion range, cause when the DL drops to "1" chunk, the finishing DL speed can be quite bad (like 50kbs/s bad) and the DL "crawls" to the finish line. But if I stop the DL when it does this, and restart it...the DL usually finishes strong from that point to the finish.

Any ideas on how to fix this constant "1" chunk speed killer issue? It happens on many DLs these days.

Thanks
Reply With Quote
  #33  
Old 28.04.2020, 12:24
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,201
Default

Quote:
Originally Posted by lj8787 View Post
Sorry to bump a very old thread, but it's relevant to this post. I am noticing terribly slow transfer speeds in a VirtualBox Windows 7 Guest when saving files to a shared drive from the Host. If I download something in JDownloader to the same drive but outside of the VM environment, the pre-allocation is almost instant and the file download doesn't pause at all. In the VM though, saving to the same drive on the Host, it can pause for a very long time, even on smaller files. I know running 1 chunk fixes the issue, but it also means terrible download speed from Real-Debrid (about 600Kbps I'm getting, per chunk). Is there an explanation as to why pre-allocating is so slow over networked drive in the VM? I'd love to be able to fix it. It's certainly not a drive speed bottleneck...

I should also note I've tried disable TCP Offloading in Device Manager and in the Registry, but that had no effect.

Appreciate any help.
yes I ran JD on a friends VM and experienced the same thing, I believe that sparse isn't supported. Hung to the point where the tcp/ip connection would timeout waiting to pre-allocate the component (2 chunks = 50%) filesize required to rewrite to location.


Quote:
Originally Posted by MrGonzo View Post
Sorry to bring this issue up again...

Im not having to "start-stop-start" as much these days...but there seems to be an issue mostly near the end of a DL from about-85-95+%, the chunks start falling off quickly, killing DL speed. A lot of the time these days I have to stop the DL in the 85-95% completion range, cause when the DL drops to "1" chunk, the finishing DL speed can be quite bad (like 50kbs/s bad) and the DL "crawls" to the finish line. But if I stop the DL when it does this, and restart it...the DL usually finishes strong from that point to the finish.

Any ideas on how to fix this constant "1" chunk speed killer issue? It happens on many DLs these days.

Thanks
slow downloads at the end of the file is due to chunks finishing and existing chunks are slowwwww. Jiaz has written a new dl core years ago (but its not public) which addresses this, but until new download core becomes standard only work around like killing download if speed is under x and resuming it (event scripter)
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]

Last edited by raztoki; 28.04.2020 at 18:08. Reason: hang to hung
Reply With Quote
  #34  
Old 28.04.2020, 16:58
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 67,541
Default

@MrGonzo: In case you're talking about Uploaded, we got several similiar reports. Seems they have server issues
__________________
JD-Dev & Server-Admin
Reply With Quote
  #35  
Old 28.04.2020, 18:34
MrGonzo's Avatar
MrGonzo MrGonzo is offline
JD Legend
 
Join Date: Dec 2010
Posts: 536
Default

Quote:
Originally Posted by raztoki View Post
slow downloads at the end of the file is due to chunks finishing and existing chunks are slowwwww. Jiaz has written a new dl core years ago (but its not public) which addresses this, but until new download core becomes standard only work around like killing download if speed is under x and resuming it (event scripter)
Just what I was wondering....its good to know this issue is known and "fixed" (with new core) ....I just wonder now how long before this new core is implemented....would be nice to not have to deal with this issue anymore because its been an issue (with the current core) for a long time now. And happens quite regularly. Quite annoying actually, but at least now I know Im not the only one with this problem, and I am doing all that can be done for now (stop & restart) ....I await the new core!
Reply With Quote
  #36  
Old 29.04.2020, 14:02
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 54,826
Default

Sorry, we cannot give you any ETA.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 19:03.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.