JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 12.05.2021, 14:07
Playa Playa is offline
Junior Loader
 
Join Date: Dec 2019
Location: Germany
Posts: 11
Question K2S.CC free, Downspeed with multi-thread Downloads

Hello,
As it seems, downloading from K2S.cc with multiply chunks/threads per File slows down the Download extremely (since JD probably cant start more then one Thread). When setting the concurrent Threads per Download to 1, it works fine, even with multiply concurrent Downloads from K2S.cc.
I havent tested this in free mode, but at least as Premium Pro it does make Problems. Can you take a look at the K2S.cc Plugin? I havent found an Option for setting this in the Expert Domain Rules which is very annoying since the Limit then affects all Downloads.

Regards,
Playa
Reply With Quote
  #2  
Old 12.05.2021, 15:54
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 58,792
Default

Hi,
wir können auch Deutsch, aber ich antworte dir mal auf Englisch:

What exactly do you mean?
Afaik k2s does not allow multiple chunks/downloads per file in free mode.

For users claiming that multiple downloads are possible we've added a plugin setting some time ago (Settings -> Plugins -> k2s.cc).
There is currently no way to allow multiple chunks in free mode.
If you think that's serverside possible, please post example URLs.

Also there are ways to gain higher free download speeds by setting specified Referers via plugin setting see HERE (please don't ask me for such Referer strings, I won't provide any).

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #3  
Old 12.05.2021, 16:04
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 72,092
Default

@Playa: Please check your firewall/av. Multiple connections/chunks should not slow down your overall download speed! There are no known issues on Keep2Share with multiple connections
What destination are you downloading to? SSD/HDD/Network/USB? What model?

Please make sure that your disk is no SMR disk! These disks will be extremly (pain) slow with multiple connections because of how SMR works!
__________________
JD-Dev & Server-Admin
Reply With Quote
  #4  
Old 12.05.2021, 17:33
Playa Playa is offline
Junior Loader
 
Join Date: Dec 2019
Location: Germany
Posts: 11
Default

Hallo,
Sind hier zwar im Englischen Forum aber okay.

I have an Premium Pro Account in use, so Multi-Chunk File loading should work(since concurrent Downloads work too).
JDownloader is running from an exposed Host, so there is no Firewall interrupting.
The Downloads are saved to two Locations, an M.2 SSD and an HDD(without SMR). The Problem occurs with all Downloads, and ime sure Drive- and Network-Speed are sufficient. I also have enough Data Quota on K2S.

It seems that K2S is blocking Multi-Threaded Downloads even with premium Accounts. I believe so because when running Multi-Threaded Downloads, you can see in the Network Graph that Chunks are loaded one after another, since the other Threads cant start. Also sometimes Downloads freeze and take a while till the next Segment is loaded while their Status is still "running".
Reply With Quote
  #5  
Old 12.05.2021, 17:51
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 72,092
Default

"exposted Host" = dedicated Server/VM? Maybe they throttle your IP?

"since the other Threads cant start." -> must be something with your IP/host/setup.
Also download *freezes* sounds strange. What HDD exactly is it?

We can also take a look together via Teamviewer, contact me via support@jdownloader.org

can you download this file with multiple connections
speed.hetzner.de/10GB.bin
cdn8.appwork.org/speed.zip
?
__________________
JD-Dev & Server-Admin
Reply With Quote
  #6  
Old 13.05.2021, 14:09
Playa Playa is offline
Junior Loader
 
Join Date: Dec 2019
Location: Germany
Posts: 11
Default

Quote:
Maybe they throttle your IP?
I am running JD on my self hosted Server(which is running win10.

Quote:
"since the other Threads cant start." -> must be something with your IP/host/setup.
I have an IPv4/IPv6 Combo with 1GB/s Download speed.
I can also load from other Hosters with many Threads and Downloads running at the same Time.

Quote:
Also download *freezes* sounds strange. What HDD exactly is it?
What i ment looks like this:

When new Downloads start (in this Case the two at the Bottom), the Downloads that where previously receiving Data seem to freeze, and only sometimes get a new thread startet. There is propably an Limit for the total Connections from one User, thats my best Explanation for this Behaviour.
Here is another Picture showing that multiple single threaded Downloads do work fine:

I am using an WD Blue 1TB, so from WDs official list, it dosent has SMR. Also, this Problem happens with my SSD.
Here you have an Crystal Disk Mark report of my HDD and SSD.
HDD:
Code:
------------------------------------------------------------------------------
CrystalDiskMark 7.0.0 Shizuku Edition x64 (C) 2007-2019 hiyohiyo
                                  Crystal Dew World: https://crystalmark.info/
------------------------------------------------------------------------------
* MB/s = 1,000,000 bytes/s [SATA/600 = 600,000,000 bytes/s]
* KB = 1000 bytes, KiB = 1024 bytes

[Read]
Sequential 1MiB (Q=  8, T= 1):   144.399 MB/s [    137.7 IOPS] < 57467.61 us>
Sequential 1MiB (Q=  1, T= 1):   142.271 MB/s [    135.7 IOPS] <  7339.37 us>
    Random 4KiB (Q= 32, T=16):     1.207 MB/s [    294.7 IOPS] <715683.57 us>
    Random 4KiB (Q=  1, T= 1):     0.378 MB/s [     92.3 IOPS] < 10767.28 us>

[Write]
Sequential 1MiB (Q=  8, T= 1):   145.050 MB/s [    138.3 IOPS] < 56893.38 us>
Sequential 1MiB (Q=  1, T= 1):   106.950 MB/s [    102.0 IOPS] <  9701.48 us>
    Random 4KiB (Q= 32, T=16):     1.459 MB/s [    356.2 IOPS] <655779.60 us>
    Random 4KiB (Q=  1, T= 1):     0.521 MB/s [    127.2 IOPS] <  7823.32 us>

Profile: Default
   Test: 512 MiB (x5) [Interval: 5 sec] <DefaultAffinity=DISABLED>
   Date: 2021/05/13 14:00:53
     OS: Windows 10 Enterprise [10.0 Build 19042] (x64)
SSD:
Code:
------------------------------------------------------------------------------
CrystalDiskMark 7.0.0 Shizuku Edition x64 (C) 2007-2019 hiyohiyo
                                  Crystal Dew World: https://crystalmark.info/
------------------------------------------------------------------------------
* MB/s = 1,000,000 bytes/s [SATA/600 = 600,000,000 bytes/s]
* KB = 1000 bytes, KiB = 1024 bytes

[Read]
Sequential 1MiB (Q=  8, T= 1):  3463.222 MB/s [   3302.8 IOPS] <  2419.82 us>
Sequential 1MiB (Q=  1, T= 1):  1821.051 MB/s [   1736.7 IOPS] <   575.01 us>
    Random 4KiB (Q= 32, T=16):   884.383 MB/s [ 215913.8 IOPS] <  2367.24 us>
    Random 4KiB (Q=  1, T= 1):    51.563 MB/s [  12588.6 IOPS] <    79.09 us>

[Write]
Sequential 1MiB (Q=  8, T= 1):   283.299 MB/s [    270.2 IOPS] < 29468.78 us>
Sequential 1MiB (Q=  1, T= 1):   286.279 MB/s [    273.0 IOPS] <  3659.60 us>
    Random 4KiB (Q= 32, T=16):   813.439 MB/s [ 198593.5 IOPS] <  2496.67 us>
    Random 4KiB (Q=  1, T= 1):   121.558 MB/s [  29677.2 IOPS] <    33.40 us>

Profile: Default
   Test: 512 MiB (x5) [Interval: 5 sec] <DefaultAffinity=DISABLED>
   Date: 2021/05/13 14:07:12
     OS: Windows 10 Enterprise [10.0 Build 19042] (x64)
Quote:
can you download this file with multiple connections
Hetzner: Delta 65mb/s, 20 Threads running, Time 2-3Min
Appwork: Delta 30mb/s, 20 Threads running, Time <30Secs

Last edited by Playa; 13.05.2021 at 14:39.
Reply With Quote
  #7  
Old 13.05.2021, 16:35
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 72,092
Default

Your HDD has extremly poor writing rates, see Random 4KB! Downloading on that hdd with multiple downloads/chunks will very fast cause IO blocking because you download much faster than the OS can write data to the disk. In such situation the IO pressure is very high.

The screenshot shows what happens when
1.) you can download much faster than your OS can write data to disk. IO Overload -> network still downloading into buffers.
2.) Firewall/AV can also cause this because they might scan the whole connection/download until it is scanned and then forwarded to application.
3.) server is blocking multiple connections from same IP for same file. Can be on purpose (eg blocking VPN/datacenter IP) or configuration issue.

So the hetzner/appwork file works fine with multiple connections or does it suffer the same?

In your case I think it is k2s blocking multiple connections because of your IP or the ISP you are using is messing with the connections
__________________
JD-Dev & Server-Admin
Reply With Quote
  #8  
Old 13.05.2021, 23:57
Playa Playa is offline
Junior Loader
 
Join Date: Dec 2019
Location: Germany
Posts: 11
Default

Hi,
Thx for that info, from now on i will offload the HDD with an Raid 0 RapidStore SSD, so it should have a good write Buffer.
I use Sophos Business Version as AV, Network is listend to, but real Scans are made on File read access.
I think the 3th Point is propably the Reason behind this, as i said its not related to the HDD since i am also using an SSD which is having the same Problem.

The Hetzner/Appwork Files worked fine.
Quote:
Originally Posted by Playa View Post
Hetzner: Delta 65mb/s, 20 Threads running, Time 2-3Min
Appwork: Delta 30mb/s, 20 Threads running, Time <30Secs
I often had ISP Problems in the past, but right now, my Connection should be unfiltered in my Experience (for example with MLDonkey running with 100+ Peers). My IP is static and unshared, so its unique, that shouldent be the Problem.

We should test out on other Systems if K2S is really limiting Connections per File/IP so that can be integrated into the K2S Plugin.
Reply With Quote
  #9  
Old 14.05.2021, 19:34
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 72,092
Default

@Playa: you could test if the issue also happens with 2 connections, every >1 or just several more like >4 or >8
__________________
JD-Dev & Server-Admin
Reply With Quote
  #10  
Old 16.05.2021, 21:28
Playa Playa is offline
Junior Loader
 
Join Date: Dec 2019
Location: Germany
Posts: 11
Default

Hi,
I already tried that, even with 2 Threads it does happen.
Reply With Quote
  #11  
Old 17.05.2021, 09:59
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 72,092
Default

Thanks for testing, so either the issue is caused by your ISP or they treat your IP/Range different (most likely because of Datacenter IP). You might wanna get in contact with their support and ask them
__________________
JD-Dev & Server-Admin
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 13:01.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2021, Jelsoft Enterprises Ltd.