JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 16.10.2019, 19:28
yurikus yurikus is offline
JD Alpha
 
Join Date: Jun 2015
Posts: 21
Thumbs up Twitch: parallel downloads and defer mux

Hi,

I was experimenting with Twitch plugin and noticed that I can greatly increase download speeds if I schedule all 10 second .ts chunks as separate files. I assume I would be able to run ffmpeg to mux them together into a single .mp4 file.

Request: Add an option to use alternate download/mux logic to download in parallel first, then mux. For long (multi-hour) streams this would allow me to grab the whole stream before Twitch blanks out the audio chunks.
Reply With Quote
  #2  
Old 16.10.2019, 19:45
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 66,134
Default

This idea requires major changes for HLS support because we first have to download the individual segments and remember which ones has already been download. Also download requires twice/x-time the size because you first download all segments, and then have to mux them into final file. Because you already have all segments on disk, it would be silly to delete them during muxing but wait for mux to complete. That way we can stop/restart the mux process without restarting the whole download.

Also more parallel connections might increase chances that server/twitch take a look how to block downloads


__________________
JD-Dev & Server-Admin
Reply With Quote
  #3  
Old 16.10.2019, 20:06
yurikus yurikus is offline
JD Alpha
 
Join Date: Jun 2015
Posts: 21
Default

Makes sense thanks. I am aware of the risks, hence wanted to make this a advanced-only setting. I'm fine with 2x disk usage and extra CPU time.
Reply With Quote
  #4  
Old 16.10.2019, 20:32
yurikus yurikus is offline
JD Alpha
 
Join Date: Jun 2015
Posts: 21
Default

wrt https://svn.jdownloader.org/issues/85472, simple concat of those .ts file doesn't produce a playable video.
Reply With Quote
  #5  
Old 16.10.2019, 20:38
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 66,134
Default

Quote:
Originally Posted by yurikus View Post
wrt https://svn.jdownloader.org/issues/85472, simple concat of those .ts file doesn't produce a playable video.
depends on the used coded/and how the container got split. for some it works, for others it doesn't
__________________
JD-Dev & Server-Admin
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 15:29.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2019, Jelsoft Enterprises Ltd.