JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 18.08.2018, 05:14
plip plip is offline
Wind Gust
 
Join Date: Jun 2016
Posts: 40
Default Twitch - a video always fails at 300+ mb

This vod: **External links are only visible to Support Staff****External links are only visible to Support Staff**

It has failed more than once at 300-something mb, with the messages "An error occured" and "Try restarting this link". If I jump around in the stream on twitch it seems the whole stream is available.

It will get auto deleted in about two weeks.

I'm wondering what the problem is and if there's anything I can do to get around it.

I tried to generate a log, but that failed. Wow it was really taking a long time to generate a log before it failed.

I did have JD2 open for several days (it's very hard to find a good time to restart JD2 when you're getting non-resumable twitch vods and aren't at the pc often. You literally would have to keep checking the pc every few hours to see if a vod is closed to finishing, so you can restart JD2 when that happens.

Is there any way to make it so JD2 will restart after the current running download is finished (not ALL downloads) and start downloading again automatically after the restart? Like a "Restart after this download" option instead of "Stop after this download"? Stop after this download is useful, but not if you are getting non-resumable downloads and aren't at the pc very often. It's hard find a time to restart or update JD2 in that case.

Here's the failed log error message:

jd.http.Browser$BrowserException

This error is caused by:

java.lang.RuntimeException: jd.http.Browser$BrowserException
at org.jdownloader.jdserv.JDServUtils.upload(JDServUtils.java:47)
at org.jdownloader.jdserv.JDServUtils.uploadLog(JDServUtils.java:26)
at org.jdownloader.jdserv.JDServUtils.uploadLog(JDServUtils.java:22)
at jd.gui.swing.jdgui.menu.actions.sendlogs.LogAction.onNewPackage(LogAction.java:69)
at org.appwork.utils.logging2.sendlogs.AbstractLogAction.createPackage(AbstractLogAction.java:233)
at jd.gui.swing.jdgui.menu.actions.sendlogs.LogAction.createPackage(LogAction.java:53)
at org.appwork.utils.logging2.sendlogs.AbstractLogAction$2.run(AbstractLogAction.java:157)
at org.appwork.utils.swing.dialog.ProgressDialog$4.run(ProgressDialog.java:234)
Caused by: jd.http.Browser$BrowserException
at jd.http.Browser.openRequestConnection(Browser.java:1708)
at jd.http.Browser.openRequestConnection(Browser.java:1517)
at org.jdownloader.jdserv.JDServUtils.upload(JDServUtils.java:39)
... 7 more
Caused by: java.net.SocketException: Connection reset by peer: socket write error
at java.net.SocketOutputStream.socketWrite0(Native Method)
at java.net.SocketOutputStream.socketWrite(Unknown Source)
at java.net.SocketOutputStream.write(Unknown Source)
at org.appwork.utils.net.CountingOutputStream.write(CountingOutputStream.java:73)
at org.appwork.utils.net.CountingOutputStream.write(CountingOutputStream.java:73)
at jd.http.requests.PostFormDataRequest.write(PostFormDataRequest.java:156)
at jd.http.requests.PostFormDataRequest.postContent(PostFormDataRequest.java:96)
at jd.http.requests.PostFormDataRequest.postRequest(PostFormDataRequest.java:121)
at jd.http.Request.connect(Request.java:333)
at jd.http.Request.connect(Request.java:321)
at jd.http.Browser.openRequestConnection(Browser.java:1661)
... 9 more
Reply With Quote
  #2  
Old 20.08.2018, 12:24
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 70,875
Default

Close JDownloader. Delete the logs folder within your JDownloader and start again
Reproduce the issue and try to create log again. In case it fails (size too large), zip the logs folder and upload (for example mega) and send the link to support@jdownloader.org

Twitch uses HLS and JDownloader doesn't yet support resume for this as the video is splitted in many many many small chunks.

__________________
JD-Dev & Server-Admin
Reply With Quote
  #3  
Old 21.08.2018, 07:04
plip plip is offline
Wind Gust
 
Join Date: Jun 2016
Posts: 40
Default

I thought I came back to post a log. Guess not so here it is:

jdlog://2022264433151/
Reply With Quote
  #4  
Old 21.08.2018, 12:06
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 70,875
Default

What Quality/Varient do you try to download? I've already got an Idea.
The stream contains muted (copyrighted music) sections.
Does the error happen on download or on *merge*. After download there is a second phase to merge the individual parts
__________________
JD-Dev & Server-Admin
Reply With Quote
  #5  
Old 21.08.2018, 16:27
plip plip is offline
Wind Gust
 
Join Date: Jun 2016
Posts: 40
Default

720p 30fps (not source).

It fails before long before download completion. It never gets to a merge.

I've noticed that when it fails there's a part0 and a part1, if that helps. It might be failing shortly after (right after?) the first "part0" completes and it switches to the second "part1".

Edit: I'll mention this in case the information helps.

With a different downloader I did get it to "complete". That downloader doesn't use ffmpeg for downloading, I'm pretty sure. It gets a load of .ts files. Then it merges the .ts files to one. Then it converts to mp4 (using ffmpeg I believe). Interestingly, the converted mp4 on that downloader resulted in a video which is twice as long as the vod length, and audio get horribly out of synch quickly. It's essentially unplayable.

But because I know this is a problematic vod, I did copy the merged .ts video from that downloader before the conversion to mp4 completed (when conversion completes the merged .ts automatically gets deleted).

That merged .ts file plays perfectly. No issues.

My best guess is maybe the issue is related to ffmpeg somehow? Because the other downloader doesn't do anything wrong until it uses ffmpeg for the conversion.

Last edited by plip; 21.08.2018 at 16:39.
Reply With Quote
  #6  
Old 21.08.2018, 18:30
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 70,875
Default

The issue happens because there are muted segments (removed audio because of copyright). There are two ways to download twitch streams.
1.) just download the individual segments and concat them into one big file. This way you get a playable file but seeking might be junky/broken and the length might be calculated wrong. Once such a *muted* segment happens, then video/audio might get out of sync. it highly depends of you just keep the concated ts file or convert them to mp4 (fixes seek and length)
2.) *feed* all individual segments into ffmpeg and let it *mux* them into one big file. This conversion will take care of sync/seek and video length but ffmpeg fails to handle those segments where no audio is given because it cannot handle *random* loss of audio track. Twitch just removes the complete audio track from the segment and that causes ffmpeg to fail.

you could try out youtube-dl and check if it manages to download the stream in *good/playable* state. feedback would be nice
__________________
JD-Dev & Server-Admin
Reply With Quote
  #7  
Old 22.08.2018, 07:47
plip plip is offline
Wind Gust
 
Join Date: Jun 2016
Posts: 40
Default

Unfortunately I'm no good at command lines and have never been able to figure out how to get youtube-dl to do what I want. I just end up with frustration. Unless it's become much more user friendly in the last few years I really have no clue how to get that thing to work.
Reply With Quote
  #8  
Old 24.08.2018, 09:45
plip plip is offline
Wind Gust
 
Join Date: Jun 2016
Posts: 40
Default

I tried converting the merged .ts I already had to mp4 with Avidemux. That resulted in a video of the correct length, but it had choppy audio throughout most of the video.

I don't know if that information is helpful or not.
Reply With Quote
  #9  
Old 24.08.2018, 11:05
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 70,875
Default

that *choppy audio* is because there are parts in streams that are muted by twitch and that causes sync loss between audio/video. The webplayer doesn't bother because it can *resync* itself to live stream, but the playback software takes plays the stream as it is and loses sync in those situations. You should not try to merge to mp4 (because that's where the issue with sync loss happens). Instread just try to contact those single ts to one big ts file
__________________
JD-Dev & Server-Admin
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 03:50.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2021, Jelsoft Enterprises Ltd.