JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 07.11.2020, 09:32
anet anet is offline
DSL User
 
Join Date: Oct 2019
Posts: 38
Default Problem with NinjaStream.to

JDownloader starts downloading but then stops and the message "CRC check failed" comes out

**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #2  
Old 09.11.2020, 10:52
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 69,605
Default

Does this also happen on different files on same host?
Either the file is broken server side or some issues with local firewall/av/hardware
Check your memory with memtest86 and the smart data of your disks
__________________
JD-Dev & Server-Admin
Reply With Quote
  #3  
Old 15.11.2020, 10:39
anet anet is offline
DSL User
 
Join Date: Oct 2019
Posts: 38
Default

Quote:
Originally Posted by Jiaz View Post
Does this also happen on different files on same host?
Either the file is broken server side or some issues with local firewall/av/hardware
Check your memory with memtest86 and the smart data of your disks
it happens with all files from the same host
Reply With Quote
  #4  
Old 15.11.2020, 17:55
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 69,605
Default

Can you please provide some more example links? Maybe smaller ones?
__________________
JD-Dev & Server-Admin
Reply With Quote
  #5  
Old 11.12.2020, 15:09
timschumi timschumi is offline
Modem User
 
Join Date: Dec 2020
Posts: 3
Default

I'm currently trying to track down the issue (or rather, I already found it), but I need some help with fully fixing it.

Basically, Ninjastream splits up their files into 50MB chunks (or less) and prepends a "fake" PNG-File to each chunk (for whatever reason, but it's always the same size and presumably the same data; EDIT: it is the same data). Right now, the JD plugin only downloads the first chunk (using a hardcoded name) and dumps it to disk as-is.

I already modified my local source checkout to retrieve all the chunk filenames, but right now I'm stuck on the task of "download each chunk, remove the PNG data from the start of each, and concat them into a single file". Are there any existing plugins where I can look up how such a functionality is implemented?
Reply With Quote
  #6  
Old 11.12.2020, 15:16
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 69,605
Default

I can help with plugin changes. Are those different URLs or one and the file is PNG-DATA chunks?
In case it is one large file, then I would recommend to download the file and then post process it to remove the png chunks
Best would be you contact me via support@jdownloader.org
__________________
JD-Dev & Server-Admin
Reply With Quote
  #7  
Old 11.12.2020, 15:21
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 57,157
Default

I see that is a chunked "in-browser chunked download" (I'm lacking the correct word).
Seems like the plugin was able to "get around" this when it was created first but now they must have changed something - this might not be an easy fix.
Ticket:


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #8  
Old 11.12.2020, 15:45
timschumi timschumi is offline
Modem User
 
Join Date: Dec 2020
Posts: 3
Default

Quote:
Originally Posted by Jiaz View Post
I can help with plugin changes. Are those different URLs or one and the file is PNG-DATA chunks?
In case it is one large file, then I would recommend to download the file and then post process it to remove the png chunks
Best would be you contact me via support@jdownloader.org
All the chunks are seperate files and available from different URLs, which are composed from a common base and with the specific chunk name appended ("mp4_0.part0", "mp4_1.part1", ...). Those chunk names are available as "v-bind:playlist" in the page output as a JSON Array (similar to the existing "v-bind:stream", just as an array). The current revision of the plugin just hardcodes "mp4_0.part0".

For the chunk format, the only thing that has to be removed from each chunk file is the first 120 bytes (which due to the file magic I assume is a PNG file, but that's not really important). Everything after those 120 bytes (i.e. everything from offset 0x78 up to the end of the file) is real data that should end up unchanged in the output file.

Regarding the post-processing, do you have any examples for that on hand?

I'll happily send you an E-Mail (I assume that helps with keeping the bug report clean), in case you deem IRC more fit for communicating I'm also online there.
Reply With Quote
  #9  
Old 11.12.2020, 16:50
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 69,605
Default

I've answered via mail. I won't find time today for chat but next week.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #10  
Old 11.12.2020, 21:13
timschumi timschumi is offline
Modem User
 
Join Date: Dec 2020
Posts: 3
Default

I have just updated the repository with a fix for Ninjastream and a (rather scrappy) implementation for skipping bytes in segmented downloads (thanks to Jiaz for the hint!). The latter one should probably be double-checked by someone, but as far as I can tell Ninjastream downloads work again.
Reply With Quote
  #11  
Old 14.12.2020, 09:26
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 69,605
Default

@timschumi: I will review and modify it a little bit. Thanks for the contribution
__________________
JD-Dev & Server-Admin
Reply With Quote
  #12  
Old 20.12.2020, 10:34
anet anet is offline
DSL User
 
Join Date: Oct 2019
Posts: 38
Default

When you pause or disconnect, the download restarts from the beginning.
Can't this problem be fixed?
Reply With Quote
  #13  
Old 21.12.2020, 08:07
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 69,605
Default

@anet: I'm working on segment resume support, yes
__________________
JD-Dev & Server-Admin
Reply With Quote
  #14  
Old 12.01.2021, 14:58
anet anet is offline
DSL User
 
Join Date: Oct 2019
Posts: 38
Default

Now I can download the whole file but when I go to watch the video I only see a first part while the rest is all on a black screen.
Reply With Quote
  #15  
Old 12.01.2021, 15:21
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 69,605
Default

can you provide example link? cannot reproduce any error
have you tested file downloaded in browser?
__________________
JD-Dev & Server-Admin

Last edited by Jiaz; 12.01.2021 at 15:46.
Reply With Quote
  #16  
Old 30.01.2021, 12:05
anet anet is offline
DSL User
 
Join Date: Oct 2019
Posts: 38
Default

If you pause or crash, the download starts all over again. Can this problem be solved?

Thanks in advance

EDIT: Ah sorry, I saw you already answered this

Last edited by anet; 31.01.2021 at 09:58.
Reply With Quote
  #17  
Old 31.01.2021, 10:01
anet anet is offline
DSL User
 
Join Date: Oct 2019
Posts: 38
Default

Jdownloader fails to connect to ninjastream and the download does not start

Goes out
"problems in the host?"
Reply With Quote
  #18  
Old 01.02.2021, 15:54
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 57,157
Default

Does the download via browser work fine?

Please post your log-ID here | bitte poste deine Log-ID hier.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #19  
Old 28.02.2021, 14:32
FreshDoktor FreshDoktor is offline
Modem User
 
Join Date: Feb 2021
Posts: 1
Default

Hey, i'v got the same Problem here. It does not start the download and only shows "Host problem", iam able to watch the stream on the webpage itself. Here my log-id 28.02.21 14.25.04 <--> 28.02.21 14.27.02 jdlog://2096725302851/
Reply With Quote
  #20  
Old 01.03.2021, 16:30
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 57,157
Default

Hi,
seems like ninjastream.to is possibly trying to block downloadmanager so it's unclear when/if we will fix this plugin.
However, you can use this download method as a workaround in the meantime.

I've created a ticket for this issue:


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 00:40.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2021, Jelsoft Enterprises Ltd.