JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 28.04.2023, 18:09
Crowley Crowley is offline
Baby Loader
 
Join Date: Feb 2016
Posts: 6
Default Cloudflare video download fails because URL gets changed

I have a signed cloudflare URL like this:
Code:
**External links are only visible to Support Staff**
Using this URL in the browser or via curl works fine.
However putting this URL in jdownloader shows the file as offline.

Steps to reproduce:
  • copy the URL
  • The file shows up in LinkGrabber as offline
  • right click on the file and "Change url". There is now a different URL like this:
    Code:
    **External links are only visible to Support Staff**
    
  • paste the original URL in there
  • The file shows now as online, and can be downloaded

Is there any way to prevent the URL from getting changed? Especially if I want to add the URL as a Folder Watch crawljob?
Reply With Quote
  #2  
Old 28.04.2023, 18:33
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 72,746
Default

I'm sorry but without real life example URLs and/or logs we can't check this.

Please also keep in mind that there is a long weekend in germany no (monday = holiday) so out next answer may not be here before next tuesday.

However what I think could be the problem:
- JD is using a User-Agent which is blocked by either that website or Cloudflare
- A special Referer is needed to access that URL

Please provide example URLs and a log.

Please post your log-ID here | bitte poste deine Log-ID hier.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #3  
Old 28.04.2023, 20:48
Crowley Crowley is offline
Baby Loader
 
Join Date: Feb 2016
Posts: 6
Default

Here is an actual example URL. Warning: The content is NSFW.
Code:
**External links are only visible to Support Staff**
I don't think it is the User Agent or the Referrer, since the download works fine using curl. In fact it works fine in Jdownloader, once I replace the mangled URL with the original one.

Edit: This is my log id: jdlog://6105311370661

Last edited by Crowley; 28.04.2023 at 20:53.
Reply With Quote
  #4  
Old 03.05.2023, 00:18
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 72,746
Default

Hi again,
your URL doesn't work for me.
Where is that URL coming from?
Can you provide the source-URL as well?

Also your log doesn't contain any download- or linkcheck activity.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #5  
Old 03.05.2023, 10:15
Crowley Crowley is offline
Baby Loader
 
Join Date: Feb 2016
Posts: 6
Default

The URL above might be expired. Here is a current one:
Code:
**External links are only visible to Support Staff**
I'm afraid the source URL is behind a login.

The log above was created by restarting my headless jdownloader on my NAS and feeding it the URL as a FolderWatch crawljob. The Job appeared as an offline file in LinkGrabber before I uploaded the log.

Here is another log which I created on the GUI client by copying the URL above:
03.05.23 10.05.09 <--> 03.05.23 10.09.17 jdlog://5115311370661/
Reply With Quote
  #6  
Old 03.05.2023, 10:58
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 72,746
Default

Hm I'm not sure if this one is a parser bug or if that behavior is correct.
Either way, you can make this link work by adding "directhttp//" in front of it (yes exactly like that, so that it will contain two times "http:..").
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #7  
Old 03.05.2023, 12:34
Crowley Crowley is offline
Baby Loader
 
Join Date: Feb 2016
Posts: 6
Default

It was in fact "directhttp ://" (minus the space) which I had to prepend, but yeah, that worked.
Thank you very much.
Reply With Quote
  #8  
Old 03.05.2023, 12:38
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 72,746
Default

As explained another team-member will look into it and check if there is a possible parser issue because the "?download=1*" indeed looks strange to me.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 01:08.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.