JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 17.12.2023, 13:55
matrix61312 matrix61312 is offline
Junior Loader
 
Join Date: Jul 2019
Posts: 14
Default [Cloudflare] "Check Online Status" appears broken for Jumploads.com

For the host "Jumploads", the "Check Online Status" feature appears to be non-functional and the status just remains as "?" (I am using a multihoster that supports Jumploads.)


Example Online Link:
  • Large file: **External links are only visible to Support Staff****External links are only visible to Support Staff**
  • Small file: **External links are only visible to Support Staff****External links are only visible to Support Staff**


Example Offline Links:
  • Large file: **External links are only visible to Support Staff****External links are only visible to Support Staff**
  • Small file: **External links are only visible to Support Staff****External links are only visible to Support Staff**

Example Invalid Links:
  • **External links are only visible to Support Staff****External links are only visible to Support Staff**
  • **External links are only visible to Support Staff****External links are only visible to Support Staff**
  • **External links are only visible to Support Staff****External links are only visible to Support Staff**


Note: For the "Offline Links", I deleted the files shortly before posting, so it may take some time for the servers to update. However, from what I've seen, the error page for a deleted file is identical to that for an invalid link, so I also included a few invalid links as reference.

In my tests, I have found that simply curl-ing the webpage, and checking if the returned page source contains:
Code:
The file you are trying to download is no longer available
has been a rather reliable method for checking the link's On/Offline status.
This level of scraping did not seem to require any cookies, Cloudflare check, etc. and worked fine via the command-line.

Simply:
Code:
HTML="$(curl -s "$URL")"
if [[ "$HTML" == *'no longer available'* ]]; then
    echo "Link: '${URL}' is Offline"
fi
Seemed to work without issue.

Thanks

Last edited by matrix61312; 17.12.2023 at 14:00.
Reply With Quote
  #2  
Old 19.12.2023, 22:21
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 72,053
Default

Hi,
try to download those items to see the error-message behind that uncheckable status.

Most likely it is Cloudflare, see:
https://board.jdownloader.org/showthread.php?t=90107

Here it is also failing due to Cloudflare.

Uncheckable items should still be attempted via multihosters so just try it.
If your multihoster is able to handle it, a download in JD might work just fine.


English / Englisch
the issue you've reported has been caused by Cloudflare/DDos-Guard or similar.
Please read the first post of the above linked thread and post in this thread if you have further questions!
Please post related questions in the above linked thread only!
Attention: The first post of that linked thread contains useful information for you AND website-owners and also the hint that website-owners can solve this issue on their side which would also make our plugin work again!

Deutsch / German
Das von dir gemeldete Problem wurde durch Cloudflare, DDoS-Guard oder ähnliche Anbieter verursacht.
Bitte lies den ersten Post des oben verlinkten Threads.
Weitere Fragen bitte im oben verlinkten Thread posten!
Achtung: Im ersten Post ist u.a. beschrieben, dass auch Webseiten-Admins das Problem auf ihrer Seite lösen können --> Unser Plugin würde dann sofort wieder funktionieren - das bitte beachten, den ersten Post vollständig lesen und ggf. an den Support der betroffenen Webseite weiterleiten!

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 19.12.2023 at 22:32.
Reply With Quote
  #3  
Old 20.12.2023, 13:08
matrix61312 matrix61312 is offline
Junior Loader
 
Join Date: Jul 2019
Posts: 14
Default

Yeah, seems it was a cloudflare issue.

I did some re-checking and it seems that the reason `curl` worked was due to a particular proxy configuration (Privoxy to a VPN docker container) that my browser also uses, which put it on cloudflare's "nice" list. Set the connection rules to restrict jumpload to use that same proxy, and link checking works.

Thanks
Reply With Quote
  #4  
Old 20.12.2023, 13:17
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 72,053
Default

Thanks for your feedback.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 11:54.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.