JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 13.11.2024, 15:41
Weaz3L Weaz3L is offline
Junior Loader
 
Join Date: Nov 2024
Posts: 12
Default MetArt.com Network error "Directurl expired or media content is broken"

"Directurl expired or media content is broken"
Happened several days ago that MetArt.com and ALSScan.com downloads would fail with the above error. Issue lasted for 2-3 days and then things started working again. The error returned again today.

Happens on Video file and Zip file downloads only. Loose image download is successful with no issues. Looked at the relevant log files and really all I could understand was that there was a 403 error.

If I go to the individual page and grab the link manually JDownloader will successfully download it but I have to give it a name and download location myself.

Have logged out and then back in to the affected sites with no change in behaviour. No adblock on those 2 sites. MetArt and ALSScan plugins show no errors and Premium account status. Have also tried disabling the host plugins, restarting JDownloader and then re-enabling the plugins. Made no difference.

Probable Cause: Met seems to be including Recaptcha tokens in download urls at least on an occasional basis. JDownloader is likely discarding that extra info from the Url which causes it to fail with a 403.

Sample Urls:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
direct url: **External links are only visible to Support Staff****External links are only visible to Support Staff**

**External links are only visible to Support Staff****External links are only visible to Support Staff**
Direct Url: **External links are only visible to Support Staff****External links are only visible to Support Staff**

Log ID: 13.11.24 06.07.37 <--> 13.11.24 06.19.49 jdlog://1276411370661/

Hopefully the sample Urls and log will be enough for you. I can provide my login for the sites if needed.

Thanks for your time!
Reply With Quote
  #2  
Old 13.11.2024, 17:12
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 73,499
Default

Quoting your logs:
Code:
{"error":"ReCaptcha token was not provided!"}
--> Looks like the website now rquires a captcha to download.
Because a (premium?) account is required to download from this website, I need your login credentials to work on this.
Send me your login credentials via PN then I will look into this problem.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #3  
Old 13.11.2024, 17:19
Weaz3L Weaz3L is offline
Junior Loader
 
Join Date: Nov 2024
Posts: 12
Default

Quote:
Originally Posted by pspzockerscene View Post
Quoting your logs:
Code:
{"error":"ReCaptcha token was not provided!"}
--> Looks like the website now rquires a captcha to download.
Because a (premium?) account is required to download from this website, I need your login credentials to work on this.
Send me your login credentials via PN then I will look into this problem.
Yes ReCaptcha token but possibly only sometimes. There is no captcha to fill out, just a token. The token is found in the directurl. I'm bad at logs but it looks like the token is discarded during the linkgrabbing. Will send my login info right away.
Reply With Quote
  #4  
Old 13.11.2024, 18:16
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 73,499
Default

Quote:
Originally Posted by Weaz3L View Post
Yes ReCaptcha token but possibly only sometimes.
Nope, always.
You just can't always see it since it is a "reCaptchaInvisible".
More information:
https://support.jdownloader.org/de/k...splay-captchas

You can also check this yourself: Open any metart.com download page or even just the main page -> View html code -> Search for "enableReCaptchaDownload" and "googleReCaptchaEnterprise" or take a look at your browsers' http traffic when clicking on any download button.
Each click on a download button triggers another invisible reCaptcha challenge.

This problem will be fixed with the next CORE-update.

metart plugin internal changelog:
- display detailed error from WebAPI in JD GUI
- login: fixed expire date detection
- download: implemented reCaptcha invisible enterprise aka "googleReCaptchaEnterprise"
- added detection of lifetime premium accounts

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #5  
Old 13.11.2024, 18:35
Weaz3L Weaz3L is offline
Junior Loader
 
Join Date: Nov 2024
Posts: 12
Default

Quote:
Originally Posted by pspzockerscene View Post
Nope, always.
You just can't always see it since it is a "reCaptchaInvisible".
...

This problem will be fixed with the next CORE-update.

metart plugin internal changelog:
- display detailed error from WebAPI in JD GUI
- login: fixed expire date detection
- download: implemented reCaptcha invisible enterprise aka "googleReCaptchaEnterprise"
- added detection of lifetime premium accounts
...
-psp-
Thank you very much for the fix!

The reason I said "possibly only sometimes" is because I was getting the same error a week past but after 2 or 3 days it returned to normal. I couldn't check if it was exactly the same error because the logs from then expired and were no longer in the folder.

Hopefully they don't change things again
Reply With Quote
  #6  
Old 13.11.2024, 18:41
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 73,499
Default

Quote:
Originally Posted by Weaz3L View Post
The reason I said "possibly only sometimes" is because I was getting the same error a week past but after 2 or 3 days it returned to normal.
Hm yeah maybe they turned the captcha on/off.
The captcha is mostly really invisible to the user so without looking into the html code or console requests, you can't really know it exists.

I will let you know in this thread once the update is out.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #7  
Old 15.11.2024, 16:47
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 73,499
Default

CORE-Updates have been released!
All announced bugfixes and features are live!
Please update your JDownloader and report any issues you find asap.
If this thread gets marked as "[Solved]" by our forum staff you can still post in it and we will read- and reply to it!

CORE-Updates wurden released!
Alle angekündigten Bugfixes/Features sind nun verfügbar!
Bitte JDownloader updaten und eventuelle Bugs schnellstmöglich an uns melden.
Falls dieser Thread vom Team als "[Erledigt]" markiert wird, kannst du weiterhin darin antworten und wir lesen/beantworten auch solche Threads!

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #8  
Old 15.11.2024, 18:04
Weaz3L Weaz3L is offline
Junior Loader
 
Join Date: Nov 2024
Posts: 12
Default

Quote:
Originally Posted by pspzockerscene View Post
CORE-Updates have been released!
All announced bugfixes and features are live!
-psp-
Thank you for the fix!

Downloads are working on both MetArt.com and ALSScan.com

Not your fault but the captcha popup for every single download is stupid and makes it very irritating to do more than a couple downloads.

I thought it was a simple matter of grabbing the ReCaptcha token from the url but I guess that the site doesn't generate a token without the page being accessed? It's smooth and seamless in the browser but very irritating in a download manager. As far as I can tell they don't even make download links visible if you aren't logged in, so the only ones that the ReCaptcha gets used for are logged in users. They could have just put a captcha on the login page if they wanted added security or whatever.

I don't know what problem they think this foolishness is going to solve, but I'm honestly thinking of cancelling LOL

Anyway, Thanks Again for the fix.
Reply With Quote
  #9  
Old 15.11.2024, 18:15
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 73,499
Default

Quote:
Originally Posted by Weaz3L View Post
but the captcha popup for every single download is stupid
Contact the support of metart.com.
As a paying premium user, there should not be any need for you to go through that security measure.

Side note:
If google thinks you are a bot (e.g. if you use a public VPN), those invisible captchas will visually turn into "normal reCaptchaV2" challenges so while you don't see them in your browser at this moment, you can be quite sure that other users see them!

Quote:
Originally Posted by Weaz3L View Post
I guess that the site doesn't generate a token without the page being accessed?
How do you mean that?
The captcha needs to be solved somewhere.
It cannot be solved in an invisible way via JD as explained here.
You can use [paid] services like 2captcha.com in JDownloader that automatically solve such captchas.

Quote:
Originally Posted by Weaz3L View Post
It's smooth and seamless in the browser but very irritating in a download manager.
They might have done this on purpose. Only the admins of metart.com can know this

Quote:
Originally Posted by Weaz3L View Post
They could have just put a captcha on the login page if they wanted added security or whatever.
Exactly. So go tell them

Quote:
Originally Posted by Weaz3L View Post
Anyway, Thanks Again for the fix.
Thanks for your feedback
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #10  
Old 15.11.2024, 18:22
Weaz3L Weaz3L is offline
Junior Loader
 
Join Date: Nov 2024
Posts: 12
Default

Quote:
Originally Posted by pspzockerscene View Post
Contact the support of metart.com.
As a paying premium user, there should not be any need for you to go through that security measure.
...

They might have done this on purpose. Only the admins of metart.com can know this
...

So go tell them
I actually did make a ticket just now. They might even listen ¯\_(ツ)_/¯
Reply With Quote
  #11  
Old 15.11.2024, 18:26
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 73,499
Default

Let me know if they change anything.
I did implement ther captcha in an optional way but depending on how they may change their website, the plugin could end up asking you for a captcha even when it is not needed anymore.

Their frontend is already designed to be able to turn the captcha off.
Search for "enableReCaptchaDownload" in their html code.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #12  
Old 15.11.2024, 18:31
Weaz3L Weaz3L is offline
Junior Loader
 
Join Date: Nov 2024
Posts: 12
Thumbs up

Quote:
Originally Posted by pspzockerscene View Post
Let me know if they change anything.
I did implement ther captcha in an optional way but depending on how they may change their website, the plugin could end up asking you for a captcha even when it is not needed anymore.

Their frontend is already designed to be able to turn the captcha off.
Search for "enableReCaptchaDownload" in their html code.
Will do. Thanks!
Reply With Quote
  #13  
Old 19.11.2024, 18:40
Weaz3L Weaz3L is offline
Junior Loader
 
Join Date: Nov 2024
Posts: 12
Default

Just an update: The reply to my support complaint was the usual "We'll pass that on". BUT...
As of today ReCaptcha is removed from the sites again. It was still in place yesterday.

Did not seem to be any problems with getting a successful download so no issues to report.

Thanks again!
Reply With Quote
  #14  
Old 19.11.2024, 18:46
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 73,499
Default

Quoting their HTML code:
Code:
"enableReCaptchaDownload":false
-> They've indeed turned off that captcha.

Good job!
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 19:50.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.