JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 26.03.2023, 23:41
mjolnir870 mjolnir870 is offline
Fibre Channel User
 
Join Date: Oct 2012
Posts: 123
Default [FileJoker.net] Files marked offline in download list

Files are sometimes being marked offline in the download list when a download is attempted, even though they are online. I'm using a few proxies if that matters.

26.03.23 16.33.03 <--> 26.03.23 16.39.37 jdlog://1334311370661/
Reply With Quote
  #2  
Old 27.03.2023, 12:49
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 72,028
Default

Hi,
I'm sorry but this is clearly a user-mistake.
Some of your used proxys are broken and return the following HTML code instead of the expected one:
Code:
<html>
<head><title>404 Not Found</title></head>
<body>
<center><h1>404 Not Found</h1></center>
<hr><center>nginx/1.18.0</center>
</body>
</html>
Now the filejoker plugin is also checking for response code 404 to determine the files' online status so your proxy leads to the failure.

Solution:
Use working proxys / check them on your own in beforehand.

I strongly advise against using free proxy lists as that can cause a lot of other troubles.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #3  
Old 28.03.2023, 03:06
mjolnir870 mjolnir870 is offline
Fibre Channel User
 
Join Date: Oct 2012
Posts: 123
Default

I am not using free proxy lists; I'm using a paid VPN and using a docker container as a proxy. Below log is for every connection disabled except for one proxy. At first it returns 404, and when I check in a browser using that proxy it is also a 404. When I force the docker container to get a new IP, it finally connects on the 3rd try. I think FileJoker is blacklisting some IPs and returning 404s? So there's nothing jDownloader can do for this, but thank you for giving me the idea to check this way.

27.03.23 19.56.00 <--> 27.03.23 19.59.49 jdlog://1634311370661/

EDIT: After checking in the browser, I did notice that for these blacklisted IPs, even the homepage "**External links are only visible to Support Staff** returns a 404. Maybe jDownloader can check for that if it gets a 404 for the download link, and if so it can mark the link with a connection error and try a different proxy instead of marking the link as offline?

Last edited by mjolnir870; 28.03.2023 at 03:09.
Reply With Quote
  #4  
Old 28.03.2023, 12:54
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 72,028
Default

Quote:
Originally Posted by mjolnir870 View Post
So there's nothing jDownloader can do for this, but thank you for giving me the idea to check this way.
Well at least it's not planned to add any official checks for this.
In this case filejoker is not using 404 for offline files so I will be adding itv to the normale errorhandling as errormessage "VPN blocked".
You can then use EventScripter scripts to trigger a VPN-switch on that error.
Please check if it works in a better way for you after the release of our next set of CORE-updates.

Quote:
Originally Posted by mjolnir870 View Post
Maybe jDownloader can check for that if it gets a 404 for the download link, and if so it can mark the link with a connection error and try a different proxy instead of marking the link as offline?
We're open source so I recommend building a custom solution for this or handling this on another level e.g. in the proxy application itself (switch proxy if filejoker is returning 404 before passing traffic to JD).
JDownloader source code:
https://support.jdownloader.org/Know...up-ide-eclipse

For all code changes mentioned in this post, the following information applies:

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 28.03.2023 at 13:03. Reason: Added information about EventScripter
Reply With Quote
  #5  
Old 29.03.2023, 09:00
mjolnir870 mjolnir870 is offline
Fibre Channel User
 
Join Date: Oct 2012
Posts: 123
Default

I ended up adding a check for this on the vpn docker container.
Reply With Quote
  #6  
Old 29.03.2023, 10:41
notice notice is offline
JD Supporter
 
Join Date: Mar 2023
Posts: 505
Default

@mjolnir870: maybe wanna share some details about this check?
Reply With Quote
  #7  
Old 29.03.2023, 11:01
mjolnir870 mjolnir870 is offline
Fibre Channel User
 
Join Date: Oct 2012
Posts: 123
Default

Quote:
Originally Posted by notice View Post
@mjolnir870: maybe wanna share some details about this check?
I'm using a gluetun docker container and a docker-compose file. I added the below to the gluetun config:

Code:
    labels:
      - "deunhealth.restart.on.unhealthy=true"
    healthcheck:
      test: wget -q --spider filejoker.net
      start_period: 25s
and then I added this container:

Code:
  deunhealth:
    image: qmcgaw/deunhealth:latest
    container_name: deunhealth
    restart: unless-stopped
    volumes:
      - /var/run/docker.sock:/var/run/docker.sock
The healthcheck on the gluetun container uses wget on filejoker 25s after the container starts, and retries 3 times before classifying the container as unhealthy. The deunhealth container watches any container with a "deunhealth.restart.on.unhealthy=true" label and restarts it if it's unhealthy.
Reply With Quote
  #8  
Old 29.03.2023, 16:39
notice notice is offline
JD Supporter
 
Join Date: Mar 2023
Posts: 505
Default

@mjolnir870: Thanks for the feedback and sharing your solution! I guess test fails because wget returns error for 404 site nice and simple solution
just out of interest, is it possible to define multiple tests?
Reply With Quote
  #9  
Old 30.03.2023, 23:22
mjolnir870 mjolnir870 is offline
Fibre Channel User
 
Join Date: Oct 2012
Posts: 123
Default

you can write the test line like this:
Code:
      test: wget -q --spider filejoker.net && OTHER COMMAND HERE
and that will require the second command to also be successful.

If you just want to test multiple sites then you can pass multiple domains to wget like this and it will return a failure if any of them are unreachable:
Code:
      test: wget -q --spider filejoker.net google.com wikipedia.org
Reply With Quote
  #10  
Old 05.04.2023, 16:25
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 72,028
Default

CORE-Updates have been released!
All announced bugfixes and features are live!
Please update your JDownloader and report any issues you find asap.
If this thread gets marked as "[Solved]" by our forum staff you can still post in it and we will read- and reply to it!

CORE-Updates wurden released!
Alle angekündigten Bugfixes/Features sind nun verfügbar!
Bitte JDownloader updaten und eventuelle Bugs schnellstmöglich an uns melden.
Falls dieser Thread vom Team als "[Erledigt]" markiert wird, kannst du weiterhin darin antworten und wir lesen/beantworten auch solche Threads!

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #11  
Old 05.04.2023, 16:44
notice notice is offline
JD Supporter
 
Join Date: Mar 2023
Posts: 505
Default

@mjolnir870: Thanks for the explanation how to test multiple sites
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 17:37.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.