[Tyler]

Jdownloader won't download from this site, keeps saying the link is not found.

here's an example link with user/pass in it.

**External links are only visible to Support Staff****External links are only visible to Support Staff**

even when i start the download in firefox and use flashgot to send it to jdownloader it still says offline.

[raztoki]

jd basic auth, uses base64 encoding, they want some other form of auth within the header response. Jiaz will need to add support

WWW-Authenticate: Digest realm="name", nonce="a=b", algorithm=MD5, qop="auth"

raztoki

[Jiaz]

Will add support for it. Can you provide some more example links to support@jdownloader.org ?

[Tyler]

well i can't guarantee that a link will stay alive since i'm not the only user

here's the download directory though, you can pick links from there

**External links are only visible to Support Staff****External links are only visible to Support Staff**

[Tyler]

any progress on this?

[raztoki]

Nope
Im sure Jiaz will do it, he likes challenges ;p

[Jiaz]

Just short feedback, 50% of work done

[Jiaz]

Tomorrow I will release update to finally support Digest method, then you'll be able to download those links

[Tyler]

alright thanks

[Jiaz]

Update is on the way Feedback would be nice

[Tyler]

tested a file and it seems to be working.

i'll test it more tomorrow.

[augur]

And I think whatever you changed just broke Basic Authentication for a site I download from. It was working yesterday and post update today it isn't, just listing a bunch of files (favicon and other icons) almost as if i'm not logged into the site.

[Jiaz]

Can you please provide a logfile? https://support.jdownloader.org/Know...d-session-logs
and post the shown logID here

Optional you can send logins and links to support@jdownloader.org
I will fix asap

[augur]

I'll be happy to but I'm waiting on a response from the admin for the site to see what he's OK with me providing. T&Cs say I'd very probably get banned if I don't get the all clear first.

[Jiaz]

I don't need logins or need to login. Logfile would be enough that shows why it fails.
You can also send me link without logins to support@jdownloader.org
Just need to find out what is different because my basic auth tests were all successfull.
But I can also wait for you getting an answer first

[augur]

Just got authorisation and he even created a test file.
Here's the log for that file.

23.07.17 02.35.56 <--> 23.07.17 02.38.23 jdlog://4817114015941/

I'll pm/email you the link

First attempt is add whole link - this has never worked.
Second attempt is delete filename just send path - this used to work.
Third attempt is send link from firefox browser using FlashGot addon, this currently works.

[raztoki]

@augur
provided logs are clean, no activity of downloads within

raztoki

[augur]

That's the problem, after the update on the 21st the links won't add to JDownloader 2 so they can't be downloaded.
I sent Jiaz the actual link I used so he can see/try himself.

If I can add links again then I can download them.

[raztoki]

the only change was authentication components
if links do not add, its could be regular expression issue.. Nothing has changed in that respect though, just basic auth.

simplified flow diagram
1) regular expressions patterns we listen for (hoster plugins) -> requestFileInfo(hoster plugin) -> link adds as online/offline(shows up linkgrabber gui)

2) regular expressions patterns we listen for (decrypter plugins) -> decryptIt(decrypter plugin) -> one or many links add. -> could be passed back into hoster plugin or marked as directly online/offline by decrypter plugin.

3) when no patterns exist for site, deep analyse can be called or triggered(by you). This will open GET connection to given URL. if the url redirects to data it will add as directhttp link and directhttp plugin will pick it it. If its html it will be parsed, and results will be returned. results are then analysed by core and passed into respective hoster/decrypter plugins 2 or 3.

raztoki

[augur]

And yet the recent update (on the 21st at about 1800 CET) now stops me (and several other users of the site too) adding links.

And before you ask if it could be the server that might have changed I loaded up an alternate/backup older install of JDownloader 2 with a build date of Mon Apr 10 03:03:24 CEST 2017
Core: #36509
Launcher: #3800
AppWork Utilities: #2867
Browser: #36508
Updater: #565

And I can still add links to that.

Something was changed in JD2 and was pushed out as an update on the 21st at about 1800.

Hopefully Jiaz can figure out what happened.

[Jiaz]

How did you add those links?!
JDownloader never had support for this host

I guess you logged into account in browser and then copied final url?

[Jiaz]

I've just released another update, wait 5 mins, then hit update button
If that still does not work, then please send me the link you are trying to add to JDownloader

[Jiaz]

The provided link doesnt work in browser (redirected to main page) nor can I upload any files. It seems the site only works with an account?

[raztoki]

ezfiles is yetishare like Jiaz has indicated never been supported
I don't believe yetishare works over basic auth, its cookie based login system.

only time it would have worked is generated links (finallinks) that you generate yourself on the webui and you copy url and JD picks up via directhttp plugin regular expression pattern (based on supported file extensions). Or via browser extension (you mentioned flashgot earlier).

raztoki

[augur]

Update didn't fix it.

You definitely need an account to access the site.
The link I was provided with is a 417MB video and I just downloaded it with my account details using Free Download Manager. I can add the link irrespective of if my account details are saved in FDM, if they aren't saved then I get a connection refused error.

If I add that link to JD2 it is listed as offline - always has been.
If I add the path but remove the "Test-File.mkv" filename it was added to the LinkGrabber page with the filename. Now I get a bunch of png icons.


One thing I have just found out is that if I add the file to fdm then query the filesize the url gets a download token which I can then copy and past into JD2.
e.g.
can't be added
**External links are only visible to Support Staff** can be added and I was able to download whilst my Basic Authentication was disabled.
**External links are only visible to Support Staff** the token is autogenerated and expires after about a day.
So it seems an account is necessary to get a token for a file but not for the actual download.

Would an account be necessary to figure this out, if so I can contact the admin and set the wheels in motion to see if I can get a temp account for you.

[raztoki]

since the domain isn't listened to by dedicated plugins, generics like DirectHTTP plugin picks it up due to the filename extension within url, https?://.+\.mkv.

linkchecking(filename, filesize, online|offline status) will fail due to it not been direct downloadable (Without you generating the link yourself).

yes account will be required for yetishare, as far as we are aware it's a cookie based platform.

raztoki

[Jiaz]

JDownloader showing link as offline -> that would help
go to Settings-Advanced Settings - search for debug and enable log debug
restart JDownloader and add link again, after error/offline, create log and post logID

At the moment I don't know how/where basic auth should take place when you add urls without userinfo available in url.
So either
-provide a debug logfile
-ask admin to create test account and provide example links
-send us your login and we will test/fix shortly

[augur]

Originally Posted by raztoki

ezfiles is yetishare like Jiaz has indicated never been supported
I don't believe yetishare works over basic auth, its cookie based login system.

**External links are only visible to Support Staff****External links are only visible to Support Staff**

Built in support for all major download managers which support http authentication.

Originally Posted by raztoki

only time it would have worked is generated links (finallinks) that you generate yourself on the webui and you copy url and JD picks up via directhttp plugin regular expression pattern (based on supported file extensions). Or via browser extension (you mentioned flashgot earlier).

raztoki

Used to work if I pasted just the path
e.g.
doesn't get added
**External links are only visible to Support Staff****External links are only visible to Support Staff**

did get added and the filename is populated.
**External links are only visible to Support Staff****External links are only visible to Support Staff**


Following the update I can download using finallinks sent from flashgot but until yesterday I never needed to.

[augur]

Here's the debug logfile.

23.07.17 08.56.37 <--> 23.07.17 08.57.15 jdlog://3237114015941/

[raztoki]

there you go, they claim they do. Live and learn =]
Our dedicated plugin template doesn't though.
not sure how basic auth will work with password protected files

[augur]

Well I've been hitting the limit of my knowledge for a while. I can say what but not why. I've got to disappear until late afternoon, but if I get a chance I'll check back before.


Would a debug log of the my JD install where I can add an ezfiles link be of any use along with a debug log of trying to do exactly the same in the up to date JD2 install?

[Jiaz]

The logfile shows that you add a link which is redirected to the register site and that fails.
How do you add it? Copy to Clipboard or Flashgot?

Yes, a debug log where it works would help a lot, because the log does not show single sign of basic auth, nor any hint how it would work at all, because JDownloader doesnt support the host and the link doesnt contain any basic auth, nor is it any download url.

So, please provide a debug log of working one, thanks!

[augur]

What I always do is paste the path link from clipboard


It worked the same if I used the Analyse Text with Links and also if I chose Normal Link Analyse or Deep Link Analyse

old version working

23.07.17 18.45.28 <--> 23.07.17 18.45.50 jdlog://1187114015941/

new version not working

23.07.17 18.47.06 <--> 23.07.17 18.47.33 jdlog://6187114015941/

[Jiaz]

Log shows that it is no issue with basic auth.

log shows that in old version you add this link
ezfiles.net/xyxyxyx/Test-File.mkv?download_token=xyxyxy

this link works perfectly fine in new version as well.

and in log from new version you add something complete different but NOT the same link.
So there is something different in how you add the links.

Only the urls with download_token will work in JDownloader as long as there is no plugin support for this host yet

[augur]

Except I'm doing exactly the same thing in both versions.

In the old version I am definitely pasting
**External links are only visible to Support Staff****External links are only visible to Support Staff**

If I use File>Analyse Text with Links and it pulls the link from the clipboard it was/is exactly the same link pulled in both versions.

To double double check I manually typed the path link in the File>Analyse Text with Links window and clicked on Continue. I get the crawling for downloads popup and then different results i.e. works in the old version, not in the new.

Do you have an older install (1 week or more) on your computer you could try this out on so you can see it's not me (and I'm really, truly, not crazy)


I had a look at the activity list for the last few days and out of all the changes this popped out at me as about the right time and is the only feature Closed that isn't for a hoster plus it has the word httpconnection in it which drew my notice.

Feature #7822 DevsOnly: add digest support for httpconnection
https://svn.jdownloader.org/issues/7822#change-691499

It is true, the Basic HTTP Authentication is broken in the original yetishare code, but it has been fixed and working fine on ezfiles.net

Everything was working before the JDBrowser revision #37363. As a test, I switched JDBrowser back to revision #37243 and JDownloader to revision #37356 in Eclipse, then I added the test ezfiles download link via "Analyse and Add Links", and it worked as it should. See below HTTP headers captured on the ezfiles.net server, source IP, the user name and clear text password are masked.

The fields are separated by comma, and they are:

Btw, I don't see any reference to basic http authentication in the Eclipse's Console with debug mode on. I would be glad to provide any info that could help to resolve this issue.

[augur]

I just had a play around with wget and I was able to get it to download the test file with the following arguments
wget --http-user=USER --http-password=PASSWORD --auth-no-challenge **External links are only visible to Support Staff**...

Of note when I tried it without the --auth-no-challenge it didn't work, it downloaded an 85KB index.html

--auth-no-challenge Send Basic HTTP authentication information without first waiting for the server's challenge.

When I opened the index.html it had several links to the various png icons that I am getting in the up to date JD2 so could it have something to do with no longer pre-emptively sending authentication.

[augur]

The admin just surprised me by creating a plugin for ezfiles - talented bloke.

**External links are only visible to Support Staff****External links are only visible to Support Staff**


So how does one get this plugin added?
**External links are only visible to Support Staff**EZFiles.java.zip
:whistling:

[raztoki]

Originally Posted by augur

I just had a play around with wget and I was able to get it to download the test file with the following arguments
wget --http-user=USER --http-password=PASSWORD --auth-no-challenge **External links are only visible to Support Staff**...

Of note when I tried it without the --auth-no-challenge it didn't work, it downloaded an 85KB index.html



When I opened the index.html it had several links to the various png icons that I am getting in the up to date JD2 so could it have something to do with no longer pre-emptively sending authentication.

That was my thoughts the other day
I haven't had time to check the source but that's where I was going to start.

[raztoki]

Originally Posted by augur

The admin just surprised me by creating a plugin for ezfiles - talented bloke.

**External links are only visible to Support Staff****External links are only visible to Support Staff**


So how does one get this plugin added?
**External links are only visible to Support Staff**EZFiles.java.zip
:whistling:

not hard when you use an existing template ;p