#1
|
|||
|
|||
archive.org questions on authentication.
hi, all.
so, first, i did search. there were a lot of archive.org hits, but none answered my question. (that doesn't mean it isn't out there, it just means i cannot find it. so, there's two types of archive.org downloads (as far as i can tell): those freely available, and those requiring you to login first. i added about 2000 links of the second type (required login) from copying and pasting into the linkgrabber/clipboard watcher. as i was not logged in, it shows all of these as offline. is there way to add authentication after the fact? or will i need to start my process all over again? thanks a bunch. |
#2
|
||||
|
||||
Please provide some example links and account info to support@jdownloader.org so we can check/provide feedback/fix the plugin.
__________________
JD-Dev & Server-Admin |
#3
|
||||
|
||||
__________________
JD-Dev & Server-Admin |
#4
|
||||
|
||||
Waiting for logindata and example URLs ...
GreeZ pspzockerscene
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#5
|
||||
|
||||
Hi!
I have the same problem: for some resouces, I need to log in (otherwise, JD says "File not found"). Example link (login required for download rar files): **External links are only visible to Support Staff****External links are only visible to Support Staff** Log: 23.01.17 20.51.11 <--> 23.01.17 20.57.30 jdlog://6352179150841/ Login data sent to psp via PM. Thanks in advance! Last edited by theboss50; 23.01.2017 at 21:04. |
#6
|
|||
|
|||
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff** IF i • login to my jdownloader (with extension) • add archive.org credentials • copy a single link leading to archive.org multi-link page link grabber will successfully show all files online (any other way it will get the right file count, but show them all offline). however, when starting the download, it will fail on each file. |
#7
|
||||
|
||||
Thanks, I've updated ticket
__________________
JD-Dev & Server-Admin |
#8
|
||||
|
||||
Added account support.
--- [Please read]=>How/when do I get updates? Read it carefully BEFORE complaining that something would still be not working! Update cycles depend on your installed JD version!! --- [Bitte lesen]=>Wie/wann bekomme ich Updates? Bitte vollständig lesen bevor ihr euch beschwert, dass etwas immernoch nicht funktionieren würde! Die Updatezyklen variieren je nach installierter JD Version!! GreeZ pspzockerscene
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#9
|
|||
|
|||
should i re-add, my downloads or just refresh the existing ones?
|
#10
|
|||
|
|||
so, i re-added some brand new, fresh, multi-archive links from archive.org.
now, instead of failing, it gives me: "server error 403" am i doing something wrong? |
#11
|
||||
|
||||
1. You'll have to re-add them.
2. Of course you need to add your archive.org account to JDownloader to be able to download them. GreeZ psp
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#12
|
|||
|
|||
thanks!
so, i • deleted the download reference, • deleted the linkgrabber reference, • deleted credentials • readded credentials • re-copied link (all items showing online in linkgrabber) • test download one: "skipped - account is missing" |
#13
|
||||
|
||||
@massquantities
provide logs from session that failed https://support.jdownloader.org/Know...d-session-logs raztoki
__________________
raztoki @ jDownloader reporter/developer http://svn.jdownloader.org/users/170 Don't fight the system, use it to your advantage. :] |
#14
|
||||
|
||||
Please provide example links and username/password to support@jdownloader.org so we can check/fix it
__________________
JD-Dev & Server-Admin |
#15
|
|||
|
|||
hey, team,
@jiaz, i emailed that info just now. @raztoki, the link for logs did not work for me. |
#16
|
||||
|
||||
works fine for me, please test again with newest update. I've also answered to your email
__________________
JD-Dev & Server-Admin |
#17
|
|||
|
|||
hey, guys,
sorry i've been so slow on this. life got busy and, well, this slid down my priority list. ok, so, a few things: i'm logged in: http://imgur.com/a/g8Tuk and let's say i try the following links: **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** in link grabber, they look fine: http://imgur.com/a/m0lU2 but when you attempt to download them, it only grabs the xml's: http://imgur.com/a/agNFV am i doing something wrong? |
#18
|
||||
|
||||
so I see you're doing it wrong
don't use basic auth. basic auth was for websites that use protocol://user:pass@domain/path, they block you via 403 header without login. use the connection manager, as archive.org doesn't use basic auth, it uses cookies which require account login. raztoki
__________________
raztoki @ jDownloader reporter/developer http://svn.jdownloader.org/users/170 Don't fight the system, use it to your advantage. :] |
#19
|
||||
|
||||
You have to add the account in Settings-Account Manager
__________________
JD-Dev & Server-Admin |
#20
|
|||
|
|||
ahhhhhh…
that was it. i thought because it was a free (not premium) account, i had to use "basic." sorry! thanks so much for all the help. |
#21
|
||||
|
||||
Thanks for the feedback and you're welcome
__________________
JD-Dev & Server-Admin |
#22
|
|||
|
|||
hey, guys.
i'm back. latest version of jdownloader. say an archive.org post needs one to login, such as, **External links are only visible to Support Staff****External links are only visible to Support Staff** i login. can see everything just fine. add to jdownloader. it'll download for a bit, then stop. jdownloader will say "skipped. account is missing." (it's not.) i clicked one of the error icons, it prompted for an archive.org premium account . i followed the link, which looks like is just an account. i entered my creds. it checked. it took. it started downloading. then stops and repeats. (i also went back and added my creds to connections manager on top of account manager. i think i'm doing it right. i'm using https and port 443.) thanks for any help in advance. |
#23
|
||||
|
||||
Hi,
I'm unable to reproduce your issue. Please set max downloads- and chunks to 1 and check if that helps. If not, please post a log: Please post your log-ID here | bitte poste deine Log-ID hier. -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#24
|
|||
|
|||
[redacted.]
Last edited by massquantities; 26.02.2021 at 22:41. |
#25
|
|||
|
|||
the
max downloads: 1 chunks: 1 seemed to kind of work (so slow), but i had to baby the download (unskip, resume, rinse, repeat). that was on one that was over 1gb. on smaller ones, it continued to just fail with the "skipped - account is missing" error message. |
#26
|
||||
|
||||
Hi again,
according to your log, one or multiple items are not available even via account - maybe it is offline. Please always check items with errors via browser. In this case, this is what I got: I've improved the errorhandling for this case so "Account required" doesn't get displayed if this error happens while the user is logged in. Wartest du auf einen angekündigten Bugfix oder ein neues Feature? Updates werden nicht immer sofort bereitgestellt! Bitte lies unser Update FAQ! | Please read our Update FAQ! --- Are you waiting for recently announced changes to get released? Updates to not necessarily get released immediately! Bitte lies unser Update FAQ! | Please read our Update FAQ! -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#27
|
|||
|
|||
ok. thanks. i'll… try it again? (this might take a little more sleuthing on my end.)
|
#28
|
|||
|
|||
[redacted.]
still getting the "skipped account is missing error" (downloaded a the fresh update), on fresh (i also downloaded via browser) 1.1mb file. Last edited by massquantities; 26.02.2021 at 22:41. |
#29
|
||||
|
||||
Try again after the next update and add an account usage rule to disable free download (= disable download without account) for archive.org:
https://support.jdownloader.org/Know...-free-download -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#30
|
|||
|
|||
ok. i think i did that (disabling free-download/download-without-account):
"Connections problems." [redacted.] Last edited by massquantities; 02.03.2021 at 03:32. |
#31
|
||||
|
||||
Can you download the failing files via browser?
The ones of youg log are working fine here but maybe archive.org had temporary issues at that time. This issue is definitly not related to our software... -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#32
|
|||
|
|||
i am downloading from a browser just fine.
is it possible that by upping the chunks (i went back up to 20), this is causing the issue? |
#33
|
||||
|
||||
Yes - just play with it.
You do not need 20 chunks. E.g. 20 chunks + 20 simultan downloads --> 400 connections -> If everyone does this, archive.org will probably introduce tighter limits -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#34
|
|||
|
|||
i'm not doing simultaneous downloads (well, never on the same host).
is there a way to limit chunks on a per host basis? |
#35
|
||||
|
||||
this is not (yet) possible via setting. However you could do it via EventScripter script and set a property "CHUNKS" with the desired value on all archive.org items. -psp- Use a Packagizer Rule
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download Last edited by pspzockerscene; 02.03.2021 at 14:53. |
#36
|
|||
|
|||
Can also be set on per-host basis via packagizer rule.
|
#37
|
||||
|
||||
That's right - totally forgot about this...
-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#38
|
|||
|
|||
now getting a weird "temporarily unavailable" after going down to 1 chunk:
03.03.21 09.13.09 <--> 03.03.21 09.13.09 jdlog://2487725302851/ |
#39
|
||||
|
||||
Again please always check such issues via browser before asking us...
Your issue e.g. happened with this URL: archive.org/download/no-intro-rom-sets/CENSORED(20100224-080928).zip --> It is broken via browser too: Please contact the archive.org support and ask them to fix these items. -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#40
|
|||
|
|||
dah! sorry! i thought i had. sorry to bother you.
|
Thread Tools | |
Display Modes | |
|
|