JDownloader Community - Appwork GmbH
 

Notices

Reply
 
Thread Tools Display Modes
  #1  
Old 18.01.2017, 02:20
massquantities massquantities is offline
JD Alpha
 
Join Date: Jan 2017
Posts: 20
Default archive.org questions on authentication.

hi, all.

so, first, i did search. there were a lot of archive.org hits, but none answered my question. (that doesn't mean it isn't out there, it just means i cannot find it.

so, there's two types of archive.org downloads (as far as i can tell): those freely available, and those requiring you to login first.

i added about 2000 links of the second type (required login) from copying and pasting into the linkgrabber/clipboard watcher. as i was not logged in, it shows all of these as offline.

is there way to add authentication after the fact? or will i need to start my process all over again?

thanks a bunch.
Reply With Quote
  #2  
Old 18.01.2017, 11:44
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

Please provide some example links and account info to support@jdownloader.org so we can check/provide feedback/fix the plugin.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #3  
Old 18.01.2017, 11:44
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

__________________
JD-Dev & Server-Admin
Reply With Quote
  #4  
Old 23.01.2017, 19:54
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Waiting for logindata and example URLs ...

GreeZ pspzockerscene
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #5  
Old 23.01.2017, 21:58
theboss50's Avatar
theboss50 theboss50 is offline
JD VIP
 
Join Date: Sep 2014
Posts: 325
Default

Hi!

I have the same problem: for some resouces, I need to log in (otherwise, JD says "File not found").

Example link (login required for download rar files):
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Log:
23.01.17 20.51.11 <--> 23.01.17 20.57.30 jdlog://6352179150841/

Login data sent to psp via PM.

Thanks in advance!

Last edited by theboss50; 23.01.2017 at 22:04.
Reply With Quote
  #6  
Old 24.01.2017, 07:02
massquantities massquantities is offline
JD Alpha
 
Join Date: Jan 2017
Posts: 20
Default

**External links are only visible to Support Staff****External links are only visible to Support Staff**

**External links are only visible to Support Staff****External links are only visible to Support Staff**

IF i
• login to my jdownloader (with extension)
• add archive.org credentials
• copy a single link leading to archive.org multi-link page
link grabber will successfully show all files online (any other way it will get the right file count, but show them all offline).

however, when starting the download, it will fail on each file.
Reply With Quote
  #7  
Old 24.01.2017, 10:36
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

Thanks, I've updated ticket
__________________
JD-Dev & Server-Admin
Reply With Quote
  #8  
Old 25.01.2017, 14:52
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Added account support.
---
[Please read]=>How/when do I get updates?
Read it carefully BEFORE complaining that something would still be not working!
Update cycles depend on your installed JD version!!

---
[Bitte lesen]=>Wie/wann bekomme ich Updates?
Bitte vollständig lesen bevor ihr euch beschwert, dass etwas immernoch nicht funktionieren würde!
Die Updatezyklen variieren je nach installierter JD Version!!


GreeZ pspzockerscene
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #9  
Old 25.01.2017, 22:54
massquantities massquantities is offline
JD Alpha
 
Join Date: Jan 2017
Posts: 20
Default

should i re-add, my downloads or just refresh the existing ones?
Reply With Quote
  #10  
Old 26.01.2017, 02:36
massquantities massquantities is offline
JD Alpha
 
Join Date: Jan 2017
Posts: 20
Default

so, i re-added some brand new, fresh, multi-archive links from archive.org.

now, instead of failing, it gives me:

"server error 403"

am i doing something wrong?
Reply With Quote
  #11  
Old 26.01.2017, 12:07
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

1. You'll have to re-add them.
2. Of course you need to add your archive.org account to JDownloader to be able to download them.

GreeZ psp
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #12  
Old 26.01.2017, 20:59
massquantities massquantities is offline
JD Alpha
 
Join Date: Jan 2017
Posts: 20
Default

thanks!

so, i
• deleted the download reference,
• deleted the linkgrabber reference,
• deleted credentials
• readded credentials
• re-copied link (all items showing online in linkgrabber)
• test download one:

"skipped - account is missing"
Reply With Quote
  #13  
Old 27.01.2017, 00:09
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,611
Default

@massquantities

provide logs from session that failed https://support.jdownloader.org/Know...d-session-logs

raztoki
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #14  
Old 27.01.2017, 11:34
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

Please provide example links and username/password to support@jdownloader.org so we can check/fix it
__________________
JD-Dev & Server-Admin
Reply With Quote
  #15  
Old 22.02.2017, 20:02
massquantities massquantities is offline
JD Alpha
 
Join Date: Jan 2017
Posts: 20
Default

hey, team,

@jiaz, i emailed that info just now.

@raztoki, the link for logs did not work for me.
Reply With Quote
  #16  
Old 23.02.2017, 09:39
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

works fine for me, please test again with newest update. I've also answered to your email
__________________
JD-Dev & Server-Admin
Reply With Quote
  #17  
Old 05.07.2017, 04:40
massquantities massquantities is offline
JD Alpha
 
Join Date: Jan 2017
Posts: 20
Default

hey, guys,

sorry i've been so slow on this. life got busy and, well, this slid down my priority list.

ok, so, a few things:

i'm logged in:

http://imgur.com/a/g8Tuk

and let's say i try the following links:

**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

in link grabber, they look fine:

http://imgur.com/a/m0lU2

but when you attempt to download them, it only grabs the xml's:

http://imgur.com/a/agNFV

am i doing something wrong?
Reply With Quote
  #18  
Old 05.07.2017, 05:18
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,611
Default

so I see you're doing it wrong

don't use basic auth. basic auth was for websites that use protocol://user:pass@domain/path, they block you via 403 header without login.

use the connection manager, as archive.org doesn't use basic auth, it uses cookies which require account login.

raztoki
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #19  
Old 05.07.2017, 09:11
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

You have to add the account in Settings-Account Manager
__________________
JD-Dev & Server-Admin
Reply With Quote
  #20  
Old 06.07.2017, 06:55
massquantities massquantities is offline
JD Alpha
 
Join Date: Jan 2017
Posts: 20
Default

ahhhhhh…

that was it.

i thought because it was a free (not premium) account, i had to use "basic." sorry!

thanks so much for all the help.
Reply With Quote
  #21  
Old 06.07.2017, 11:51
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

Thanks for the feedback and you're welcome
__________________
JD-Dev & Server-Admin
Reply With Quote
  #22  
Old 24.02.2021, 04:39
massquantities massquantities is offline
JD Alpha
 
Join Date: Jan 2017
Posts: 20
Default

hey, guys.

i'm back.

latest version of jdownloader.

say an archive.org post needs one to login, such as,

**External links are only visible to Support Staff****External links are only visible to Support Staff**

i login. can see everything just fine. add to jdownloader. it'll download for a bit, then stop. jdownloader will say "skipped. account is missing." (it's not.)

i clicked one of the error icons, it prompted for an archive.org premium account . i followed the link, which looks like is just an account. i entered my creds. it checked. it took. it started downloading. then stops and repeats.

(i also went back and added my creds to connections manager on top of account manager. i think i'm doing it right. i'm using https and port 443.)

thanks for any help in advance.
Reply With Quote
  #23  
Old 24.02.2021, 14:40
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Hi,

I'm unable to reproduce your issue.
Please set max downloads- and chunks to 1 and check if that helps.
If not, please post a log:

Please post your log-ID here | bitte poste deine Log-ID hier.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #24  
Old 25.02.2021, 05:38
massquantities massquantities is offline
JD Alpha
 
Join Date: Jan 2017
Posts: 20
Default

[redacted.]

Last edited by massquantities; 26.02.2021 at 23:41.
Reply With Quote
  #25  
Old 25.02.2021, 05:40
massquantities massquantities is offline
JD Alpha
 
Join Date: Jan 2017
Posts: 20
Default

the

max downloads: 1
chunks: 1

seemed to kind of work (so slow), but i had to baby the download (unskip, resume, rinse, repeat). that was on one that was over 1gb.

on smaller ones, it continued to just fail with the "skipped - account is missing" error message.
Reply With Quote
  #26  
Old 25.02.2021, 16:34
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Hi again,
according to your log, one or multiple items are not available even via account - maybe it is offline.
Please always check items with errors via browser.
In this case, this is what I got:

I've improved the errorhandling for this case so "Account required" doesn't get displayed if this error happens while the user is logged in.

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #27  
Old 25.02.2021, 23:34
massquantities massquantities is offline
JD Alpha
 
Join Date: Jan 2017
Posts: 20
Default

ok. thanks. i'll… try it again? (this might take a little more sleuthing on my end.)
Reply With Quote
  #28  
Old 25.02.2021, 23:50
massquantities massquantities is offline
JD Alpha
 
Join Date: Jan 2017
Posts: 20
Default

[redacted.]

still getting the "skipped account is missing error" (downloaded a the fresh update), on fresh (i also downloaded via browser) 1.1mb file.

Last edited by massquantities; 26.02.2021 at 23:41.
Reply With Quote
  #29  
Old 26.02.2021, 12:30
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Try again after the next update and add an account usage rule to disable free download (= disable download without account) for archive.org:
https://support.jdownloader.org/Know...-free-download

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #30  
Old 26.02.2021, 23:40
massquantities massquantities is offline
JD Alpha
 
Join Date: Jan 2017
Posts: 20
Default

ok. i think i did that (disabling free-download/download-without-account):

"Connections problems."

[redacted.]

Last edited by massquantities; 02.03.2021 at 04:32.
Reply With Quote
  #31  
Old 01.03.2021, 15:56
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Can you download the failing files via browser?

The ones of youg log are working fine here but maybe archive.org had temporary issues at that time.
This issue is definitly not related to our software...

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #32  
Old 01.03.2021, 21:05
massquantities massquantities is offline
JD Alpha
 
Join Date: Jan 2017
Posts: 20
Default

i am downloading from a browser just fine.

is it possible that by upping the chunks (i went back up to 20), this is causing the issue?
Reply With Quote
  #33  
Old 01.03.2021, 21:32
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Yes - just play with it.
You do not need 20 chunks.
E.g. 20 chunks + 20 simultan downloads --> 400 connections -> If everyone does this, archive.org will probably introduce tighter limits

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #34  
Old 02.03.2021, 04:32
massquantities massquantities is offline
JD Alpha
 
Join Date: Jan 2017
Posts: 20
Default

i'm not doing simultaneous downloads (well, never on the same host).


is there a way to limit chunks on a per host basis?
Reply With Quote
  #35  
Old 02.03.2021, 15:34
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Hi,
this is not (yet) possible via setting.
However you could do it via EventScripter script and set a property "CHUNKS" with the desired value on all archive.org items.

-psp-

Use a Packagizer Rule
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 02.03.2021 at 15:53.
Reply With Quote
  #36  
Old 02.03.2021, 15:48
mgpai mgpai is offline
Script Master
 
Join Date: Sep 2013
Posts: 1,533
Default

Can also be set on per-host basis via packagizer rule.
Reply With Quote
  #37  
Old 02.03.2021, 15:52
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

That's right - totally forgot about this...

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #38  
Old 03.03.2021, 22:32
massquantities massquantities is offline
JD Alpha
 
Join Date: Jan 2017
Posts: 20
Default

now getting a weird "temporarily unavailable" after going down to 1 chunk:

03.03.21 09.13.09 <--> 03.03.21 09.13.09 jdlog://2487725302851/
Reply With Quote
  #39  
Old 04.03.2021, 15:04
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Again please always check such issues via browser before asking us...
Your issue e.g. happened with this URL:
archive.org/download/no-intro-rom-sets/CENSORED(20100224-080928).zip
--> It is broken via browser too:

Please contact the archive.org support and ask them to fix these items.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #40  
Old 05.03.2021, 01:46
massquantities massquantities is offline
JD Alpha
 
Join Date: Jan 2017
Posts: 20
Default

dah! sorry! i thought i had. sorry to bother you.
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 09:29.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.