JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 28.08.2017, 17:14
heyholetsgo
Guest
 
Posts: n/a
Default Downloading from Archive.org

Hi,

I have a big list of Archive.org links which I would like to download but every time I paste a link into Jdownloader it also grabs all other formats and other auto generated files. As example if I paste this link **External links are only visible to Support Staff****External links are only visible to Support Staff** it adds .avi, .gif, .mp4 and .ogv but I only want the original file (.avi in this case) because the others were auto generated by Archive.org and have bad quality and are unnecessarily taking up space. https://i.imgur.com/J4PgYTg.png Is there any way to tell Jdownloader to only grab the best format? Like telling it to check if there is .avi instead of .mp4 or checking if there is .mp4 instead of .ogv
I checked the Archive.org plugin but unfortunately there are no options available.

Thank you in advance.
Attached Images
File Type: png J4PgYTg.png (11.5 KB, 0 views)
Reply With Quote
  #2  
Old 28.08.2017, 17:19
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 80,991
Default

How do you tell that avi is always better than mp4?
avi is very old format/extension and normally mp4 should be modern/better quality.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #3  
Old 28.08.2017, 17:20
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 80,991
Default

I will add an option to include original files only
__________________
JD-Dev & Server-Admin
Reply With Quote
  #4  
Old 28.08.2017, 17:38
heyholetsgo
Guest
 
Posts: n/a
Default

Quote:
Originally Posted by Jiaz View Post
How do you tell that avi is always better than mp4?
avi is very old format/extension and normally mp4 should be modern/better quality.
Because it was the original file. Archive.org does not auto generate .avi or .mkv files. If you upload .avi it will generate .gif, .mp4 and .ogv.

Quote:
Originally Posted by Jiaz View Post
I will add an option to include original files only
Such an option would be awesome, thank you very much!
Reply With Quote
  #5  
Old 28.08.2017, 17:56
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 80,991
Default

Settings-Plugins. search for archive.org (will exist twice) and then enable prefer original
Wait for next plugin update
__________________
JD-Dev & Server-Admin
Reply With Quote
  #6  
Old 28.08.2017, 19:08
heyholetsgo
Guest
 
Posts: n/a
Default

Quote:
Originally Posted by Jiaz View Post
Settings-Plugins. search for archive.org (will exist twice) and then enable prefer original
Wait for next plugin update
Thanks for the quick update unfortunately when I paste a link (**External links are only visible to Support Staff****External links are only visible to Support Staff** for testing) it will only grab the _meta.sqlite and _meta.xml (it doesn't grab the _files.xml) files but doesn't grab the actual video. https://i.imgur.com/gJYiRqm.png
Trying it with the previous link (**External links are only visible to Support Staff****External links are only visible to Support Staff**) worked well except it didn't grab the .thumbs, .torrent and .xml files again https://i.imgur.com/sb8uq7o.png
Attached Images
File Type: png gJYiRqm.png (29.4 KB, 0 views)
File Type: png sb8uq7o.png (4.2 KB, 0 views)
Reply With Quote
  #7  
Old 29.08.2017, 12:25
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 80,991
Default

Wait for next update and try again
I've added support for folder links (topkekguy example)
I dont see much sense in downloading .thumbs folder or the meta data files (_meta and _files). Why download .thumbs when you actual download the video?
__________________
JD-Dev & Server-Admin
Reply With Quote
  #8  
Old 29.08.2017, 19:43
heyholetsgo
Guest
 
Posts: n/a
Default

Seems to work great with .mp4, .mp3 and .m4a files (topkekguy example) but I am having some trouble with .mkv (**External links are only visible to Support Staff****External links are only visible to Support Staff** as example). It doesn't add the .mkv nor the .mp4

There also seems to be a problem with links that require you to log in to view them (**External links are only visible to Support Staff****External links are only visible to Support Staff** as example). Even though I added my archive.org account to Jdownloader in the Account Manager it won't add the files to the linkgrabber.
Reply With Quote
  #9  
Old 29.08.2017, 19:50
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 80,991
Default

Please send logins to support@jdownloader.org so I can check it
__________________
JD-Dev & Server-Admin
Reply With Quote
  #10  
Old 29.08.2017, 19:52
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 80,991
Default

Issue is caused by *german Umlauts*. Will be working after next core update (any minute)
__________________
JD-Dev & Server-Admin
Reply With Quote
  #11  
Old 30.08.2017, 13:30
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 80,991
Default

login view will be fixed with next plugin update
__________________
JD-Dev & Server-Admin
Reply With Quote
  #12  
Old 30.08.2017, 20:39
heyholetsgo
Guest
 
Posts: n/a
Default

Awesome, seems to work perfectly now! Thank you very much!

Will donate some money as soon as I get a paysafecard :)

Edit:
Just found 2 potentially useful links about original and derivatived files on archive.org

**External links are only visible to Support Staff****External links are only visible to Support Staff**
TL;DR
"You can view information about every file in this directory by viewing the file ending in _files.xml (in this example, popeye_taxi-turvey_files.xml). Each file in the item is listed here, along with whether the source is “original” (uploaded by the user), “derivative” (derived by archive.org), or “metadata” file."

**External links are only visible to Support Staff****External links are only visible to Support Staff**

but I guess you already saw this.

Thanks again.

Last edited by heyholetsgo; 30.08.2017 at 20:49.
Reply With Quote
  #13  
Old 31.08.2017, 08:52
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 80,991
Default

Plugin already makes use of _files.xml info to check original and deriviate

So all working now?
__________________
JD-Dev & Server-Admin
Reply With Quote
  #14  
Old 31.08.2017, 15:10
heyholetsgo
Guest
 
Posts: n/a
Default

Yes, it's working great. Thank you very much
Reply With Quote
  #15  
Old 31.08.2017, 15:23
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 80,991
Default

Thanks for the feedback You're welcome
__________________
JD-Dev & Server-Admin
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 07:59.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.