JDownloader Community - Appwork GmbH
 

Notices

Reply
 
Thread Tools Display Modes
  #1  
Old 17.09.2015, 02:20
ApexPredator ApexPredator is offline
Vacuum Cleaner
 
Join Date: Sep 2015
Posts: 18
Default Missing images from Deviantart

Jdownloader seems to not grab some deviantart image links when I try to get a whole gallery.
For example, these are some that Jdownloader linkgrabber did not find from the deviantart gallery:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
or
**External links are only visible to Support Staff****External links are only visible to Support Staff**
or
**External links are only visible to Support Staff****External links are only visible to Support Staff**
or
**External links are only visible to Support Staff****External links are only visible to Support Staff**

There were at least 15 files that Jdownloader missed (found 456, total should be at least 471)
Reply With Quote
  #2  
Old 17.09.2015, 10:38
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,289
Default

Can you provide the gallery links? The one that you entered and when some images were missing
__________________
JD-Dev & Server-Admin
Reply With Quote
  #3  
Old 17.09.2015, 18:07
ApexPredator ApexPredator is offline
Vacuum Cleaner
 
Join Date: Sep 2015
Posts: 18
Default

This is the link I used for Jdownloader: **External links are only visible to Support Staff****External links are only visible to Support Staff**
This is a link to the gallery page to one of the missed images (it's going to be hard to find the 15 missed images in the deviantart gallery because the names are hard to search for): **External links are only visible to Support Staff****External links are only visible to Support Staff**

Like I said in the original post, Jdownloader found 456 images from that link. In the gallery stats for Deviantart, it states that the artist has 456 deviations **External links are only visible to Support Staff****External links are only visible to Support Staff**

However, while browsing this artists gallery myself I ran across some images I didn't recall seeing Jdownloader download (the ones in the original post). I ended up finding 15 images that were in the deviantart artists gallery that Jdownloader didn't find. When I combined the missed images with the ones Jdownloader found, I ended up with 471 total images.

I ran a duplicate file checker and it only turned up 2 images that were exactly the same (these 2 images were downloaded by Jdownloader, but they have different names). So, I know that essentially there are 469 unique images in total that I have from the artists gallery.

I'll link this pastebin with the direct links I obtained using a firefox userscript ((dm) deviant art gallery ripper (old slowmode)). The userscript also only found 456 images, however 15 of them were different from Jdownloader's links. **External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
Old 17.09.2015, 18:14
djmakinera
Message deleted by pspzockerscene. Reason: spam
  #4  
Old 17.09.2015, 18:34
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,918
Default

ApexPredator we need the main "/art/" urls to the missing images e.g.
3smjill.deviantart.com/art/Lonely-JILL-23-525795057
...otherwise its gonna be very hard to find out whats wrong.
Plus it would be good to know on which page the missing urls are but I guess once we have the urls we can easily find this out via script.
Please keep in mind that some websites are buggy and show wrong numbers - this can also happen when galleries contain the same urls multiple times - but JDownloader will recognize this and only add them once, resulting in less entries in the linkgrabber than you expect.

GreeZ psp
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #5  
Old 17.09.2015, 20:07
ApexPredator ApexPredator is offline
Vacuum Cleaner
 
Join Date: Sep 2015
Posts: 18
Default

I couldn't find the page numbers for the images. However, I did go through the direct links the userscript gave me and went to go google the /art/ url's for the missing pages: **External links are only visible to Support Staff****External links are only visible to Support Staff**

Most of the missing images Jdownloader missed appear to be .gif and there was 1 .png file.
Reply With Quote
  #6  
Old 18.09.2015, 11:48
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,918
Default

I added your URL again and all of your "missing" images were found:
3smjill.deviantart.com/gallery/?catpath=/
Found 456 urls and by using the search field on the bottom bar and typing in IDs of missing images, you can find them via filename e.g.:
414982596

Sorry - I'm not (yet) able to reproduce your issue.

GreeZ psp
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #7  
Old 18.09.2015, 22:10
ApexPredator ApexPredator is offline
Vacuum Cleaner
 
Join Date: Sep 2015
Posts: 18
Default

I don't know how to search with the ID's but I did try the file search. As you can see in this picture: http://imgur.com/6w1JayE I have 456 links in Jdownloader, and you can see some of the files in the list. Now, in this picture: http://imgur.com/GILF6pf you can see that I did a file search for .gif and it only found one .gif image in the linkgrabber.

Edit: I'm not sure why the imgur links are visible since all the other external links are visible to supporters only.

Last edited by ApexPredator; 18.09.2015 at 22:13.
Reply With Quote
  #8  
Old 19.09.2015, 13:49
tony2long's Avatar
tony2long tony2long is offline
English Supporter
 
Join Date: Jun 2009
Posts: 6,507
Default

For this plugin, file type is not available in linkgrabber tab.
The "missing" link in your post #3 is available: Carla.s.dance.475970334 but downloaded as .png
__________________
FAQ: How to upload a Log

Last edited by tony2long; 19.09.2015 at 14:02.
Reply With Quote
  #9  
Old 19.09.2015, 19:34
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,289
Default

fixed correct file extension, wait for plugin update
__________________
JD-Dev & Server-Admin
Reply With Quote
  #10  
Old 19.09.2015, 21:37
ApexPredator ApexPredator is offline
Vacuum Cleaner
 
Join Date: Sep 2015
Posts: 18
Default

That plugin update seems to have resolved all the issues except for one that I forgot to mention this whole time. 3_by_3smjill-d6vhhec.png never downloaded at any time for me, it always gives a server error 404 message (I've downloaded the whole gallery twice now). I can right click and save as on deviantart and get it just fine though. I don't know what is preventing Jdownloader from downloading it.
This is the /art/ url for the image: **External links are only visible to Support Staff****External links are only visible to Support Staff** .
This is the direct link to the image: **External links are only visible to Support Staff****External links are only visible to Support Staff** (Jdownloader can download the image using the direct link)

Last edited by ApexPredator; 19.09.2015 at 21:42.
Reply With Quote
  #11  
Old 19.09.2015, 21:39
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,289
Default

the preview image is offline, will fix that too
__________________
JD-Dev & Server-Admin
Reply With Quote
  #12  
Old 19.09.2015, 21:51
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,289
Default

fixed with next update
__________________
JD-Dev & Server-Admin
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 14:39.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.