JDownloader Community - Appwork GmbH
 

Notices

Reply
 
Thread Tools Display Modes
  #1  
Old 14.04.2021, 00:58
Sac John Sac John is offline
JD Adviser
 
Join Date: Nov 2014
Posts: 108
Default How to download all images in folders, one generation down into webpage

Still loving JD2. Best download software EVER, by far.

I'm sure this question has been discussed before, but I don't know how to search for an answer. I don't know the terminology.

Here's a webpage with a large number of photos. Each photo is a link to another page with a series of photos related to the top "link" photo.

Is there a way to download all the photos in separate folders without manually capturing each link? I would love to learn some way to just select-all on the top page and that generates a folder for each of the embedded "under" links.

Basically, I'm not looking to download the images on this page. I'm looking to download all the images on the pages that these images link to. And I want jdownloader2 to create folders for each page so that all I have to do is select-all and copy-selected-links on this page. One or two clicks, then a few minutes of jd2 generating folders and links, and I'm done.

I think the photos I want are not one folder down. They are two folders down. The below link is the top page. Those images all link to thumbnails one page down. And those thumbnails link to the full-resolution individual images that I'm after.

There are about 580 images on this page. I want jd2 to create 580 folders, each named automatically like the 580 webpages, and each folder containing the 12 to 20 links to full-res images.

How is this accomplished?

**External links are only visible to Support Staff****External links are only visible to Support Staff**

Last edited by Jiaz; 14.04.2021 at 16:05.
Reply With Quote
  #2  
Old 14.04.2021, 13:13
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Hi,
this is easily possible via LinkCrawler Rule(s).
You can find a lot of examples in our forum.
Just check back here if you're stuck and we can help you to create working rules.
Please keep in mind that getting all results from this search query (your example) automatically won't work but adding e.g. such links, finding all images and putting them into one package with a meaningful name is easily possible:
..com/galleries/this-is-an-example-12345678/

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by Jiaz; 14.04.2021 at 16:05. Reason: Forgot to link support article
Reply With Quote
  #3  
Old 14.04.2021, 15:58
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

https://support.jdownloader.org/Know...kcrawler-rules
https://support.jdownloader.org/Know...le-deepdecrypt
__________________
JD-Dev & Server-Admin
Reply With Quote
  #4  
Old 14.04.2021, 16:04
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

You just need a linkcrawler rule for the index/search site, the individual links will be fixed with next update
__________________
JD-Dev & Server-Admin
Reply With Quote
  #5  
Old 15.04.2021, 00:45
Sac John Sac John is offline
JD Adviser
 
Join Date: Nov 2014
Posts: 108
Default

Hello guys. Thank you for the replies. Always so helpful!

I spent an hour or so trying to make my own linkcrawler rule, but no luck. I'm just not experienced enough with all the terminology. I couldn't even understand the tutorial! I did find where to insert the rule in the advanced settings, but the changes I made to the sample rule did not work.

If either of you want to help, this is the page of master thumbnails.

**External links are only visible to Support Staff****External links are only visible to Support Staff**

Behind each of these images is a page with twenty or so large thumbnails - and behind each of those images is the full-res image. So I guess I'm looking to search two levels down into this page for image links. The goal is to have only the full-res image links loaded into JD2. If they would appear in folders with the page name for each one, that would be even better. But I am presuming from pspzockerscene's comment that that is not possible. Not a big problem. I can package the image links myself after they are all in JD2 if necessary.

But just getting 550+ pages worth of links into JD2 using linkcrawler rules is still over my head. Any help would be appreciated.
Reply With Quote
  #6  
Old 15.04.2021, 11:07
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

The website uses pagination in way not supported by Linkcrawler Rules.
I would recommend to just scroll in browser until all links are visible and then select all (CTRL+A) and copy to Clipboard (CTRL+C)
As an alternative you could try to use Eventscripter, see
https://board.jdownloader.org/showthread.php?t=70525
and a small script that does the pagination and crawl all the links for you. Ask mgpai for help with this.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #7  
Old 15.04.2021, 20:42
Sac John Sac John is offline
JD Adviser
 
Join Date: Nov 2014
Posts: 108
Default

I appreciate you trying. Thanks.
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 11:34.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.