JDownloader Community - Appwork GmbH
 

Notices

Reply
 
Thread Tools Display Modes
  #1  
Old 09.11.2019, 02:54
photogmuses photogmuses is offline
Modem User
 
Join Date: Nov 2019
Posts: 2
Default [LinkCrawler Rule] 35photo.pro Search Two Links Deep

Hello,

I'm wondering if JD2 is able to search two links deep for the original image...

For instance, artist profile pages at 35photo.pro load temp image thumbnails on scroll:

e.g. **External links are only visible to Support Staff****External links are only visible to Support Staff**

The temp thumbnails link to individual pages for each image:

e.g. **External links are only visible to Support Staff****External links are only visible to Support Staff**

On the individual image page(s), a larger version of the image loads from a subdomain link:

e.g. **External links are only visible to Support Staff****External links are only visible to Support Staff**

Is it possible to have JD2 trace the links to the original image following a pattern like the example I gave above?

Any help would be much appreciated.

Cheers,

~MJ
Reply With Quote
  #2  
Old 12.11.2019, 12:16
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,342
Default


You either have to wait for plugin support for those photo_ links or create a LinkCrawler rule to teach JDownloader how to process those links. You can use board search for examples of LinkCrawler rules
__________________
JD-Dev & Server-Admin
Reply With Quote
  #3  
Old 05.08.2021, 14:19
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,140
Default

This is possible via LinkCrawler Rules - a dedicated plugin is not required.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #4  
Old 07.09.2021, 15:40
Ronny88 Ronny88 is offline
Linkgrabbing Monster
 
Join Date: Oct 2014
Posts: 83
Default

I am also interested in having a link crawler for this site. Could I have some help? Thanks.
Reply With Quote
  #5  
Old 07.09.2021, 15:53
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,140
Default

Hi,
here is a simple rule for single images.
While you can basically add another rule to be able to auto-crawl user profiles or search-results you won't be able to make pagination/dynamic scrolling work.
For this, basically use your browser, scroll all the way down and copy/paste all "/photo_123456" URLs in JD.

Here is the rule:
Code:
[
  {
    "enabled": true,
    "updateCookies": true,
    "logging": false,
    "maxDecryptDepth": 1,
    "name": "example rule",
    "pattern": "**External links are only visible to Support Staff**,
    "rule": "DEEPDECRYPT",
    "deepPattern": "(**External links are only visible to Support Staff**]+)"
  }
]
Rule as plaintext for easier copy & paste:
pastebin.com/raw/b5AQhu70

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #6  
Old 07.09.2021, 15:55
Ronny88 Ronny88 is offline
Linkgrabbing Monster
 
Join Date: Oct 2014
Posts: 83
Default

Thank you!
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 11:35.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.