JDownloader Community - Appwork GmbH
 

 
 
Thread Tools Display Modes
Prev Previous Post   Next Post Next
  #1  
Old 24.03.2023, 13:34
mtsandersen mtsandersen is offline
Junior Loader
 
Join Date: Mar 2023
Posts: 12
Smile [LinkCrawler] Trying to download DPReview sample images

Hi, since DPReview is shutting down on April 10th, I'm trying to download some of their sample photos gallery, and it looks like JD2s LinkCrawler should be able to do that. I've looked at the sample documentation, and tried to construct a rule:

Code:
[{
"enabled" : true,
"logging" : false,
"maxDecryptDepth" : 2,
"name" : "DPReview sample gallery",
"pattern" : "(**External links are only visible to Support Staff**,
"packageNamePattern": "$2",
"rule" : "DEEPDECRYPT",
"passwordPattern" : null,
"deepPattern" : "(**External links are only visible to Support Staff**
}]
Settings -> Advanced Settings -> search "Rules"
Shows Key, Description and Value columns
Entry for "LinkCrawler: Link Crawler Rules"
Edit "Value" field and enter parameters with square brackets

Unfortunately it's not working. The RegEx is valid, I checked an online JSON validator, it should work. I had the periods double-escaped with two slashes, but took them out to try and troubleshoot, since regex '.' still matches. A regex checker seems to match fine.
I set MaxDecryptDepth to 2, not sure if that is correct, nor the other parameters.

What I'm trying to do:
From the main page, there's a Camera and Lens sample gallery link, like this:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
Clicking a link, it opens a gallery with the same URL of images from the camera. Clicking though to an image, there's a sample image with info on the side usually with a jpg and Raw download link on this page. That's what I'm trying to get.
Ideally it would only download files over a certain size (ie not every thumbnail jpg), but I'm not sure that can be done.
I played with trying to get it to write the camera part of the URL into the file name, but the PackageNamePattern should work fine for individual folders. The pattern above *should* put that part into PackageNamePattern, and hence allow a folder to be created on download.
What am I doing wrong?
Reply With Quote
 

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 16:55.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.