[marvelfrozen]

The website in question is for example is this

**External links are only visible to Support Staff****External links are only visible to Support Staff**

**External links are only visible to Support Staff****External links are only visible to Support Staff**

I use this rule and manage to crawl the image files list

[ {
  "enabled" : true,
  "cookies" : [ ],
  "updateCookies" : true,
  "logging" : false,
  "maxDecryptDepth" : 9,
  "id" : 1586231755944,
  "name" : "my rule",
  "pattern" : "**External links are only visible to Support Staff**,
  "rule" : "DEEPDECRYPT",
  "packageNamePattern" : null,
  "passwordPattern" : null,
  "formPattern" : null,
  "deepPattern" : "(?<=<p>| )<a href=\"([^\"]+theweb\\.tv/(?!(category|tag))\\S+(/|\\.jpg))\"",
  "rewriteReplaceWith" : null
} ]

*i use "theweb" there to mask the website, sorry if confusing

But when I tried to download said files, it got error File not found on the download list.

Am I missing something?

Thank you for the help.

[tony2long]

Can you open the crawl result with browser?

[marvelfrozen]

Right Click and open in browser opens the source url.

Is it supposed to open the image file instead?

[tony2long]

I can't test it because theweb.tv is not in the source of that example link.
In the source, the link after "Full size:" is the link that you should get.

[marvelfrozen]

I sent you a private message. Please check.

This is the source (?) that I get if I crawl using the rule
https://i.postimg.cc/zJgDKYjB/JDownl...hg-CV0k-Fk.png

While this is the one if I didn't use the rule, but copy block the gallery
https://i.postimg.cc/c14NDpQf/JDownl...jst-K8x-LT.png

Why is it not directing to the image file when I'm using the rule?

[tony2long]

It seems that non zero "maxDecryptDepth" will make upside down the links.
So try with 2 rules, one for picture only with "maxDecryptDepth" = 0 and "deepPattern" : "Full size: <a href="([^"]+)""

[marvelfrozen]

I have added a second rule, so the setup looks like this

[ {
  "enabled" : true,
  "cookies" : [ ],
  "updateCookies" : true,
  "logging" : false,
  "maxDecryptDepth" : 9,
  "name" : "rule 1",
  "pattern" : "**External links are only visible to Support Staff**,
  "rule" : "DEEPDECRYPT",
  "packageNamePattern" : null,
  "passwordPattern" : null,
  "formPattern" : null,
  "deepPattern" : "(?<=<p>| )<a href=\"([^\"]+theweb\\.tv/(?!(category|tag))\\S+(/|\\.jpg))\"",
  "rewriteReplaceWith" : null
},{
  "enabled" : true,
  "cookies" : [ ],
  "updateCookies" : true,
  "logging" : false,
  "maxDecryptDepth" : 0,
  "name" : "rule 2",
  "pattern" : "**External links are only visible to Support Staff**,
  "rule" : "DEEPDECRYPT",
  "packageNamePattern" : null,
  "passwordPattern" : null,
  "formPattern" : null,
  "deepPattern" : "Full size: <a href=\"([^"]+)\"",
  "rewriteReplaceWith" : null
} ]

But the links are still not found on download. It still also put the image link in the middle of the three when I try to show download urls.

I have also remove the .jpg from the first rule, but that results in the crawler not getting any files at all.

[pspzockerscene]

Works fine here like this:

[ {
  "enabled" : true,
  "maxDecryptDepth" : 1,
  "name" : "modelblog.tv replace thumbnail URL to full image URL",
  "pattern" : "(https?://modelblog\\.tv/wp-content/uploads/\\d{4}/\\d{2}/.*)(-\\d+x\\d+)\\.jpg",
  "rule" : "REWRITE",
  "packageNamePattern" : null,
  "passwordPattern" : null,
  "formPattern" : null,
  "deepPattern" : null,
  "rewriteReplaceWith" : "$1.jpg"
}, {
  "enabled" : true,
  "updateCookies" : true,
  "maxDecryptDepth" : 1,
  "name" : "modelblog.tv grab thumbnails from overview page",
  "pattern" : "https?://modelblog\\.tv/(?!wp-content)[^/]+/",
  "rule" : "DEEPDECRYPT",
  "packageNamePattern" : null,
  "passwordPattern" : null,
  "formPattern" : null,
  "deepPattern" : "(https?://modelblog\\.tv/wp-content/[^\"]+\\.jpg)",
  "rewriteReplaceWith" : null
} ]

This way you would only have to add the "overview" URL containing the thumbnails and save 1 step.

-psp-

[marvelfrozen]

Thank you, that works just like I wanted.

[pspzockerscene]

Thanks for your feedback.

-psp-