I have added a second rule, so the setup looks like this
Code:
[ {
"enabled" : true,
"cookies" : [ ],
"updateCookies" : true,
"logging" : false,
"maxDecryptDepth" : 9,
"name" : "rule 1",
"pattern" : "**External links are only visible to Support Staff**,
"rule" : "DEEPDECRYPT",
"packageNamePattern" : null,
"passwordPattern" : null,
"formPattern" : null,
"deepPattern" : "(?<=<p>| )<a href=\"([^\"]+theweb\\.tv/(?!(category|tag))\\S+(/|\\.jpg))\"",
"rewriteReplaceWith" : null
},{
"enabled" : true,
"cookies" : [ ],
"updateCookies" : true,
"logging" : false,
"maxDecryptDepth" : 0,
"name" : "rule 2",
"pattern" : "**External links are only visible to Support Staff**,
"rule" : "DEEPDECRYPT",
"packageNamePattern" : null,
"passwordPattern" : null,
"formPattern" : null,
"deepPattern" : "Full size: <a href=\"([^"]+)\"",
"rewriteReplaceWith" : null
} ]
But the links are still not found on download. It still also put the image link in the middle of the three when I try to show download urls.
I have also remove the .jpg from the first rule, but that results in the crawler not getting any files at all.