View Single Post
  #1  
Old 27.06.2020, 13:52
SourceStryker SourceStryker is offline
Baby Loader
 
Join Date: Jun 2020
Posts: 5
Default nhentai.net digit increase linkcrawler rule

So I wanted to create a linkcrawler rule that allowed me to supply the first page and to search through only a specified number of pages. I've been looking around and found this piece of code here, but since all the external links are censored I'm not really sure how the regex works. I've also searched around but not really found any tutorials on it, although I am very willing to say I've missed them.

Code:
[{
"enabled": true,
"maxDecryptDepth": 10,
"name": "nhentai.net",
"pattern": https://nhentai.net/search/?q=femdom&sort=popular&page=,
"rule": "DEEPDECRYPT",
"deepPattern": "(class=\"mp4\"><a href=\"([^\"]+)\"|<a href=\"(/modelSearch/.*?/page/\\d+)\")"
}]
For example if I supplied this link: **External links are only visible to Support Staff****External links are only visible to Support Staff** I would like to be able to specify crawling through the pages 25-100 (hopefully I can change those numbers myself when I need to) without typing each of the links individually.

Further example links look like
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

So essentially they're just page=1, page=2, page=3 at the end and all I want to do is know how to increment the ending for a link crawl up to a certain amount.

I did write some c++ code that generates the links myself, but was hoping there was a more official way to do it through JDownloader 2 through the deepPattern.

Thank you.

Last edited by SourceStryker; 27.06.2020 at 13:59.
Reply With Quote