JDownloader Community - Appwork GmbH
 

Notices

 
 
Thread Tools Display Modes
Prev Previous Post   Next Post Next
  #1  
Old 27.06.2020, 13:52
SourceStryker SourceStryker is offline
Baby Loader
 
Join Date: Jun 2020
Posts: 5
Default nhentai.net digit increase linkcrawler rule

So I wanted to create a linkcrawler rule that allowed me to supply the first page and to search through only a specified number of pages. I've been looking around and found this piece of code here, but since all the external links are censored I'm not really sure how the regex works. I've also searched around but not really found any tutorials on it, although I am very willing to say I've missed them.

Code:
[{
"enabled": true,
"maxDecryptDepth": 10,
"name": "nhentai.net",
"pattern": https://nhentai.net/search/?q=femdom&sort=popular&page=,
"rule": "DEEPDECRYPT",
"deepPattern": "(class=\"mp4\"><a href=\"([^\"]+)\"|<a href=\"(/modelSearch/.*?/page/\\d+)\")"
}]
For example if I supplied this link: **External links are only visible to Support Staff****External links are only visible to Support Staff** I would like to be able to specify crawling through the pages 25-100 (hopefully I can change those numbers myself when I need to) without typing each of the links individually.

Further example links look like
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

So essentially they're just page=1, page=2, page=3 at the end and all I want to do is know how to increment the ending for a link crawl up to a certain amount.

I did write some c++ code that generates the links myself, but was hoping there was a more official way to do it through JDownloader 2 through the deepPattern.

Thank you.

Last edited by SourceStryker; 27.06.2020 at 13:59.
Reply With Quote
 

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 05:09.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2021, Jelsoft Enterprises Ltd.