JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 28.11.2018, 13:47
sirfrancis17 sirfrancis17 is offline
Modem User
 
Join Date: Nov 2018
Posts: 3
Default linkcrawler help

Hello
I want to use the jdownloader to get links from a web page. How should I do it so that I can scan the pages with the linkgrabber without having to manually enter the addresses?
Thank you
* I tried this but I just took the links on the first page
[ {
"enabled" : true,
"cookies" : null,
"updateCookies" : true,
"maxDecryptDepth" : 3,
"id" : 0,
"name" : null,
"pattern" : null,
"rule" : "DEEPDECRYPT",
"packageNamePattern" : null,
"passwordPattern" : null,
"formPattern" : null,
"deepPattern" : null,
"rewriteReplaceWith" : null
} ]
Reply With Quote
  #2  
Old 28.11.2018, 14:42
mgpai mgpai is offline
Script Master
 
Join Date: Sep 2013
Posts: 449
Default

In the rule, you need to specify the pattern which match the urls from that site.

Example:
Code:
https://board.jdownloader.org/showthread.php?t=70525
https://board.jdownloader.org/showthread.php?t=79288
https://board.jdownloader.org/showthread.php?t=79289

Crawler Rule:
Code:
[ {
  "enabled" : true,
  "cookies" : null,
  "updateCookies" : true,
  "maxDecryptDepth" : 0,
  "id" : 1543407812078,
  "name" : "JDownloader",
  "pattern" : "https://board.jdownloader.org/showthread.php\\?t=\\d+",
  "rule" : "DEEPDECRYPT",
  "packageNamePattern" : null,
  "passwordPattern" : null,
  "formPattern" : null,
  "deepPattern" : null,
  "rewriteReplaceWith" : null
} ]

You can find more information on linkcrawler rules in Post #422008
Reply With Quote
  #3  
Old 29.11.2018, 23:16
sirfrancis17 sirfrancis17 is offline
Modem User
 
Join Date: Nov 2018
Posts: 3
Default

Thank you for answering
Can you help me with the next page?
**External links are only visible to Support Staff****External links are only visible to Support Staff**
each web page there is a group of series that takes you to your website. In each series has its website with the links of chapters and finally it will take you to a page with different links (mega, 1fichier, etc)
How can I do that?
What is it "id" : 1543407812078,?
Reply With Quote
  #4  
Old 29.11.2018, 23:54
mgpai mgpai is offline
Script Master
 
Join Date: Sep 2013
Posts: 449
Default

The ID is automatically generated by JD when you add a rule.

Please search the forum. You can find several examples which can help you create the rules.
Reply With Quote
  #5  
Old 01.12.2018, 17:57
sirfrancis17 sirfrancis17 is offline
Modem User
 
Join Date: Nov 2018
Posts: 3
Default

I could not do it but thanks equally
Best regards
Reply With Quote
  #6  
Old 01.12.2018, 18:13
mgpai mgpai is offline
Script Master
 
Join Date: Sep 2013
Posts: 449
Default

If you provide more information, I can check it. Find me in JD Chat.
Reply With Quote
  #7  
Old 04.12.2018, 15:06
mgpai mgpai is offline
Script Master
 
Join Date: Sep 2013
Posts: 449
Default

The show title will be set as packagename. I have created the rules based on the example urls you have given to me, but I am getting links only from ouo (working) and mitly (plugin broken). Do you know if all final links are supported in JD?

Linkcrawler Rule:
Code:
gitlab.com/snippets/1786899/raw?inline=false
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 04:49.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2019, Jelsoft Enterprises Ltd.