JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 08.04.2018, 20:16
ninguno ninguno is offline
JD Beta
 
Join Date: Oct 2010
Posts: 53
Question LinkCrawler Rules help

Hi, is there any tutorial or faq showing how to create rules?
I search the forum and i'm not finding it. For example the different values that "rule" parameter (example "DIRECTHTTP") could have and the meaning of them.
And specially how to assign cookies.

Thanks in advance
Reply With Quote
  #2  
Old 10.04.2018, 13:07
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 56,185
Default

LinkCrawler Rules support different modes

REWRITE -> rewrite/change URL
SUBMITFORM -> submit a FORM
DIRECTHTTP -> treat URL as direct downloadable and download the content/response
DEEPDECRYPT -> load the URL and parse the html source (no js execution) to find inner links
FOLLOWREDIRECT -> follow URL redirect
for example: "rule" : "DEEPDECRYPT"

with
"pattern" : "pattern"
you specify the pattern that matches the rule

you can specify cookies by
"cookies: [ ["key1","value1"], ["key2","value2"],["key2","value2"]..]
pay attention for correct json escaping!

you can enable/disable rule by
"enabled" : true or false

you can specify max depth (how deep the same rule can go)
"maxDecryptDepth" : 0

you can specify name (for yourself or when you share rules)
"name" : "Test"

you can specify pattern (DEEPDECRYPT) that returns the name of the package for all found links
"packageNamePattern" : "pattern"

you can specify pattern (SUBMITFORM) that selects the form to submit
"formPattern" : "pattern"

you can specify pattern (DEEPDECRYPT) that returns inner links/html to parse
"deepPattern" : "pattern"

you can specify pattern (REWRITE) to rewrite URL ($1 is first match, $2 is second match...)
"rewriteReplaceWith" : "$1"


In case you need further help of have additional questions, please don't hesitate and ask
__________________
JD-Dev & Server-Admin
Reply With Quote
  #3  
Old 22.05.2018, 03:30
ninguno ninguno is offline
JD Beta
 
Join Date: Oct 2010
Posts: 53
Default

You're the best Jiaz! I'll play with these and tell you if there is any doubt
Reply With Quote
  #4  
Old 22.05.2018, 11:42
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 56,185
Default

You're welcome! Just ask if you have further questions about this or need help
__________________
JD-Dev & Server-Admin
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 18:59.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2018, Jelsoft Enterprises Ltd.