JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 10.09.2022, 19:25
vxvaeaw vxvaeaw is offline
Baby Loader
 
Join Date: Aug 2021
Posts: 8
Default can't add new link crawler rule

Hello.

I'm trying to add new link crawler rule for JD, I copy & pasted code to JD, But it doesn't work and I see a pop-up message that an error has occurred.

Here's a link for the site I want to add
**External links are only visible to Support Staff****External links are only visible to Support Staff**

and here's how I wrote link crawler rule
Code:
[ {
"enabled" : true,
"logging" : false,
"maxDecryptDepth" : 1,
"name" : "coolinet.net",
"pattern" : "**External links are only visible to Support Staff**,
"rule" : "DIRECTHTTP"
} ]
FYI, the video provided by the site is in m3u8 format.
Reply With Quote
  #2  
Old 11.09.2022, 14:12
tarkett tarkett is offline
JD VIP
 
Join Date: Apr 2009
Location: Deutschland
Posts: 323
Default

There is an error in the JSON syntax.
In the pattern you must double all Backslahes (Change from \ to \\).
Then is the syntax okay.
Reply With Quote
  #3  
Old 11.09.2022, 16:45
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,465
Default

sorry thought i posted this morning,
and it wont be DIRECTHTTP, it will be DEEPDECRYPT

https://support.jdownloader.org/Know...le-deepdecrypt
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #4  
Old 11.09.2022, 16:52
vxvaeaw vxvaeaw is offline
Baby Loader
 
Join Date: Aug 2021
Posts: 8
Default

Quote:
Originally Posted by tarkett View Post
There is an error in the JSON syntax.
In the pattern you must double all Backslahes (Change from \ to \\).
Then is the syntax okay.
Nice tip! I'm gonna edit previous code.

Last edited by vxvaeaw; 11.09.2022 at 17:07.
Reply With Quote
  #5  
Old 11.09.2022, 17:04
vxvaeaw vxvaeaw is offline
Baby Loader
 
Join Date: Aug 2021
Posts: 8
Default

Quote:
Originally Posted by raztoki View Post
sorry thought i posted this morning,
and it wont be DIRECTHTTP, it will be DEEPDECRYPT

**External links are only visible to Support Staff**...
Thank you for the tip.
I rewritten the rule, but there was still an error, so I can't add it. I'd appreciate it if you could look at what's wrong.

Code:
[ {
"enabled" : true,
"logging" : false,
"maxDecryptDepth" : 1,
"name" : "coolinet.net",
"pattern" : "**External links are only visible to Support Staff**,
"rule" : "DEEPDECRYPT",
"packageNamePattern" : null,
"passwordPattern" : null,
"deepPattern" : "(**External links are only visible to Support Staff**
} ]
Reply With Quote
  #6  
Old 11.09.2022, 21:07
tarkett tarkett is offline
JD VIP
 
Join Date: Apr 2009
Location: Deutschland
Posts: 323
Default

Quote:
Originally Posted by vxvaeaw View Post
Thank you for the tip.
I rewritten the rule, but there was still an error, so I can't add it. I'd appreciate it if you could look at what's wrong.
The following rule is working for me
Code:
[ {
      "cookies": null,
      "deepPattern": ".*yocoolnet\\.in/.*",
      "formPattern": null,
      "id": 1662912440941,
      "maxDecryptDepth": 1,
      "name": "coolinet.net",
      "packageNamePattern": null,
      "passwordPattern": null,
      "pattern": "https?://(.*\\.)?coolinet\\.net/.*",
      "rewriteReplaceWith": null,
      "rule": "DEEPDECRYPT",
      "enabled": true,
      "logging": false,
      "updateCookies": true
   } ]

With this rule I get all video files. Please check it.

Last edited by tarkett; 11.09.2022 at 21:10.
Reply With Quote
  #7  
Old 11.09.2022, 22:40
vxvaeaw vxvaeaw is offline
Baby Loader
 
Join Date: Aug 2021
Posts: 8
Default

Quote:
Originally Posted by tarkett View Post
The following rule is working for me
Code:
[ {
      "cookies": null,
      "deepPattern": ".*yocoolnet\\.in/.*",
      "formPattern": null,
      "id": 1662912440941,
      "maxDecryptDepth": 1,
      "name": "coolinet.net",
      "packageNamePattern": null,
      "passwordPattern": null,
      "pattern": "https?://(.*\\.)?coolinet\\.net/.*",
      "rewriteReplaceWith": null,
      "rule": "DEEPDECRYPT",
      "enabled": true,
      "logging": false,
      "updateCookies": true
   } ]

With this rule I get all video files. Please check it.
Thank you very much!!!!
I did some tests after modifying my code at first, and it went well.

[additional question]
I tried to rename downloaded files as like this, tried both, but won't work. Any idea? I wanted keep original Chinese title name.

"packageNamePattern": "<h2>([^\\?#]+)</h2>",
"packageNamePattern": "<h2>(.*?)</h2>",

Last edited by vxvaeaw; 11.09.2022 at 23:12.
Reply With Quote
  #8  
Old 12.09.2022, 10:45
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 78,379
Default

@vxvaeaw:I'm sorry but currently it's not possible to modify/set the filename, but you can create a packagizer rule, see for example https://support.jdownloader.org/Know...me-as-filename
eg set title as packagename and then use packagizer to use it as filename too
__________________
JD-Dev & Server-Admin
Reply With Quote
  #9  
Old 12.09.2022, 11:41
vxvaeaw vxvaeaw is offline
Baby Loader
 
Join Date: Aug 2021
Posts: 8
Default

Quote:
Originally Posted by Jiaz View Post
@vxvaeaw:I'm sorry but currently it's not possible to modify/set the filename, but you can create a packagizer rule, see for example **External links are only visible to Support Staff**...
eg set title as packagename and then use packagizer to use it as filename too
It's OK. I'm learning a lot of technics from this community. Thank you
Reply With Quote
  #10  
Old 12.09.2022, 11:44
tarkett tarkett is offline
JD VIP
 
Join Date: Apr 2009
Location: Deutschland
Posts: 323
Default

@jiaz: Maybe this can be a new feature, too set also the FileName directly in a LinkCrawler rule
Reply With Quote
  #11  
Old 12.09.2022, 12:02
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,465
Default

might be possible with only one file returned, if you deep decrypt to find many, you wont want them all returning with the same filename.
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #12  
Old 12.09.2022, 12:57
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 78,379
Default

@vxvaeaw: In case you need further help with this, just let us know
__________________
JD-Dev & Server-Admin
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 10:09.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2022, Jelsoft Enterprises Ltd.