JDownloader Community - Appwork GmbH
 

Notices

Reply
 
Thread Tools Display Modes
  #1  
Old 01.04.2020, 02:06
rock4u9 rock4u9 is offline
I will play nice!
 
Join Date: Mar 2020
Posts: 4
Default zoig.com LinkCrawler Pattern Assistance

Hello,

I am trying to set up a LinkCrawler rule for the following URL, but it will not work. Any assistance is greatly appreciated:

Url:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Pattern:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #2  
Old 01.04.2020, 06:00
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,611
Default

and your rule that you tried is?
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #3  
Old 01.04.2020, 23:40
rock4u9 rock4u9 is offline
I will play nice!
 
Join Date: Mar 2020
Posts: 4
Default

Quote:
Originally Posted by raztoki View Post
and your rule that you tried is?
My rule looks like this:
Code:
[ {
  "enabled" : true,
  "cookies" : [ [ "xf_csrf", "censored" ] ],
  "updateCookies" : true,
  "logging" : false,
  "maxDecryptDepth" : 1000,
  "id" : 1543407812078,
  "name" : "JDownloader",
  "pattern" : "**External links are only visible to Support Staff**,
  "rule" : "DEEPDECRYPT",
  "packageNamePattern" : null,
  "passwordPattern" : null,
  "formPattern" : null,
  "deepPattern" : null,
  "rewriteReplaceWith" : null
} ]

Last edited by raztoki; 02.04.2020 at 06:14.
Reply With Quote
  #4  
Old 02.04.2020, 06:16
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,611
Default

that rule will only work for that specific category
I would advise that you escape period characters, as in regex they are single char wildcard.
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #5  
Old 04.04.2020, 05:05
rock4u9 rock4u9 is offline
I will play nice!
 
Join Date: Mar 2020
Posts: 4
Default

I updated my rule, however, it is still not pulling from the clipboard. It appears that it does not like the part after the .html: &btype=mv&btime=all

Code:
[ {
  "enabled" : true,
  "cookies" : [ [ "xf_csrf", "censored" ] ],
  "updateCookies" : true,
  "logging" : false,
  "maxDecryptDepth" : 1000,
  "id" : 1543407812078,
  "name" : "JDownloader",
  "pattern" : "**External links are only visible to Support Staff**,
  "rule" : "DEEPDECRYPT",
  "packageNamePattern" : null,
  "passwordPattern" : null,
  "formPattern" : null,
  "deepPattern" : null,
  "rewriteReplaceWith" : null
} ]

Last edited by raztoki; 04.04.2020 at 07:39.
Reply With Quote
  #6  
Old 04.04.2020, 07:36
tony2long's Avatar
tony2long tony2long is offline
English Supporter
 
Join Date: Jun 2009
Posts: 6,507
Default

Have you tried with simple pattern?
Do you want to get everything from that page?
I get redirected, so I get pictures only.
__________________
FAQ: How to upload a Log
Reply With Quote
  #7  
Old 04.04.2020, 15:59
rock4u9 rock4u9 is offline
I will play nice!
 
Join Date: Mar 2020
Posts: 4
Default

I am trying to get all the pictures in that category. However, they have views of 30 days, 60 days, and all. If I remove the last part (&btype=mv&btime=all), it will successfully run, but will not return all the pictures of the category (approx 133 pages worth).
Reply With Quote
  #8  
Old 04.04.2020, 18:35
tony2long's Avatar
tony2long tony2long is offline
English Supporter
 
Join Date: Jun 2009
Posts: 6,507
Default

You may use last part as input, but the pattern doesn't have to contain that.
Use "logging" : true, and read the LinkCrawlerRule log.
__________________
FAQ: How to upload a Log
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 23:42.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.