JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 05.09.2020, 23:06
jorgemarmo jorgemarmo is offline
Modem User
 
Join Date: Apr 2019
Posts: 4
Default [Cloudflare] zt-protect.com LinkGrabber crawl 2 levels deep

Hi,
I get links from a site that lists them but when you clic, it send you to another "sub-site" that finally gives you the right link...
so if in this list I copy every link address, jD finds the download link.

So the question is: is there a way to "crawl" 2 levels deep when analyzing a link?

Thank you
Reply With Quote
  #2  
Old 07.09.2020, 18:24
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 55,183
Default

Hi,

this might be possible with a LinkCrawler rule.
Without example URL I will not be able to help you atm. ...

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #3  
Old 20.09.2020, 20:30
jorgemarmo jorgemarmo is offline
Modem User
 
Join Date: Apr 2019
Posts: 4
Default

Hi,

Here it is an example
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Best regards,
Reply With Quote
  #4  
Old 21.09.2020, 17:18
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 55,183
Default

This would easily be possible via LinkCrawler rule but it doesn't make any sense at this moment because JD will fail to crawl their zt-protect.com URLs because of Cloudflare.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #5  
Old 25.09.2020, 17:16
jorgemarmo jorgemarmo is offline
Modem User
 
Join Date: Apr 2019
Posts: 4
Default

ok, thank you very much, I get a picture of the problem with cloudfare...
and just for good sport, what would this rule look like?
Reply With Quote
  #6  
Old 25.09.2020, 17:23
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 55,183
Default

There you go here is an example rule:
Code:
[ {
  "enabled" : true,
  "updateCookies" : true,
  "logging" : false,
  "maxDecryptDepth" : 1,
  "name" : "zt-za.com example rule",
  "pattern" : "https?://zt-za\\.com/[^/]+/\\d+[a-z0-9\\-]+\\.html",
  "rule" : "DEEPDECRYPT",
  "packageNamePattern" : null,
  "passwordPattern" : null,
  "formPattern" : null,
  "deepPattern" : "href=\"(https?://zt-protect\\.com/[^\"]+)\"",
  "rewriteReplaceWith" : null
} ]
Same rule as plaintext to get around our forum URL censor:
pastebin.com/M6aQUajb

It is untested and may contain mistakes in the regular expressions.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 06:28.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.