JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 27.01.2023, 09:41
Ronny88 Ronny88 is offline
Linkgrabbing Monster
 
Join Date: Oct 2014
Posts: 82
Default [LinkCrawler Rule] Unusualporn.net site

Hi, could you help me create a crawler rule to fetch filesmonster links from this site?
**External links are only visible to Support Staff****External links are only visible to Support Staff**
The examples links are as follows:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
Inside every page there is a link to filesmonster.
Currently JD catches every link and filesmonster links are repeated 6 times.
A thousand thanks.
Reply With Quote
  #2  
Old 27.01.2023, 16:05
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,088
Default

Hi again Ronny88,
In the past I've already helped you a few times to create LinkCrawler rules for other websites.
Please keep in mind that this is a feature which is supposed to be understood- and used by the user and the intention behind it is not to ask us every time you need a new rule for website XY.
I urge you to learn the basics of regular expression and read the following article so you can create your own LinkCrawler Rules:
https://support.jdownloader.org/Know...kcrawler-rules
More about LinkCrawler rules:
https://support.jdownloader.org/Know...kcrawler-rules

Nevertheless we're here to help so here is a rule which might do the job:
Code:
[
  {
    "enabled": true,
    "logging": true,
    "maxDecryptDepth": 1,
    "name": "unusualporn.net find all filesmonster.com links",
    "pattern": "https?://unusualporn\\.net/[a-z0-9\\-]+",
    "rule": "DEEPDECRYPT",
    "packageNamePattern": null,
    "deepPattern": "(https?://filesmonster\\.com/download\\.php\\?id=[A-Za-z0-9_-]+)"
  }
]
Rule as plaintext for easier copy & paste:
pastebin.com/raw/FxPZTMuG

Please keep in mind that that website seems to be very slow so as long as that's the case, JDownloader might run into timeouts.
If this doesn't work or does not work in a stable way, please check out the following article:
https://support.jdownloader.org/Know...orted-websites

Quote:
Originally Posted by Ronny88 View Post
Currently JD catches every link and filesmonster links are repeated 6 times.
I'm unable to reproduce this problem.

Please post your log-ID here | bitte poste deine Log-ID hier.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 20.10.2023 at 13:27. Reason: Fixed missing escape sequence for char "?"
Reply With Quote
  #3  
Old 20.10.2023, 12:50
Ronny88 Ronny88 is offline
Linkgrabbing Monster
 
Join Date: Oct 2014
Posts: 82
Default

Hi, Link Crawler doesn't work anymore. JD grabs many links. But the site is not changed.
I have tried to modify the rule again but nothing. I don't know why.
Could you please check it?
Thank you very much.
Reply With Quote
  #4  
Old 20.10.2023, 13:10
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,088
Default

Please post your attempt to change the rule here and provide fresh example URLs.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #5  
Old 20.10.2023, 13:28
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,088
Default

Inside the "deepPattern" there was an escape sequence missing in front of "?".

I've corrected this and updated my post #2 in this thread.
The changed rule is working fine here.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 18:36.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.