JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 12.01.2019, 04:05
Cody-Green Cody-Green is offline
Modem User
 
Join Date: Mar 2018
Posts: 1
Default Link Crawler for downloading media for all pages on specific thread

Hi. I've checked quite a bit on here before posting this topic but I am a bit technologically inept so I'm not sure I could modify what I have found to fit my needs.
Could someone help me create a linkcrawler rule set that would be able to catch all media (specifically jpegs, pngs and moving gifs) on all successive pages of a specific forum post?. Most of the media is linked and not embedded onto the page and they are linked from different sites as well, I would also prefer if all the media from this download could be grouped under one category like let's say the site name.
The site link is **External links are only visible to Support Staff****External links are only visible to Support Staff**
Would highly appreciate any help with this, thanks.
Reply With Quote
  #2  
Old 22.01.2019, 00:41
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 48,052
Default

Hi Cody,
there you go:
Code:
{
    "enabled": true,
    "cookies": null,
    "updateCookies": true,
    "maxDecryptDepth": 0,
    "id": 1547771712392,
    "name": "Test crawl all imgur urls from literotica.com",
    "pattern": "https?://forum\\.literotica\\.com/showthread\\.php\\?t=\\d+",
    "rule": "DEEPDECRYPT",
    "packageNamePattern": null,
    "passwordPattern": null,
    "formPattern": null,
    "deepPattern": "https?://i\\.imgur\\.com/.+",
    "rewriteReplaceWith": null
  }
Please keep in mind that this will only crawl imgur URLs from that page.
You can either extend that or just let it crawl everything it finds in the html code.

-psp-
__________________

Ad-free installers || Werbefreie Installer
Windows Setup<--JD2 BETA-->Linux Setup x86 || Linux Setup x64 || Mac Setup
-----=>Support Chat<=-----
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 14:12.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2019, Jelsoft Enterprises Ltd.