JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 27.11.2017, 20:44
sacca_guy sacca_guy is offline
Modem User
 
Join Date: Nov 2017
Posts: 2
Default Prevent Crawling

Hello,

I go to a website that has a bunch of links to uploaded.net, rapidgator and so on. I do a select all and copy. The link grabber grabs all the download on that page, but then it starts crawling. I want to prevent it from ever crawling (like in JDownloader 0.9). Can anyone tell me how to prevent crawling?

Thanks

PS - I tried searching for an answer the last couple of hours, but couldn't figure it out.
Reply With Quote
  #2  
Old 27.11.2017, 20:55
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 62,525
Default

Settings-Filter-setup rules what to filter
Use SourceURL contains to prevent any crawling activity on matches
__________________
JD-Dev & Server-Admin
Reply With Quote
  #3  
Old 27.11.2017, 21:48
sacca_guy sacca_guy is offline
Modem User
 
Join Date: Nov 2017
Posts: 2
Default

Thanks Jiaz. I read that earlier, but I still can't seem to figure it out. What variable did you put into the field?
Reply With Quote
  #4  
Old 28.11.2017, 09:07
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 62,525
Default

For example you want to filter out test.com urls
Settings-Filter-create new filter
Code:
SourceURL contains test.com
for multiple urls you can either create multiple rules or use regex

Code:
SourceURL contains .*(test\.com|example\.net|google\.com).*
and enable the regex checkbox on the right side
If you need further help, don't hesitate and ask
__________________
JD-Dev & Server-Admin

Last edited by raztoki; 28.11.2017 at 09:57. Reason: regex . should contain escaping
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 17:43.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2019, Jelsoft Enterprises Ltd.