JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 30.11.2017, 19:00
SAG
Guest
 
Posts: n/a
Default Uncontroller Crawling

I go to **External links are only visible to Support Staff**www.naughtyblog.org (NB). Open up a webpage of scene I want to download. Do a select all and copy. Jdownloader downloads the links I want, but then crawl a whole bunch of other pages on NB.

Example:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

On the page it lists the following:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

I have it filtered for uploaded.net only (Download contains not uploaded). It only downloads uploaded.net.

But in Jdownloader, I get more links than just
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

I also get 9 other videos. How do I stop the nine other videos from be linkgrabbed.

Per other posts, I tried:
SourceURL contains naughtyblog.org
and
SourceURL contains **External links are only visible to Support Staff**www.naughtyblog.org

It still doesn't work.
Reply With Quote
  #2  
Old 02.12.2017, 05:50
tony2long's Avatar
tony2long tony2long is offline
English Supporter
 
Join Date: Jun 2009
Posts: 6,507
Default

Instead of select all and copy, why don't you just copy the link that you want?
__________________
FAQ: How to upload a Log
Reply With Quote
  #3  
Old 02.12.2017, 11:36
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,614
Default

JD looks at the HTML behind the copy of the website, its called HTMLFlavour. You can disable this feature by disabling advanced setting 'GraphicalUserInterfaceSettings.clipboardmonitorprocesshtmlflavor'

it will mean the links you copy MUST be within written in TEXT within the <a href="LINKHERE">TXTHERE</a> or you will have to copy the URL with right click function yourself on each link.
else do as tony2long mentioned copy the selection you want vs ctrl a & ctrl c
else make your link filter rules correctly, you can test them easy enough in the rule editor
note: naughtyblog does have decrypter plugin also
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]

Last edited by raztoki; 02.12.2017 at 11:40.
Reply With Quote
  #4  
Old 04.12.2017, 12:35
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,522
Default

Quote:
Originally Posted by raztoki View Post
note: naughtyblog does have decrypter plugin also
most easiest way
__________________
JD-Dev & Server-Admin
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 15:46.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.