JDownloader Community - Appwork GmbH
 

Notices

Reply
 
Thread Tools Display Modes
  #1  
Old 22.08.2021, 00:15
hosa hosa is offline
Baby Loader
 
Join Date: Aug 2021
Posts: 7
Question Make JD only crawl the provided page for videos?

I use it to download vids, and not crawl any further links in a page.. when i input a page that has a video it detects other videos that are linked/suggested, thats a problem.. in technical terms, to have 0 layer crawling depth only current page ...

:outch:

[EDIT] : Message to mods: This Post has NOT been solved!

Last edited by hosa; 28.08.2021 at 18:06. Reason: This Post has NOT been solved!
Reply With Quote
  #2  
Old 22.08.2021, 02:12
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,611
Default

through linkcrawler rule?
or just add links dialog ?
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #3  
Old 23.08.2021, 00:53
hosa hosa is offline
Baby Loader
 
Join Date: Aug 2021
Posts: 7
Default Its a good thing u told me..

Quote:
Originally Posted by raztoki View Post
through linkcrawler rule?
or just add links dialog ?
That being said,
The Jdownloader user guide is just not user friendly, in regards to guiding the user (non-programmers like me) to find the desired tweak and implement it.. I also used google and DDG using keywords I have mentioned in the post, prior to posting and nothing helped..

I then saw your reply and DDG "link crawler rules" and I found a knowledge base page which explains the concept from a general perspective..


And so to make sure if I am correct, what I need to do is,:

I basically go to Advanced Settings>"LinkCrawler: Link Crawler Rules"

and just input that:

Quote:
[
{
"enabled": true,
"maxDecryptDepth": 0,
}
]

Ive probably made a few mistakes, dont hesitate to correct me..

I would also like to know how to do it via Links Dialog..

Last edited by hosa; 23.08.2021 at 01:00.
Reply With Quote
  #4  
Old 23.08.2021, 02:20
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,611
Default

Clipboard monitoring only triggers for supported content. Either dedicated plugins or link crawler rules.

In the 'add links' dialog you can select from the menu to 'deep analyse' next to the continue button there is a up arrow, deep/normal analyse. If you use deep it will either add url if its supported by plugins, if not it will scan the html for supported content. The add links function will do deep analyse by default for memory if you only add a single unsupported url and press enter or click continue.

Linkcrawler rules give the end user the ability to create url listen support for url pattern, and either deep decrypt or look for specific content. More info please check out the following support article https://support.jdownloader.org/Know...kcrawler-rules
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #5  
Old 23.08.2021, 20:47
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,919
Default

Quote:
Originally Posted by hosa View Post
That being said,
The Jdownloader user guide is just not user friendly, in regards to guiding the user (non-programmers like me) to find the desired tweak and implement it..
Which guide are you talking about?
We're always open for suggestions.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #6  
Old 24.08.2021, 05:31
hosa hosa is offline
Baby Loader
 
Join Date: Aug 2021
Posts: 7
Default This one

https://support.jdownloader.org/Knowledgebase/Article/View/what-are-linkcrawler-rules


I got irritated because this page did not show up in search engines when I looked for a solution..

Last edited by hosa; 24.08.2021 at 05:34.
Reply With Quote
  #7  
Old 24.08.2021, 13:50
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,919
Default

Thanks for your feedback.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #8  
Old 24.08.2021, 17:30
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

@hosa: your rule doesn't contain any pattern! JDownloader will just use the default deep decrypt mode and find/return everything that it finds in html.
check this as an example, https://support.jdownloader.org/Know...le-deepdecrypt
In case you need further help, best is to provide example links (either post them here or send to support@jdownloader.org) and then we can help with the rule
__________________
JD-Dev & Server-Admin
Reply With Quote
  #9  
Old 26.08.2021, 00:38
hosa hosa is offline
Baby Loader
 
Join Date: Aug 2021
Posts: 7
Question

Quote:
Originally Posted by Jiaz View Post
@hosa: your rule doesn't contain any pattern! JDownloader will just use the default deep decrypt mode and find/return everything that it finds in html.
check this as an example, **External links are only visible to Support Staff**...
In case you need further help, best is to provide example links (either post them here or send to support@jdownloader.org) and then we can help with the rule
Okay, thanks for the heads up..
I took a look at the page you provided.. concerning the pattern, I just want it to be universal, (as in applied to all links)... How do I write the rule/pattern for that..?

(I hate to admit it, but the knowledge base assumes that I would be able to handle every situation by just giving a general example.. Most people are actually clueless just like me.. )
Reply With Quote
  #10  
Old 26.08.2021, 12:41
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

Quote:
Originally Posted by hosa View Post
I took a look at the page you provided.. concerning the pattern, I just want it to be universal, (as in applied to all links)... How do I write the rule/pattern for that..?
You really DON'T want such a rule! That would mean JDownloader will request/parse EVERY URL. Imagine you copy a *add XY to amazon cart* URL into clipboard, you will never know what the website will do when you open such a link again and again
That's the reason why plugins for sites only listen on site specific patterns and not on everything you copy to clipboard! You should rules that only match on wanted sites/URLs and NOT everything!

We will help you with questions and even try to help with rules and even try to create them for you. In that case we need real working examples.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #11  
Old 28.08.2021, 17:25
hosa hosa is offline
Baby Loader
 
Join Date: Aug 2021
Posts: 7
Default

Quote:
Originally Posted by Jiaz View Post
You really DON'T want such a rule! That would mean JDownloader will request/parse EVERY URL. Imagine you copy a *add XY to amazon cart* URL into clipboard, you will never know what the website will do when you open such a link again and again
That's the reason why plugins for sites only listen on site specific patterns and not on everything you copy to clipboard! You should rules that only match on wanted sites/URLs and NOT everything!

We will help you with questions and even try to help with rules and even try to create them for you. In that case we need real working examples.
I think you understand what Im going for..
I need JDownloader to have zero link crawling depth for any and all video websites.. I do not think thats complicated.. In Addition, I never use Jdownloader in the way you mentioned!

Last edited by hosa; 28.08.2021 at 17:33.
Reply With Quote
  #12  
Old 28.08.2021, 17:32
hosa hosa is offline
Baby Loader
 
Join Date: Aug 2021
Posts: 7
Default

Why did the MODS mark this threrad as solved? this has NOT been solved!
Reply With Quote
  #13  
Old 30.08.2021, 16:31
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,919
Default

Updated thread prefix.

Not sure if a LinkCrawler Rule that simply accepts every pattern would provide the functionality you need - have you tried it?
As explained by Jiaz it is not recommended to do this and by default JD is not designed to do so.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #14  
Old 30.08.2021, 19:26
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

Quote:
Originally Posted by hosa View Post
I think you understand what Im going for..
I need JDownloader to have zero link crawling depth for any and all video websites.. I do not think thats complicated.. In Addition, I never use Jdownloader in the way you mentioned!
I'm sorry but I think you have not understood what I try to explain/warn! JDownloader by default only auto processes known URLs that are specified in the plugins in JDownloader. URLs without plugins or user created linkcrawler rules are NOT processed automatically.
With help of linkcrawler rules you can teach JDownloader to auto deep decrypt certain URL patterns but you don't want this to happen on ALL of them. Imagine you copy a *add xy to my shopping cart* URL, then JDownloader will call this URL and depending on the shop, this might in fact add something to your shopping cart. No imagine a URL that does send a message to someone or worse, buy something/send money/cancel something...There is a reason JDownloader does not auto process every URL you copy to clipboard!
Also there is no such pattern that matches on *any and all videos websites*. You should create rules specifically for your wished websites/services instead.

We can help you with that but we need example links.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #15  
Old 01.09.2021, 16:49
hosa hosa is offline
Baby Loader
 
Join Date: Aug 2021
Posts: 7
Default I See

Ah, Now I understand the nature of JDownloader

You can now mark as Solved

This thread is done..
Reply With Quote
  #16  
Old 01.09.2021, 17:07
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,919
Default

Quote:
Originally Posted by hosa View Post
You can now mark as Solved
Done.
As said you can make this work but it's a bad idea.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 17:39.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.