JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 26.01.2017, 16:47
botmtl botmtl is offline
DSL User
 
Join Date: Apr 2015
Location: Montreal
Posts: 39
Default JD couldn't find any links to download on ...



Please provide a flag for this (always do deep analysis or some such) or a simple don't show again.

rationale:
If i'm pasting links in JD, then assume i'm not stupid and there is something to be found (this message does not show up unless you are pasting links (or doing analyse text with links) and the result is nothing).

More complicated to implement but awesomer:
have a customizable white list for automatic deep analysis by domains/regex in advanced options.

ps. if this is scriptable in event scripter and I missed it, I would appreciate a hint, like what is the event type for link detection.

Last edited by botmtl; 26.01.2017 at 16:50.
Reply With Quote
  #2  
Old 26.01.2017, 16:57
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,540
Default

Settings-Advanced Settings-search for Linkcrawler Rules
There you can different rules
DEEPDECRYPT=parse html for links
DIRECTHTTP= treat url as downloadable and download it
REWRITE=rewrite url
SUBMITFORM=submit a form
FOLLOWREDIRECT=follow an url

Use board search for examples for such rules. In case you need help, just contact us again.

Paste will do auto deep-decrypt for SINGLE urls only.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #3  
Old 26.01.2017, 19:12
botmtl botmtl is offline
DSL User
 
Join Date: Apr 2015
Location: Montreal
Posts: 39
Default

Thank you. I should have done a better job looking for this before asking. For future reference, here is an example of an automatic deep crawler domain:
In settings, Linkcrawler rule:

[{...rule...},{
"enabled" : true,
"maxDecryptDepth" : 0,
"name" : "Rule Name",
"pattern" : "https?://www\\.yourdomain\\.org/.*",
"rule" : "DEEPDECRYPT"
}]

Last edited by botmtl; 26.01.2017 at 20:07. Reason: changed maxdecryptdepth to 0
Reply With Quote
  #4  
Old 26.01.2017, 19:21
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,540
Default

In case you need additional help, just let me know.
I know these rules are hidden deep inside advanced settings, but because there are no graphical editors/settings yet, they are better for *advanced* users

I could also add addtional rule to specify when to allow this rule (eg always, clipboard only, paste...) Would such a rule be of any help for you?
__________________
JD-Dev & Server-Admin
Reply With Quote
  #5  
Old 26.01.2017, 20:48
botmtl botmtl is offline
DSL User
 
Join Date: Apr 2015
Location: Montreal
Posts: 39
Default

Quote:
Originally Posted by Jiaz View Post
I could also add addtional rule to specify when to allow this rule (eg always, clipboard only, paste...) Would such a rule be of any help for you?
TLDR: An option for "on paste only" would be useful to me.

I just realized the downside to this rule is that if I am on the site and copy the whole page, then I don't want it to deepcrawl - the links I want are in the clipboard already and I don't want it to look further.

If I am on another domain, say google custom search, and I copy a bunch of links, then I do want it to deepcrawl-0.

I tried to rewrite the regex to pick up only the links that I need but it can't be done. There are some links that match the most precise regex I can come up with and deepcrawling those ever changing links find results I was not interested in.

Other ideas:
Would a condition like "is holding ctrl" to allow/disalow the rule be implemented easily? That would rock even more than "on paste only".
Reply With Quote
  #6  
Old 26.01.2017, 20:53
botmtl botmtl is offline
DSL User
 
Join Date: Apr 2015
Location: Montreal
Posts: 39
Default

Replying to my own post - the initial problem is really only a minor annoyance, I'll let you decide if it's worth making the system more complex for an annoyance.

Honestly what I really need is a guide on how to setup a forms authentication proxy (cookies is fine, not oauth). It's well outside JD's realm.
Reply With Quote
  #7  
Old 27.01.2017, 10:28
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,540
Default


I've created ticket about two new features. check for origin(clipboard, paste...) and check for source (where does the link come from...)
__________________
JD-Dev & Server-Admin
Reply With Quote
  #8  
Old 27.01.2017, 10:29
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,540
Default

Quote:
Originally Posted by botmtl View Post
Honestly what I really need is a guide on how to setup a forms authentication proxy (cookies is fine, not oauth). It's well outside JD's realm.
You need JDownloader to fill out some forms or login somewhere?
I can provide better help if you can send me some example links, send them to support@jdownloader.org
__________________
JD-Dev & Server-Admin
Reply With Quote
  #9  
Old 27.01.2017, 10:30
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,540
Default

Quote:
Originally Posted by botmtl View Post
Would a condition like "is holding ctrl" to allow/disalow the rule be implemented easily? That would rock even more than "on paste only".
As CTRL is part of Copy/Paste Shortcuts, not that easy to do
__________________
JD-Dev & Server-Admin
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 13:24.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.