JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 05.06.2021, 09:11
ronaldron ronaldron is offline
Junior Loader
 
Join Date: Apr 2020
Posts: 10
Default Stop Linkcrawler after a certain link pattern is found

Hey!

I'm using a LinkCrawler rule to find videos from private.com which doesn't have a plugin. For example this link:

**External links are only visible to Support Staff****External links are only visible to Support Staff**

with maxDecryptDepth 0 will find a bunch of small files and the videos I want to download, namely something like

**External links are only visible to Support Staff****External links are only visible to Support Staff** (+ a bunch of url params)

I have a packagizer rule that auto starts those 720p files and a filter rule to remove all the other files, but was wondering if it is possible to have the option to also stop the linkcrawling after I found a file or link that matches my pattern (in this case anything ending with 720p.mp4). Otherwise Linkgrabber keeps running for that one link for multiple minutes.

Alternatively if you can provide a plugin for private.com that works as well of course but curious about a way for linkgrabber to stop at a defined point as described above for use cases in the future
Reply With Quote
  #2  
Old 07.06.2021, 12:09
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 82,247
Default

@ronaldron:
you should use more specific pattern in your rule to ONLY add those links that you are interested in, see https://support.jdownloader.org/Know...le-deepdecrypt
https://support.jdownloader.org/Know...kcrawler-rules

If you need help with this, please show your current linkcrawler rule (remove the cookies from it if there are any)
__________________
JD-Dev & Server-Admin
Reply With Quote
  #3  
Old 07.06.2021, 12:10
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 82,247
Default

Quote:
Originally Posted by ronaldron View Post
Alternatively if you can provide a plugin for private.com that works as well of course but curious about a way for linkgrabber to stop at a defined point as described above for use cases in the future
We can check for possible support. Please send username/password to support@jdownloader.org
__________________
JD-Dev & Server-Admin
Reply With Quote
  #4  
Old 08.06.2021, 07:22
ronaldron ronaldron is offline
Junior Loader
 
Join Date: Apr 2020
Posts: 10
Default

Oh I see, so Linkcrawler will only fetch links that match deepPattern?

Is that strictly faster than what I'm doing right now with deepPattern null and a filter rule?
Reply With Quote
  #5  
Old 08.06.2021, 10:49
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 82,247
Default

Quote:
Originally Posted by ronaldron View Post
Oh I see, so Linkcrawler will only fetch links that match deepPattern?
Correct, with deepPattern set, it will only find/process those matching URLs


Quote:
Originally Posted by ronaldron View Post
Is that strictly faster than what I'm doing right now with deepPattern null and a filter rule?
Yes, it should be as JDownloader only processes the URLs that you are interested in and not every image/thumbnail/css/js....file found in html source
__________________
JD-Dev & Server-Admin
Reply With Quote
  #6  
Old 08.06.2021, 23:59
ronaldron ronaldron is offline
Junior Loader
 
Join Date: Apr 2020
Posts: 10
Default

Makes sense will it give a try then, thanks!

Can close this thread for now then!
Reply With Quote
  #7  
Old 09.06.2021, 09:29
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 82,247
Default

Just ask for help if you need help
__________________
JD-Dev & Server-Admin
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 22:33.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.