JDownloader Community - Appwork GmbH
 

Notices

Reply
 
Thread Tools Display Modes
  #1  
Old 08.05.2022, 23:14
I3ordo I3ordo is offline
Ultra Loader
 
Join Date: Mar 2022
Posts: 48
Default Limit the number of files grabbed per pasted link Link grabber filter

Hi, i found a situation where this new feature would work wonders.
This would be best fitted to the packagizer...? as it should work on grabbed files after the filtering.)

When link grabber receives a new link, If certain source url is matched and certain file type is matched, set file count limit to 1 (or 2) for that pasted link.
It should sort by alphabetical filename and decide which file is first

My situation for asking this:
A certain site, when it s link pasted, brings loads of img files , most of them are filterable as their download url is different. But the ones that i was not able to filter out to a single one comes from same path.

Normally,in other sites, i would set all the file names to "page title" and have the first one downloaded image , cancel out the preceding ones via file already exists error (intentional)
But i need the filename but not the title and of course i cant make them take the filename of the first arrived file....
Here, **External links are only visible to Support Staff****External links are only visible to Support Staff**
i filtered "/media/images/banner/" and "/media/cache/tuk_model_custom_filter_en
so that only images from url"model_new_big_en/model_images.+\/(.+)" arrives

But that link gives me 2+ images as they are extra images . others links bring more.

this feature would limit the number files to 1 per pasted link.

Last edited by I3ordo; 08.05.2022 at 23:19.
Reply With Quote
  #2  
Old 09.05.2022, 15:15
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 64,582
Default

Neither do I see us adding this feature nor do I see this working for your case.
Please describe which URLs you want.
I guess thise ones?
b2.3ddd.ru/media/cache/tuk_model_custom_filter_en/model_images/0000/0000/4174/4174740.6274ca53481de.jpeg

Please atach the filter rules you've created so far so we can find a solution on how to filter everything except the image-URLs you want to have.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #3  
Old 09.05.2022, 19:41
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,044
Default

@I3ordo: The packagizer has no knowledge/influence of/on other links.

For your case the best would be a LinkCrawler rule, see https://support.jdownloader.org/Know...kcrawler-rules and https://support.jdownloader.org/Know...le-deepdecrypt
so you tell/teach JDownloader which content/links you are interested in.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #4  
Old 10.05.2022, 11:33
I3ordo I3ordo is offline
Ultra Loader
 
Join Date: Mar 2022
Posts: 48
Default

In this case, it s currently impossible....
I was able to filter out a big percentage of unwanted images already , they had different url paths so very easy. but this is hard because they all come from same path

site.com/my_chair/ (source url)
site.com/abc/abc.123.jpg (desired image)
site.com/abc/abd.124.jpg(unwanted)
site.com/abc/abe.126.jpg(unwanted)

the abcs are all random so, i just can NOT define a general rule and tell , "dont download from "abd*" or "abe*", because those paths will become needed, just not for that pasted link....
So the only differentiator is the numerically smallest number.
Currently, i paste link, wait for all links to get grabbed, delete the numerically larger ones. until only one image is left for that pasted link, then move onto the next paste.

ofcourse, i just did it twice then gave up and instead just dragging images to an explorer folder without JD

i gave actual links btw , i just dont think it is doable with current tools.

question:
Is there paste event IDs in JD?
Maybe a script could do this:
For Paste event ID: 123#
get list of files downlaoded for that event
delete all downloaded links until count is 1, reverse numerically sorted.
pff


Or it could be:
For every source url,
delete all jpeg until file count=1
delete all rar until file count=1 ofcourse reverse numerical order...

Last edited by I3ordo; 10.05.2022 at 11:48.
Reply With Quote
  #5  
Old 10.05.2022, 12:36
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,044
Default

@I3ordo: Instead of filter out unwanted content, you should create/use Linkcrawler rules and tell JDownloader in what content/links you are interested. You create a rule that matches the site url /my_chair... and then specify a deepPattern that matches only content/links you are interested in.
In case you need help with it, just let us know but please try for yourself first.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #6  
Old 10.05.2022, 13:55
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,482
Default

I will add in a link crawler rule, you can also specify html components that are adjacent to what you're looking for instead over just a generalised pattern of url itself which is shared/reused in other locations, thus doing what Jiaz recommends and find what you want vs every url pattern.

Count wont work in my opinion as it implies the content you want will be either statically in a given position. My experience this is very rare.
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]

Last edited by pspzockerscene; 10.05.2022 at 15:10. Reason: Added linkcrawlerRule hyperlink
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 00:21.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2023, Jelsoft Enterprises Ltd.