JDownloader Community - Appwork GmbH
 

Go Back   JDownloader Community - Appwork GmbH > English Support > General Discussion
Reply
 
Thread Tools Display Modes
  #1  
Old 06.11.2010, 15:12
whismerhill
Guest
 
Posts: n/a
Default [Link Filtering]RegEx help

I would like to use Flashgot - Download them all, function more efficiently

Currently when using this I get hundreds of unnecessary things to delete manually.

Hence I thought about filtering out filetypes
but it does not seem to work like I thought it would
some still get through plus some particular cases might cause problem (like ".something.htm" file links)

so I'm thinking about another way to filter out unused stuff

I'm thinking about negative domain filtering
instead of blacklisting example.com
I would instead whitelist example.com so that anything not from example.com will get filtered

the end project would be to do a huge filter for every supported/meaningful host.

here's another way to say it :
IF link DOES NOT CONTAIN rapidshare.com OR megaupload.com OR ...
THEN delete the link
ELSE continue

Is it possible to do that at all ?
Thanks.
Reply With Quote
  #2  
Old 06.11.2010, 15:26
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,120
Default

@whismerhill
I think the problem you have is that you get unwanted image-links or so.
By disabeling the "http plugins" plugin in Settings->Hoster you won't ever see those links again

GreeZ pspzockerscene
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #3  
Old 06.11.2010, 15:33
remi
Guest
 
Posts: n/a
Default

@whismerhill

I think your request is perfectly valid.

In short, you want to exclude all links that don't belong to a few preselected hosts.
Reply With Quote
  #4  
Old 06.11.2010, 17:42
whismerhill
Guest
 
Posts: n/a
Default

Quote:
Originally Posted by pspzockerscene View Post
@whismerhill
I think the problem you have is that you get unwanted image-links or so.
By disabeling the "http plugins" plugin in Settings->Hoster you won't ever see those links again

GreeZ pspzockerscene
yeah images and also php documents & http documents

I tried that without much success so I disabled directhttp too
but there's still a lot of them who appear in the link grabber (waited enough time for Jdownloader to get through the whole bunch of links)
I was using the nightly though, so tomorrow I'll reset it to normal to see if that changes anything
Thanks for replying in any case.

@remi
yes exactly
I understand regex a little bit, but not enough to do that it seems
hence the post, to gather some tips or links
Reply With Quote
  #5  
Old 07.11.2010, 09:55
drbits's Avatar
drbits drbits is offline
JD English Support (inactive)
 
Join Date: Sep 2009
Location: Physically in Los Angeles, CA, USA
Posts: 4,434
Default

These examples might help:
Code:
# ignore these extensions
.+?\.php
.+?\.gif
.+?\.png
.+?\.htm[l]?

# the next lines define a collection in the [] brackets, but it is optional (?) so it matches jpeg or jpg.
#eliminate most thumbnails
.*?/tm\_.*?\.jp[e]?g
.*?/th\_.*?\.jp[e]?g
.*?\_thumb.*?\.jp[e]?g

# ignore imdb.com
.*?imdb\.com.*?
#ignore these sites also
.*?imagebam\.com.*?
.*?imagevenue\.com.*?
.*?tubenow\.net.*?
.*?picturetrail\.com.*?
.*?nedds.pl\/img.*?
.*?tinypic\.com.*?
.*?stooorage\.com.*?
They are all filters I have used for selecting whole pages and then using Ctrl+C to copy the links.

Note: The next version of JD will allow you to copy Live Links with Ctrl+C, so you will rarely have to actually use FlashGot.
Reply With Quote
  #6  
Old 07.11.2010, 10:06
remi
Guest
 
Posts: n/a
Cool

I'm amazed that nobody seems to understand whismerhill's request.

@whismerhill
Please, post it in the dreams and wishes forum or wait for a mod to move it there, because it can't be done with today's jD.
Reply With Quote
  #7  
Old 07.11.2010, 10:53
drbits's Avatar
drbits drbits is offline
JD English Support (inactive)
 
Join Date: Sep 2009
Location: Physically in Los Angeles, CA, USA
Posts: 4,434
Default

@ remi,
I submitted a feature request similar to whismerhill's needs months ago.

I was showing how to do the tasks with the current elimination filter.
Reply With Quote
  #8  
Old 07.11.2010, 11:48
remi
Guest
 
Posts: n/a
Default

Is it ?

When I read Jiaz' comment he writes about "enabled/disabled". Does he mean that he wants to reverse the filter mechanism, i.e., instead of eliminating links, also selecting links?
Reply With Quote
  #9  
Old 12.11.2010, 17:17
whismerhill
Guest
 
Posts: n/a
Default

the link filter never really did what I expected of him even with the exact code example that drbits gave
I'm not sure but I think the link filter might just put files as if they were offline in the link grabber ... not quite what I expected

anyway I found a workaround to using flashgot to do that
I know use the "copy links" extension which allows to copy selected or all links of a webpage
Reply With Quote
  #10  
Old 14.11.2010, 11:39
drbits's Avatar
drbits drbits is offline
JD English Support (inactive)
 
Join Date: Sep 2009
Location: Physically in Los Angeles, CA, USA
Posts: 4,434
Default

I see part of the problem. The filters I supplied are for Linkgrabber, not for FlashGot. Usually, LinkGrabber gets its input from the Clipboard (Copy and Paste).

There is a JD plugin into FlashGot that causes FlashGot to send specially formatted information to port 9666 (the same port as CNL). This information skips most of the Linkgrabber processing.

Because of changes in Firefox and enhancements in JDownloader, it is not clear whether FlashGot will be necessary for the next version of JD.
Reply With Quote
Reply


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 16:34.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.