JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 04.04.2020, 22:50
bengalih bengalih is offline
Vacuum Cleaner
 
Join Date: Jan 2017
Posts: 16
Default Help with Linkgrabber Filter format

I'm trying to filter out all but the 720p stream here.
I can't figure out any type of link grabber format that works.
I don't know if the parentheses are causing an issue or not, but even searching just for the term "720" doesn't seem to work, or a regex just for those characters.

I must be missing something, can someone give me a workable filter?

thanks

**External links are only visible to Support Staff****External links are only visible to Support Staff**
linkfilter.png

EDIT: For some reason I can't view my own attachment when clicked on it, nor can anyone apparently see external links. Not sure if others will have the issue seeing my attachment. But here is an example of what I need to filter:

rAnhOKUm-31810271.mp4 (180p_aac).mp4
rAnhOKUm-31810271.mp4 (270p_aac).mp4
rAnhOKUm-31810271.mp4 (720p_aac).mp4

I need only the 720p...the others should be filtered.

thanks

Last edited by raztoki; 05.04.2020 at 06:07.
Reply With Quote
  #2  
Old 05.04.2020, 03:49
bengalih bengalih is offline
Vacuum Cleaner
 
Join Date: Jan 2017
Posts: 16
Default

For instance if I set the filter to :

Filename - CONTAINS - .*\(720p_aac\).*

Then it filters my 720p link out. That is to be expected. I however want the opposite, so I use:

Filename - NOT CONTAINS - .*\(720p_aac\).*

However it then filter ALL links out, including my 720p one.

I'm not sure if I don't have right RegEx, or if there is a bug somewhere.

thanks
Reply With Quote
  #3  
Old 05.04.2020, 05:28
tony2long's Avatar
tony2long tony2long is offline
English Supporter
 
Join Date: Jun 2009
Posts: 6,381
Default

Please provide example links.
__________________
FAQ: How to upload a Log
Reply With Quote
  #4  
Old 05.04.2020, 05:50
bengalih bengalih is offline
Vacuum Cleaner
 
Join Date: Jan 2017
Posts: 16
Default

Quote:
Originally Posted by tony2long View Post
Please provide example links.
The links are m3u8 files, so the filename is not the link itself.
TBH I'm not 100% sure how the m3u8 is parsed to get the individual video.

The following link for instance:

**External links are only visible to Support Staff****External links are only visible to Support Staff**

Will find 4 mp4 files of varying resolutuions and name them as such.
Additionally it finds one m4a stream.

As I mention above my example works when choosing a regex to CONTAIN the 720p string. It filters out just that one link. However if I tell it to NOT Contain it then filters out all 5, including the one that contains that expression.

thanks
Reply With Quote
  #5  
Old 05.04.2020, 06:23
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,196
Default

have you made sure the regex checkbox is checked ?
rule should work as intended, do you have example url your testing with please?
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #6  
Old 05.04.2020, 06:26
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,196
Default

sorry i wrote that message an hour or more ago and didnt post, in the mean time newer posts

I was not able to add that link to my JD all offline for me, so session or ip restricted maybe.

we have a decrypter plugin to parse m3u8 files to return all the formats within.
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #7  
Old 05.04.2020, 06:54
bengalih bengalih is offline
Vacuum Cleaner
 
Join Date: Jan 2017
Posts: 16
Default

Quote:
Originally Posted by raztoki View Post
have you made sure the regex checkbox is checked ?
rule should work as intended, do you have example url your testing with please?

These are from the preview pane in dev tools, perhaps you can add them or it will provide more insight?:

Code:
#EXTM3U
#EXT-X-STREAM-INF:PROGRAM-ID=1,BANDWIDTH=470000,RESOLUTION=480x270,CODECS="mp4a.40.2,avc1.77.30",CLOSED-CAPTIONS=NONE
https://videos-a.jwpsrv.com/content/conversions/YdK0fumR/videos/BPloViAu-31810272.mp4.m3u8?hdnts=exp=1586072606~acl=*/BPloViAu-31810272.mp4.m3u8~hmac=0060bcb8ece4a28ae26c654132ed444452a8a95f85fa75454065187c2baeb603
#EXT-X-STREAM-INF:PROGRAM-ID=1,BANDWIDTH=1190000,RESOLUTION=1280x720,CODECS="mp4a.40.2,avc1.77.30",CLOSED-CAPTIONS=NONE
https://videos-a.jwpsrv.com/content/conversions/YdK0fumR/videos/BPloViAu-31810274.mp4.m3u8?hdnts=exp=1586072606~acl=*/BPloViAu-31810274.mp4.m3u8~hmac=38cf72f3d223678c7324c8841d4ed07517d7fd54d56af4682dcb0b579851059b
#EXT-X-STREAM-INF:PROGRAM-ID=1,BANDWIDTH=580000,RESOLUTION=720x406,CODECS="mp4a.40.2,avc1.77.30",CLOSED-CAPTIONS=NONE
https://videos-a.jwpsrv.com/content/conversions/YdK0fumR/videos/BPloViAu-31810273.mp4.m3u8?hdnts=exp=1586072606~acl=*/BPloViAu-31810273.mp4.m3u8~hmac=639f887a0c7a379aeabdcd5a97d92ef42feeb86d48a6da8b6a2028a8dcbbb1ea
#EXT-X-STREAM-INF:PROGRAM-ID=1,BANDWIDTH=330000,RESOLUTION=320x180,CODECS="mp4a.40.2,avc1.77.30",CLOSED-CAPTIONS=NONE
https://videos-a.jwpsrv.com/content/conversions/YdK0fumR/videos/BPloViAu-31810271.mp4.m3u8?hdnts=exp=1586072606~acl=*/BPloViAu-31810271.mp4.m3u8~hmac=6c78ed833a44a75676ec7101a4a7c00b8385c57da06695c4ac78afcdf25d907d
#EXT-X-STREAM-INF:PROGRAM-ID=1,BANDWIDTH=120000,CODECS="mp4a.40.2"
**External links are only visible to Support Staff**
You can try with any of the videos from here:

**External links are only visible to Support Staff****External links are only visible to Support Staff**

Yes, regex is on. Again, I can filter just the 720 with that entry, but if I reverse the logic they all get filtered.

Thanks for your assistance.
Reply With Quote
  #8  
Old 05.04.2020, 13:08
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,196
Default

doing more testing seems to be related to m3u8; Tested links without hls stuff, and works fine. I dont think its hls but decrypter>hoster linkechecking and the filtering.

there is something directly broken, im not every fast looking on this macbook.
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #9  
Old 05.04.2020, 13:23
mgpai mgpai is offline
Script Master
 
Join Date: Sep 2013
Posts: 939
Default

Quote:
Originally Posted by bengalih View Post
... if I tell it to NOT Contain it then filters out all 5, including the one that contains that expression.
Try enabling the following condition in the filter rule:
Code:
File : is : online - Download is possible
Reply With Quote
  #10  
Old 05.04.2020, 13:37
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,196
Default

@mgpai I did test with that condition, it really shouldn't matter as with field disabled it should test against all conditions (online|offline|unknown).

Just double checked and its still bork.
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #11  
Old 05.04.2020, 13:51
mgpai mgpai is offline
Script Master
 
Join Date: Sep 2013
Posts: 939
Default

Quote:
Originally Posted by raztoki View Post
@mgpai I did test with that condition, it really shouldn't matter as with field disabled it should test against all conditions (online|offline|unknown).

Just double checked and its still bork.
Works fine here at least. I posted it only after checking.
Reply With Quote
  #12  
Old 05.04.2020, 14:59
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,196
Default

hmm strange, i see a fault in one of my tests i had closing ) in the wrong place
the online/offline/unknown condition is the fault btw

@bengalih
change "(720p)" to "(720p" since there is a space and audio kbits component next (i didnt use regex) and put a file is online condition until the bug is fixed.
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]

Last edited by raztoki; 05.04.2020 at 16:57.
Reply With Quote
  #13  
Old 05.04.2020, 18:42
bengalih bengalih is offline
Vacuum Cleaner
 
Join Date: Jan 2017
Posts: 16
Default

Thanks, I did the following tests:

When turning on File is ONLINE, all the following work:

With RegEx
Code:
720p
.*720p.*
^[a-zA-Z]{8}-[0-9]{8}.mp4 \(720p_aac\).mp4
Without RegEx
Code:
720p
With File checking online/offline not enabled none of the above work. So it does seem to be something related to that. Is this something you will be filing a bug on?

Also, just to reiterate for completeness: The inverse filter does work without enabling the file checking. If I say to filter links that CONTAIN the 720p patterns those links DO get filtered out.

thanks.
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 18:33.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.