JDownloader Community - Appwork GmbH
 

Notices

Closed Thread
 
Thread Tools Display Modes
  #1  
Old 21.02.2016, 20:42
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default Link Crawler Rules - not work for me!

What wrong?

Code:
[ {
"enabled" : true,
"pattern" : "*.?((\d+)$)|(/page-(\d+)$)|(\?page=(\d+)\&)|(/page/(\d+)/$)|(/page(\d+)$)|(/page/(\d+)\?)|(/page(\d+)/)|(\?PageNo=(\d+))|(\?paged=(\d+))|(/page/(\d+)$)|(\?st=(\d+))|(\&s=(\d+)+)|(\&p=(\d+))|(\&cat=(\d+))|(/(\d+)+)|(\&start=(\d+)",
"rule" : "DEEPDECRYPT"
} ]
  #2  
Old 21.02.2016, 21:16
Lram32's Avatar
Lram32 Lram32 is offline
Spanish Supporter
 
Join Date: Jul 2012
Location: Dark side of the moon
Posts: 9,905
Default

Who knows.
Without example links is hard to know.
Maybe you need vacations again?
__________________
» Setup JD2 / Instalador de JD2 «
Spoiler:

Installer for Windows XP/Vista/Seven/Eight
|| JD2 x86 - x64 (Beta) ||

Installer for Mac
|| JD2 (Beta) ||

Installers for Linux
|| JD2 (Beta) x86 || <---> || JD2 (Beta) x64 ||

How to Create a Log
-» Click Here «-


¿Cómo crear un registro?
-» Click Aquí «-


Support Chat / Chat de Soporte
-» Click Here / Click Aquí «-


  #3  
Old 21.02.2016, 21:48
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

Lram32 - You have given me many bans already, maybe this time you calm down?

do not understand that this regex for each "Multipage"
  #4  
Old 21.02.2016, 21:52
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

Jiaz - In the place of the actual page number use the sub expresion (\d+).
e.g. website\.com/galleries/(*)/page(\d+).html$
  #5  
Old 22.02.2016, 01:15
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,611
Default

once again regex is wrong, * is not a wildcard its a repeat factor
period is the wildcard factor, so it should look like .*

please learn regex, please use regex testing software like regex buddy or regex testing websites like regex101.com

raztoki
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
  #6  
Old 22.02.2016, 12:03
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

https://board.jdownloader.org/showpo...10&postcount=5

and does not work for me, the rules are for me here incomprehensible.

I do not have to use RegexBuddy,
when RegEx works for me well for me!(at least in many applications or editors that I use.), but not here ....
I'm done!
  #7  
Old 22.02.2016, 12:23
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

Regex work for me but not work JD2

MINI-example:

flickr\.com/photos/(.*)/page(\d+)/\?details\=1
/t(\d+)p(\d+)\-
/Details\.aspx\?id=(\d+)&start=(\d+)
rule34\.paheal\.net/post/list/(.*)/(\d+)$
\&start=(\d+)
\&page=(\d+)$
\?page=(\d+)$
/page-(\d+)$
\?page=(\d+)\&
/page/(\d+)/$
/page(\d+)$
/page/(\d+)\?
/page(\d+)/
\?PageNo=(\d+)
\?paged=(\d+)
/page/(\d+)$
\?st=(\d+)
\&s=(\d+)+
\&p=(\d+)
\&cat=(\d+)
  #8  
Old 22.02.2016, 12:35
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

And what exactly does not work with those regex?
(\d+)+ is invalid
__________________
JD-Dev & Server-Admin
  #9  
Old 22.02.2016, 15:04
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

\?page=(\d+)\&

Invalid regex ? No , no, no, and no!
  #10  
Old 22.02.2016, 15:06
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

(\d+)+ is invalid
you talk about a complete different regex
__________________
JD-Dev & Server-Admin
  #11  
Old 22.02.2016, 15:09
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

Quote:
(\d+)+ is invalid
okay, other regex are good?
  #12  
Old 22.02.2016, 15:13
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

Jiaz - how to JOIN all the regex?

.....(regex1)|(regex2)|(regex3)

..... <== at the beginning???
  #13  
Old 22.02.2016, 15:23
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

regex is working for me, I do not know how to mix complex regex, so I asked for a "regex the Lines"


**External links are only visible to Support Staff****External links are only visible to Support Staff**
Attached Thumbnails
Screen_Shot_02_22_16_at_02_17_PM.jpg  

Last edited by raztoki; 23.02.2016 at 08:55.
  #14  
Old 22.02.2016, 15:36
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

Note: The join of thousands of regex is not easy. There may be undefined errors!!!
  #15  
Old 22.02.2016, 17:27
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,611
Default

pattern1|pattern2|pattern3

No need to use () brackets unless you need those features that brackets provide.
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
  #16  
Old 22.02.2016, 17:42
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

still not wor for me

error:is not a valid 'java.util.List<jd.controlling.LinkCrawlerRuleStorable>
  #17  
Old 22.02.2016, 17:51
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

please show the rule you try to paste
__________________
JD-Dev & Server-Admin
  #18  
Old 22.02.2016, 17:52
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

[ {
"enabled" : true,
"maxDecryptDepth" : 1,
"id" : 1454334584729,
"name" : null,
"pattern" : "/(\d+)\.cfm",
"rule" : null
} ]
  #19  
Old 22.02.2016, 17:53
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

or

[ {
"enabled" : true,
"pattern" : "/(\d+)\.cfm",
"rule" : "DEEPDECRYPT"
} ]
  #20  
Old 22.02.2016, 17:57
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

first rule, missing rule
and you need to escape \ -> \\
__________________
JD-Dev & Server-Admin
  #21  
Old 22.02.2016, 18:05
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

Code:
[ {
"enabled" : true,
"maxDecryptDepth" : 1,
"id" : 1454334584729,
"name" : null,
"pattern" : "/(\d+)\\.cfm",
"rule" : DEEPDECRYPT
} ]
  #22  
Old 22.02.2016, 18:31
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

Still do not understand what is wrong ... Enlighten me . .


**External links are only visible to Support Staff****External links are only visible to Support Staff**
Attached Thumbnails
Screen_Shot_02_22_16_at_05_25_PM.jpg  

Last edited by raztoki; 23.02.2016 at 08:56.
  #23  
Old 22.02.2016, 18:53
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

You need to enter valid JSON syntax! \ must be escaped with \\
\d becomes \\d
__________________
JD-Dev & Server-Admin
  #24  
Old 22.02.2016, 19:05
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

Quote:
Originally Posted by Jiaz View Post
You need to enter valid JSON syntax! \ must be escaped with \\
\d becomes \\d
but it still does not work:


  #25  
Old 22.02.2016, 19:09
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

Please, PLEASE check your input
"rule" : DEEPDECRYPT
is NOT
"rule" : "DEEPDECRYPT"
__________________
JD-Dev & Server-Admin
  #26  
Old 22.02.2016, 19:13
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

but here you have provided quotes

https://board.jdownloader.org/showpo...23&postcount=2


What is the difference?
  #27  
Old 22.02.2016, 19:19
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

Quote:
Originally Posted by Jiaz View Post
Please, PLEASE check your input
"rule" : DEEPDECRYPT
is NOT
"rule" : "DEEPDECRYPT"
Please see screenshot and your post. Thank your
You use
"rule" : DEEPDECRYPT

but it must be

"rule" : "DEEPDECRYPT"
__________________
JD-Dev & Server-Admin
  #28  
Old 22.02.2016, 19:23
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

Quote:
Originally Posted by Jiaz View Post

but it must be

"rule" : "DEEPDECRYPT"

but it still does not work

  #29  
Old 22.02.2016, 19:23
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

ah ... Oppppsss sorry...
  #30  
Old 22.02.2016, 19:23
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

again, your rule is missing the quotes...I guess you simply do not see them....
__________________
JD-Dev & Server-Admin
  #31  
Old 22.02.2016, 19:24
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

Work.
  #32  
Old 22.02.2016, 19:29
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

Just for your information. Would be nice to get any kind of 'thank you' in future......and you wonder why we don't want to help you......
__________________
JD-Dev & Server-Admin
  #33  
Old 22.02.2016, 19:32
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

LingrabberFilter
[x] Filename:

.*?(ico|png|gif).* (ReGex Enable)

[x]File is online if possible

===========
[ {
"enabled" : true,
"maxDecryptDepth" : 1,
"id" : 1454334584729,
"name" : null,
"pattern" : "/(\\d+)\\.cfm",
"rule" : "DEEPDECRYPT"
} ]


still decrypt PNG and GIF :(

**External links are only visible to Support Staff****External links are only visible to Support Staff**
  #34  
Old 22.02.2016, 19:38
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

I suggest you to ask in other forums where it is about RegEx.

Your requests are not any longer about JDownloader - they are about hundrets of patterns you need for your own stuff.
Closed!
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
  #35  
Old 22.02.2016, 19:45
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

your filter works perfectly fine (all gif,png are filtered)
__________________
JD-Dev & Server-Admin
  #36  
Old 22.02.2016, 19:54
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

Quote:
Originally Posted by Jiaz View Post
your filter works perfectly fine (all gif,png are filtered)
Jiaz - Thanks for your help, as always.

However, this does not always work.


**External links are only visible to Support Staff****External links are only visible to Support Staff**
Attached Thumbnails
Screen_Shot_02_22_16_at_06_48_PM.jpg  

Last edited by raztoki; 23.02.2016 at 08:55.
  #37  
Old 22.02.2016, 19:55
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

Do you have any quickfilters active? are those files online?
__________________
JD-Dev & Server-Admin
  #38  
Old 22.02.2016, 20:00
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

Quote:
Originally Posted by Jiaz View Post
are those files online?
No...

have to modify the rule, because it shows me Availability "?"
  #39  
Old 22.02.2016, 20:03
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

without linkcheck this rule does not work. If you want to make it work without linkcheck, then you have to use filetype and not filename.
__________________
JD-Dev & Server-Admin
  #40  
Old 22.02.2016, 20:14
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

Quote:
Originally Posted by Jiaz View Post
without linkcheck this rule does not work. If you want to make it work without linkcheck, then you have to use filetype and not filename.
I tried these settings, checked the action and still something is wrong, still shows PNG, GIF.


**External links are only visible to Support Staff****External links are only visible to Support Staff**
Attached Thumbnails
Screen_Shot_02_22_16_at_07_08_PM.jpg  

Last edited by raztoki; 23.02.2016 at 08:54.
Closed Thread

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 09:38.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.