JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 11.10.2016, 13:24
flowlapache flowlapache is offline
DSL Light User
 
Join Date: Oct 2016
Posts: 31
Default Problem while analyse a page with jdownloader 2

Hi everyone!
I use jdownloader since years without problem and allways surprised by its power!!!

Unfortunately since the last update, when I try to analyse and find links through pages, it doesn't find anymore the links hosted on these pages!! And before it worked like a charm!!
What could I do?
Thanks alot for your help
Reply With Quote
  #2  
Old 11.10.2016, 13:43
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 76,742
Default

Please provide example links. Nothing has changed parser, so must be something with the website you are trying to parse
__________________
JD-Dev & Server-Admin
Reply With Quote
  #3  
Old 11.10.2016, 14:07
flowlapache flowlapache is offline
DSL Light User
 
Join Date: Oct 2016
Posts: 31
Default

Yes thanks, but on the pages if I select and copy links, jdownloader detect it immediately:
for example:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

It should find:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
and
**External links are only visible to Support Staff****External links are only visible to Support Staff**

but it only find images from the pages and audio files from bandcamp, I don't understand what has changed. Last time I used it it was middle of july and I don't find any changement on the website.
Reply With Quote
  #4  
Old 11.10.2016, 14:07
flowlapache flowlapache is offline
DSL Light User
 
Join Date: Oct 2016
Posts: 31
Default

**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #5  
Old 11.10.2016, 14:56
tony2long's Avatar
tony2long tony2long is offline
English Supporter
 
Join Date: Jun 2009
Posts: 6,491
Default

Have you checked page source of that link to find those 2 llinks?
I can't find it.
__________________
FAQ: How to upload a Log
Reply With Quote
  #6  
Old 11.10.2016, 17:25
flowlapache flowlapache is offline
DSL Light User
 
Join Date: Oct 2016
Posts: 31
Default

Yes, when I see the code source (with Ctrl+U on firefox), we can find these links (I found it using Ctrl+F)
On line 496 there are the 3 links:It's a huge line ! firstly Bandcamp (which is found by JD) then zippyshare and psy-music.ru (which are not found by JD).Strange!
thank you

Last edited by flowlapache; 11.10.2016 at 17:33.
Reply With Quote
  #7  
Old 11.10.2016, 19:07
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 76,742
Default

You need to add LinkCrawler Rules to tell JDownloader to auto parse this type of url.
JDownloader does not support this url and therefore does not autohandle/parse it.
With a customized LinkCrawler Rule (use board search) you can tell JDownloader how to handle this url.

You can also Copy/Paste the URL into JDownloader to force auto deep decrypt of the url
__________________
JD-Dev & Server-Admin
Reply With Quote
  #8  
Old 11.10.2016, 19:10
flowlapache flowlapache is offline
DSL Light User
 
Join Date: Oct 2016
Posts: 31
Default

Ok, I will try this "link crawler rule". But it strange because it works since 4 years at least!! Maybe they change the type of url this summer. Thank you for your quick answers and help!
Reply With Quote
  #9  
Old 11.10.2016, 19:17
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 76,742
Default

JDownloader does not support this type of url and never did.
Copy/Paste will work fine and a Linkcrawler Rule too
__________________
JD-Dev & Server-Admin
Reply With Quote
  #10  
Old 11.10.2016, 19:20
flowlapache flowlapache is offline
DSL Light User
 
Join Date: Oct 2016
Posts: 31
Default

Ok, so the website have changed without something changed for me.
When I try with deep decrypt, it doesn't find what I search for.
I'm looking for linkcrawler Rule, JD is really surprising!
Reply With Quote
  #11  
Old 11.10.2016, 19:21
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 76,742
Default

Simply copy/paste the url into JDownloader, it will deep decrypt and show all supported links.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #12  
Old 11.10.2016, 19:26
flowlapache flowlapache is offline
DSL Light User
 
Join Date: Oct 2016
Posts: 31
Default

Thats what I did, but it doesn't find the two links I would like. And I'm not sure what I should change in the linkcrawler rule. Can I create a new rule specific to this website? It seems to be allways on the line 96 with same type of codes, on every pages from this website (psy-music.ru) If I copy this line, JD find immediately what I look for!!
I don't find on other thread how to do..I see often "mail to support@..." to obtain help about making a rule for this website...

edit: I can't find how to tell JD to auto parse pages from this website. I look some other rules for specific sites but I don't understand which code I should add to linkcrawler rules....

Last edited by flowlapache; 11.10.2016 at 21:14.
Reply With Quote
  #13  
Old 11.10.2016, 22:49
flowlapache flowlapache is offline
DSL Light User
 
Join Date: Oct 2016
Posts: 31
Default

I have forgotten something important! (thanks to mgpai from JDchat)
links are not visible unless I login. That's why you didn't find links when you asked me.
I'm still trying to make a rule for linkcrawler.

For this login, it was already this since years.When I logged and had the cookie of the website, it was visible for JD.
But now no more.

I tried this, but it's not a valid rule...
Code:
[ {
  "enabled" : true,
  "name" : "psy-music",
  "pattern" : " psy-music\\.ru/news/.+/[0-9-]+ ",
  "rule" : "DEEPDECRYPT",
} ]

I will sleep, maybe tomorrow regex will be clearer...

Last edited by flowlapache; 11.10.2016 at 23:08.
Reply With Quote
  #14  
Old 12.10.2016, 00:29
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,443
Default

pattern requires protocol prefix
Code:
https?://
it shouldn't contain white space in the inside of quotation mark.

raztoki
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]

Last edited by raztoki; 12.10.2016 at 00:42.
Reply With Quote
  #15  
Old 12.10.2016, 08:40
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 76,742
Default

Quote:
Originally Posted by flowlapache View Post
Code:
[ {
  "enabled" : true,
  "name" : "psy-music",
  "pattern" : "https?://psy-music\\.ru/news/.+/[0-9-]+ ",
  "rule" : "DEEPDECRYPT",
} ]
see fixed version
__________________
JD-Dev & Server-Admin
Reply With Quote
  #16  
Old 12.10.2016, 11:11
flowlapache flowlapache is offline
DSL Light User
 
Join Date: Oct 2016
Posts: 31
Default

Ok, thanks guys, I'm learning....
I tried with this fixed version (without and with the space after the "+" in pattern) but JD doesn't accept it.
And one thing more, I have already a linkcrawler rule (I don't know where and when it comes from) for zip format:
Code:
[ {
  "enabled" : true,
  "maxDecryptDepth" : 0,
  "id" : 1476219085998,
  "name" : "psy_music",
  "pattern" : " psy-music\\.ru/news/.+/[0-9-]+ ",
  "rule" : "DEEPDECRYPT",
  "packageNamePattern" : null,
  "formPattern" : null,
  "deepPattern" : null,
  "rewriteReplaceWith" : null
} ]
I don't understand where to put my Rule for psy-music.ru? Before, After or Instead of this "zip" rule?
I tried the 3 solutions, but because it's not valid, the value doesn't change (only zip rule stays...)
Reply With Quote
  #17  
Old 12.10.2016, 11:13
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 76,742
Default

your pattern is still invalid!
it must begin with https?://

an url does not start with _(space)
__________________
JD-Dev & Server-Admin
Reply With Quote
  #18  
Old 12.10.2016, 12:21
flowlapache flowlapache is offline
DSL Light User
 
Join Date: Oct 2016
Posts: 31
Default

Sorry, it wasn't this one, I copied the (first) bad one.
I would like to show the existing one for zip format:
Code:
[ {
  "enabled" : true,
  "maxDecryptDepth" : 2,
  "id" : 1433746432948,
  "name" : "Learned file extension:zip",
  "pattern" : "(?i).*\\.zip($|\\?.*$)",
  "rule" : "DIRECTHTTP",
  "packageNamePattern" : null,
  "formPattern" : null,
  "deepPattern" : null,
  "rewriteReplaceWith" : null
} ]
Code:
[ {
  "enabled" : true,
  "name" : "psy-music",
  "pattern" : "https?://psy-music\\.ru/news/.+/[0-9-]+",
  "rule" : "DEEPDECRYPT",
} ]
still invalid but different.

And must I replace the ".zip" rule or I add it wrinting something like:
Code:
[ {
  "enabled" : true,
  "name" : "psy-music",
  "pattern" : "https?://psy-music\\.ru/news/.+/[0-9-]+",
  "rule" : "DEEPDECRYPT",
} ]
[ {
  "enabled" : true,
  "maxDecryptDepth" : 2,
  "id" : 1433746432948,
  "name" : "Learned file extension:zip",
  "pattern" : "(?i).*\\.zip($|\\?.*$)",
  "rule" : "DIRECTHTTP",
  "packageNamePattern" : null,
  "formPattern" : null,
  "deepPattern" : null,
  "rewriteReplaceWith" : null
} ]
I tried the 3 solutions, but because it's not valid, the value doesn't change (only zip rule stays...)
Reply With Quote
  #19  
Old 12.10.2016, 12:27
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 76,742
Default

[{rule1},{rule2},{rule3}]
and NOT
[{rule1}][{rule2}][{rule3}]
__________________
JD-Dev & Server-Admin
Reply With Quote
  #20  
Old 12.10.2016, 13:50
flowlapache flowlapache is offline
DSL Light User
 
Join Date: Oct 2016
Posts: 31
Default

Ok thanks! I see the importance of "," and priority of "[" and "{". I will try
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 16:23.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2022, Jelsoft Enterprises Ltd.