JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 10.09.2023, 13:50
AD-TEAM AD-TEAM is offline
JD Alpha
 
Join Date: Nov 2019
Posts: 24
Default Redirect crawl via LinkCrawler Rule

Hello Friends
i have this link
Code:
**External links are only visible to Support Staff**
redirect to .
Code:
**External links are only visible to Support Staff**
is there any method or script for JD to download the result link from redirect
mean wen i copy first link JD redirect automatic and download the second link

Thanks
Reply With Quote
  #2  
Old 10.09.2023, 15:12
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,627
Default

The problem isn't the second link, its the first. The second for memory is listened to/for.
The first link isn't and you just need to add a linkcrawler redirect rule, please see https://support.jdownloader.org/Know...lowredirect/22

raztoki
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #3  
Old 10.09.2023, 18:12
AD-TEAM AD-TEAM is offline
JD Alpha
 
Join Date: Nov 2019
Posts: 24
Default

Hello Bro
i found this rules :
Code:
[
 {
  "cookies"            : null,
  "deepPattern"        : null,
  "formPattern"        : null,
  "id"                 : 1681420281530,
  "maxDecryptDepth"    : 0,
  "name"               : "Learned file extension: epub",
  "packageNamePattern" : null,
  "passwordPattern"    : null,
  "pattern"            : "(?i)https?://.*\\.epub($|\\?.*$)",
  "rewriteReplaceWith" : null,
  "rule"               : "DIRECTHTTP",
  "enabled"            : true,
  "logging"            : false,
  "updateCookies"      : false
 },
 {
  "cookies"            : null,
  "deepPattern"        : null,
  "formPattern"        : null,
  "id"                 : 1688081601422,
  "maxDecryptDepth"    : 0,
  "name"               : "Learned file extension: gz",
  "packageNamePattern" : null,
  "passwordPattern"    : null,
  "pattern"            : "(?i)https?://.*\\.gz($|\\?.*$)",
  "rewriteReplaceWith" : null,
  "rule"               : "DIRECTHTTP",
  "enabled"            : true,
  "logging"            : false,
  "updateCookies"      : false
 }
]
for my question i add this
Code:
[
  {
    "enabled": true,
    "name": "example rule for LinkCrawler type FOLLOWREDIRECT",
    "pattern": "https?://magazinelib\.com/[A-Za-z0-9]+",
    "rule": "FOLLOWREDIRECT"
  }
]
or i remove all and keep only last rule?
thanks for help Bro

Last edited by AD-TEAM; 10.09.2023 at 18:24.
Reply With Quote
  #4  
Old 11.09.2023, 01:31
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,627
Default

You can keep the first two if you use them, just add another ", { inserted rule }" and
you will need to adjust the pattern for your domain and url structure.
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #5  
Old 29.09.2023, 12:26
AD-TEAM AD-TEAM is offline
JD Alpha
 
Join Date: Nov 2019
Posts: 24
Default

thanks work perfectly
Reply With Quote
  #6  
Old 29.09.2023, 12:43
AD-TEAM AD-TEAM is offline
JD Alpha
 
Join Date: Nov 2019
Posts: 24
Default

also for this
Code:
**External links are only visible to Support Staff**
i did this
,
{
"enabled": true,
"name": "example rule for LinkCrawler type FOLLOWREDIRECT",
"pattern": "https?://theebookhunter\\.com/d\?[A-Za-z0-9_-]+",
"rule": "FOLLOWREDIRECT"
}

but not work can you help
Thnaks
Reply With Quote
  #7  
Old 29.09.2023, 15:12
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,627
Default

double escape the \\? and you're missing = after question mark. test your pattern at regex101 then add additional escaping in for json (if required)
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #8  
Old 29.09.2023, 15:54
AD-TEAM AD-TEAM is offline
JD Alpha
 
Join Date: Nov 2019
Posts: 24
Default

i did this
Code:
,
 {
  "cookies"            : null,
  "deepPattern"        : null,
  "formPattern"        : null,
  "id"                 : 1695991268354,
  "maxDecryptDepth"    : 0,
  "name"               : "example rule for LinkCrawler type FOLLOWREDIRECT",
  "packageNamePattern" : null,
  "passwordPattern"    : null,
  "pattern"            : "https?://theebookhunter\\.com/d\\?=[A-Za-z0-9_-]+",
  "rewriteReplaceWith" : null,
  "rule"               : "FOLLOWREDIRECT",
  "enabled"            : true,
  "logging"            : false,
  "updateCookies"      : false
 }
for this links
Code:
**External links are only visible to Support Staff**
not work
manually it work
Reply With Quote
  #9  
Old 05.10.2023, 16:11
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 69,719
Default

It's not working because that link simply redirects to website "ebookhunter.net" (main page).

Maybe cookies or a specific referer is missing?
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?


-----------------------------------
On Vacation / Im Urlaub
Start: 2023-12-09
End: TBA
Reply With Quote
  #10  
Old 07.10.2023, 00:11
AD-TEAM AD-TEAM is offline
JD Alpha
 
Join Date: Nov 2019
Posts: 24
Default

Here the source page
download link are down
Code:
**External links are only visible to Support Staff**
Reply With Quote
  #11  
Old 07.10.2023, 12:25
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 69,719
Default

I see multiple mistakes here:
1. Regex does not allow "www." at the beginning of those URLs.
2. Domain "ebookhunter.net" is missing.
3. Referer is needed to make those "redirect URLs" work so a 2nd rule is needed as you cannot (yet) specify a referer in such a rule.

Rule I made:
Code:
[
  {
    "maxDecryptDepth": 0,
    "name": "redirect rule for website theebookhunter.com",
    "pattern": "https?://(www\\.)?(theebookhunter\\.com|ebookhunter\\.net)/d\\?=[A-Za-z0-9_-]+",
    "rule": "FOLLOWREDIRECT",
    "enabled": true,
    "logging": true,
    "updateCookies": false
  },
  {
    "enabled": true,
    "logging": false,
    "maxDecryptDepth": 1,
    "name": "deepdecrypt rule for website theebookhunter.com",
    "pattern": "https?://(www\\.)?(theebookhunter\\.com|ebookhunter\\.net)/[a-z0-9_-]+/",
    "rule": "DEEPDECRYPT",
    "packageNamePattern": null,
    "deepPattern": "(//(theebookhunter\\.com|ebookhunter\\.net)/d\\?=[A-Za-z0-9_-]+)"
  }
]
Pastebin:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Then after all that it still doesn't work because of a possible bug or design-flaw in our "FOLLOWREDIRECT" handling.
Ticket:
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?


-----------------------------------
On Vacation / Im Urlaub
Start: 2023-12-09
End: TBA
Reply With Quote
  #12  
Old 07.10.2023, 18:43
AD-TEAM AD-TEAM is offline
JD Alpha
 
Join Date: Nov 2019
Posts: 24
Default

thanks for help bro
waiting for this fix asap
Reply With Quote
  #13  
Old 07.10.2023, 19:23
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 69,719
Default

Quote:
Originally Posted by AD-TEAM View Post
waiting for this fix asap
There will be no "asap" fix.

This will most likely never be addressed -> I recommend looking for alternative [browser based] solutions

Sure you can also address it yourself as JD is open source:
https://support.jdownloader.org/Know...up-ide-eclipse
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?


-----------------------------------
On Vacation / Im Urlaub
Start: 2023-12-09
End: TBA
Reply With Quote
  #14  
Old 08.10.2023, 15:19
AD-TEAM AD-TEAM is offline
JD Alpha
 
Join Date: Nov 2019
Posts: 24
Default

ok bro thanks
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 07:55.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2023, Jelsoft Enterprises Ltd.