#1
|
||||
|
||||
[LinkCrawler Rule] musify.club needs fix
Links shown as dead. Also album based grabbing would be very useful.
14.09.21 13.53.13 <--> 14.09.21 13.53.55 jdlog://9387825302851/ Albums: **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** Tracks: **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** |
#2
|
||||
|
||||
Hi,
we do not havew a plugin for this website. Your mp3 direct-URLs are working just fine here. For the "/release/" URLs, you can simply create a LinkCrawler rule to grab the direct .mp3 URLs. A plugin for this simple website is not required. Let us know if you need help creating a Link Crawler Rule for this website. -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#3
|
||||
|
||||
musify.club needs fix
Links shown as dead. Also album based grabbing would be very useful.
14.09.21 13.53.13 <--> 14.09.21 13.53.55 jdlog://0000000000000/ Albums: **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** Tracks: **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** |
#4
|
||||
|
||||
@tunayx
Merged duplicated threads and moved them into the correct subforum. Please read my last post! - I'm unable to reproduce your issue - We do not have a plugin for this website -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#5
|
||||
|
||||
I created script for tracks but need help about grab an album and creating album & artist - album name based on the source url.
**External links are only visible to Support Staff****External links are only visible to Support Staff** Package should be named as: Jan Garbarek - Star (1991) Source url: **External links are only visible to Support Staff****External links are only visible to Support Staff** not grabbing anything. |
#6
|
||||
|
||||
Here is a simple LinkCrawler Rule that does just what you want:
Code:
[ { "enabled": true, "updateCookies": true, "logging": false, "maxDecryptDepth": 1, "name": "example rule for musify.club", "pattern": "**External links are only visible to Support Staff**, "rule": "DEEPDECRYPT", "packageNamePattern": "<h1>(.*?)</h1>", "deepPattern": "(/track/play/[0-9]+/[^/]+\\.mp3)" } ] pastebin.com/raw/6UmrmPjC -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#7
|
||||
|
||||
I copied and saved to text file then import it from packagizer by modifying **External links are only visible to Support Staff** with **External links are only visible to Support Staff****External links are only visible to Support Staff**
[ { "enabled": true, "updateCookies": true, "logging": false, "maxDecryptDepth": 1, "name": "musify album", "pattern": "**External links are only visible to Support Staff** "rule": "DEEPDECRYPT", "packageNamePattern": "<h1>(.*?)</h1>", "deepPattern": "(/track/play/[0-9]+/[^/]+\\.mp3)" } ] I get this screen during import: Last edited by tunayx; 14.09.2021 at 14:55. |
#8
|
||||
|
||||
This is not a Packagizer rule!
As stated in my other posts and also linked (HERE again), that is a Link Crawler Rule. The linked article explains how to create and use such rules. -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download Last edited by pspzockerscene; 14.09.2021 at 15:03. |
#9
|
||||
|
||||
Tried grabbing an album but nothing grabbed.
14.09.21 16.23.28 <--> 14.09.21 16.24.35 jdlog://8487825302851/ Last edited by tunayx; 14.09.2021 at 15:24. |
#10
|
||||
|
||||
Please provide non working example link
__________________
JD-Dev & Server-Admin |
#11
|
||||
|
||||
After crawling progress nothing grabbed.
Actually no album can be grabbed currently. **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** |
#12
|
||||
|
||||
Works fine here.
Either you've corrupted the rule during importing it or maybe Cloudflare is kicking in for you. Please change the following inside the rule and re-add the rule to JD: Code:
"logging": false Code:
"logging": true Please post your log-ID here | bitte poste deine Log-ID hier. -psp- EDIT Sorry I forgot to mention that you also have to enable debug logs in the advanced setting first (see log help article about "debug logs")!
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download Last edited by pspzockerscene; 14.09.2021 at 19:15. |
#13
|
||||
|
||||
I set crawler script's logging: true restart JD, tried to grab album links, here's the log.
14.09.21 19.31.36 <--> 14.09.21 19.32.10 jdlog://9587825302851/ **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** Last edited by tunayx; 14.09.2021 at 18:35. |
#14
|
||||
|
||||
Could you please create with debug mode enabled? Enable Settings->Advanced Settings->Log.debugmodeenabled
and restart JDownloader, try again and create new log
__________________
JD-Dev & Server-Admin |
#15
|
||||
|
||||
It has been enabled for years.
New log: 14.09.21 21.52.40 <--> 14.09.21 22.01.12 jdlog://2687825302851/ Another log with another JD2 14.09.21 22.03.16 <--> 14.09.21 22.04.44 jdlog://3687825302851/ For the same links **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** 14.09.21 21.52.40 <--> 14.09.21 21.57.15 jdlog://1687825302851/ |
#16
|
||||
|
||||
Please wait for next core update and create new log. Found a bug in logging so important parts are missing in the log
__________________
JD-Dev & Server-Admin |
#17
|
||||
|
||||
New log:
17.09.21 09.47.13 <--> 17.09.21 09.47.42 jdlog://5797825302851/ **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** |
#18
|
||||
|
||||
Thanks! Strange is that your log looks good and example links and rule working fine here. Sure you don't have any filter rule in place in Settings->Linkfilter?
If you want we can also take a look at this together via Teamviewer, contact me via support@jdownloader.org
__________________
JD-Dev & Server-Admin |
#19
|
||||
|
||||
Hi, single track nor album grabbing isn't possible. I've sent you an email.
|
#20
|
||||
|
||||
Can this be the reason?
**External links are only visible to Support Staff****External links are only visible to Support Staff** actual dl address **External links are only visible to Support Staff****External links are only visible to Support Staff** |
#21
|
||||
|
||||
@tunayx: no, that's not the reason. I've answered to your mail
__________________
JD-Dev & Server-Admin |
#22
|
||||
|
||||
Yes, TW is open, just play the music on my desktop (orange icon) so I'll hear you and I come in a second.
|
#23
|
||||
|
||||
Updated waiting.
|
#24
|
||||
|
||||
@tunayx: Teamviewer is not able to connect. Please check firewall/av
__________________
JD-Dev & Server-Admin |
#25
|
||||
|
||||
Changed its version, it must be working now. have no firewall nor av etc.
|
#26
|
||||
|
||||
I have none of them. My os is old. It must be TW compatibility issue. I tried versions 15-14-13. One last time please we try with V11.
|
#27
|
||||
|
||||
finally had a chance to do teamviewer, thank you. issue was caused by setting
Settings->Advanced Settings->LinkCrawler.directhttppermission to RULES ONLY but no DIRECTHTTP rule for it @pspzocker: can you help with creating a directhttp rule for the final links?
__________________
JD-Dev & Server-Admin |
#28
|
||||
|
||||
Added description for setting "LinkCrawler.directhttppermission" for the next CORE-update.
-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#29
|
||||
|
||||
So here is the missing context for other users reading this:
The rule I posted worked just fine but @tunayx did set the following setting to "RULES_ONLY": Code:
LinkCrawler.directhttppermission This means in order to make this work, a 2nd rule is required which matches on all modify.club directurls (.mp3 URLs). I've extended that first rule to support a wider variety of .mp3 URLs and added a 2nd rule which matches on their .mp3 directURLs: Code:
[ { "enabled": true, "updateCookies": true, "logging": false, "maxDecryptDepth": 1, "name": "example rule for musify.club", "pattern": "**External links are only visible to Support Staff**, "rule": "DEEPDECRYPT", "packageNamePattern": "<h1>(.*?)</h1>", "deepPattern": "(/track/(dl|play)/[0-9]+/[^/]+\\.mp3)" }, { "enabled": true, "logging": false, "maxDecryptDepth": 1, "name": "example rule for mudify.club direct .mp3 URLs to allow forthis to work with JD setting LinkCrawler.directhttppermission -> RULES_ONLY", "pattern": "https?://musify\\.club/track/(dl|play)/[0-9]+/[^/]+\\.mp3", "rule": "DIRECTHTTP" } ] pastebin.com/raw/h53T4rem -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#30
|
||||
|
||||
Album links can be grabbed now but all shown as offline.
23.09.21 18.20.53 <--> 23.09.21 18.25.05 jdlog://6328825302851/ **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** Yet single mp3 tracks are okay. **External links are only visible to Support Staff****External links are only visible to Support Staff** |
#31
|
||||
|
||||
@tunayx: check again with next update
__________________
JD-Dev & Server-Admin |
#32
|
||||
|
||||
One last problem, each album's tracks are grabbing twice (or has a twin)
23.09.21 19.06.25 <--> 23.09.21 19.09.00 jdlog://8328825302851/ **External links are only visible to Support Staff****External links are only visible to Support Staff** Last edited by tunayx; 23.09.2021 at 18:16. |
#33
|
||||
|
||||
@tunayx:
change pattern to only contain /track/dl/ instead of (dl|play)
__________________
JD-Dev & Server-Admin |
#34
|
||||
|
||||
Thank you very much unstoppable duo, even I tried though not programmed single line.
|
Thread Tools | |
Display Modes | |
|
|