JDownloader Community - Appwork GmbH
 

Notices

Reply
 
Thread Tools Display Modes
  #1  
Old 18.10.2020, 17:46
nathan1 nathan1 is offline
JD VIP
 
Join Date: Apr 2012
Posts: 395
Default How add a donator account and download .zip files from khinsider.com?

Dear Staff,
I read before this thread
https://board.jdownloader.org/showth...ight=khinsider

but I don't understand how to solve for my situation.

I have a 'donator account' (similar to a premium account) and in this way I can download files as .zip and not only individual .mp3.

To download files as .zip you must have a donator account and I have one
**External links are only visible to Support Staff****External links are only visible to Support Staff**

To better explain what I would like JD to do

1.I go on this page
**External links are only visible to Support Staff****External links are only visible to Support Staff**

you see list of files



2. Then I click on this link (is just an example)
**External links are only visible to Support Staff****External links are only visible to Support Staff**

that is

Etrian Odyssey Untold (Shin Sekaiju no MeiQ) The Millennium Girl Original Soundtrack

Ok, now, iinside that link I different mp3 files but my attention is for this link




3. This page is visible only for Donator Account


I can give you my login credentials if you want to test



I see 2 links

**External links are only visible to Support Staff****External links are only visible to Support Staff**

**External links are only visible to Support Staff****External links are only visible to Support Staff**

I want retrieve both (not every album has a FLAC version, in this case there is)

My question are 2:

a) I have a list of links like

**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Action Man - Search for Base X (GBC) (23 songs)
Bob the Builder - Fix it Fun! (GBC) (20 songs)
Flintstones, The - King Rock Treasure Island (GB) (12 songs)
Jimmy White's Cueball (GBC) (6 songs)


I want copy and paste these links and download them as .zip files using Jdownloader 2

b) I don't understand how to add my account on JD2. I want to add mine

Thanks for any help.

Last edited by Jiaz; 26.10.2020 at 19:46.
Reply With Quote
  #2  
Old 19.10.2020, 18:08
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,140
Default

Hi,

because there is no JD plugin available for this website you cannot just add your account to JD.
From what I can see, I can download your direct-URLs even without your account so it should be possible to put your login-cookies into the previously posted LinkCrawler rule so JD can then (theoretically) auto-find those URLs.

If you want me to check this, you can send me your logindata via PN.
I will only use them to check/update the link crawler rule - you can change your password afterwards.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #3  
Old 19.10.2020, 18:35
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,343
Default

Either send logins to pspzockerscene or to support@jdownloader.org and we can try to help with the rule
__________________
JD-Dev & Server-Admin
Reply With Quote
  #4  
Old 20.10.2020, 00:56
nathan1 nathan1 is offline
JD VIP
 
Join Date: Apr 2012
Posts: 395
Default

@Jiaz

I sent via PM my login data to pspzockerscene
Reply With Quote
  #5  
Old 20.10.2020, 11:44
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,343
Default

Thanks. I'm sure he will be able to help you
__________________
JD-Dev & Server-Admin
Reply With Quote
  #6  
Old 20.10.2020, 13:46
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,140
Default

Turns out all you need is your personal "xf_session" cookie.
Here is the rule (well, two rules) - all you need to do is to replace the word CENSORED with the value of your personal "xf_session" cookie then you're good to go:
Code:
[ {
  "enabled" : true,
  "cookies" : [ ["xf_session", "CENSORED"] ],
  "updateCookies" : true,
  "logging" : false,
  "maxDecryptDepth" : 1,
  "name" : "downloads.khinsider.com loggedin 1: Grab add_album URL",
  "pattern" : "https?://downloads\\.khinsider\\.com/[^/]+/album/[^/]+",
  "rule" : "DEEPDECRYPT",
  "packageNamePattern" : null,
  "passwordPattern" : null,
  "formPattern" : null,
  "deepPattern" : "\"(https?://downloads\\.khinsider\\.com/cp/add_album/\\d+)\"",
  "rewriteReplaceWith" : null
},
{
  "enabled" : true,
  "cookies" : [ ["xf_session", "CENSORED"] ],
  "updateCookies" : true,
  "logging" : false,
  "maxDecryptDepth" : 1,
  "name" : "downloads.khinsider.com loggedin 2: Grab .zip files",
  "pattern" : "https?://downloads\\.khinsider\\.com/cp/add_album/\\d+",
  "rule" : "DEEPDECRYPT",
  "packageNamePattern" : null,
  "passwordPattern" : null,
  "formPattern" : null,
  "deepPattern" : "\"(https?://[^\"]+\\.zip)\"",
  "rewriteReplaceWith" : null
} ]
Rule in plaintext to get around our forum's URL censoring:
pastebin.com/M4ZQ4Thq

-psp-
EDIT

In case you're wondering why some .zip files appear twice in your linkgrabber:
This rule will simply grab ALL .zip URLs which means if there is a mirror, it will be included as well.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 20.10.2020 at 13:48.
Reply With Quote
  #7  
Old 20.10.2020, 20:13
nathan1 nathan1 is offline
JD VIP
 
Join Date: Apr 2012
Posts: 395
Default

Maybe I wrong something because don't work

1. I take cookie code using Flag Cookie extension





1. I edit your link rule crawled in this way

Code:
[ {
  "enabled" : true,
  "cookies" : [ ["xf_session", "1271103%2CODDI56dzL4KcLam9w7eCzpEs4Pg5gg3VQ#######"] ],
  "updateCookies" : true,
  "logging" : false,
  "maxDecryptDepth" : 1,
  "name" : "downloads.khinsider.com loggedin 1: Grab add_album URL",
  "pattern" : "https?://downloads\\.khinsider\\.com/[^/]+/album/[^/]+",
  "rule" : "DEEPDECRYPT",
  "packageNamePattern" : null,
  "passwordPattern" : null,
  "formPattern" : null,
  "deepPattern" : "\"(https?://downloads\\.khinsider\\.com/cp/add_album/\\d+)\"",
  "rewriteReplaceWith" : null
},
{
  "enabled" : true,
  "cookies" : [ ["xf_session", "1271103%2CODDI56dzL4KcLam9w7eCzpEs4Pg5gg3VQ#######"] ],
  "updateCookies" : true,
  "logging" : false,
  "maxDecryptDepth" : 1,
  "name" : "downloads.khinsider.com loggedin 2: Grab .zip files",
  "pattern" : "https?://downloads\\.khinsider\\.com/cp/add_album/\\d+",
  "rule" : "DEEPDECRYPT",
  "packageNamePattern" : null,
  "passwordPattern" : null,
  "formPattern" : null,
  "deepPattern" : "\"(https?://[^\"]+\\.zip)\"",
  "rewriteReplaceWith" : null
} ]
2. I copy and paste this code here


But JD2 doesn't crawls links

LOG

Code:
20.10.20 16.59.30 <--> 20.10.20 16.46.12 jdlog://6666325302851/

Last edited by Jiaz; 26.10.2020 at 19:46.
Reply With Quote
  #8  
Old 20.10.2020, 22:07
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,343
Default

You've got to enable logging in rules. change
Quote:
"logging" : false
to
Quote:
"logging" : true
and try again and create log
__________________
JD-Dev & Server-Admin
Reply With Quote
  #9  
Old 20.10.2020, 22:26
nathan1 nathan1 is offline
JD VIP
 
Join Date: Apr 2012
Posts: 395
Default

@Jiaz

No, nothing, I change false into true but these example links

**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

are not crawled

LOG

Code:
20.10.20 19.23.34 <--> 20.10.20 19.23.34 jdlog://1076325302851/
Reply With Quote
  #10  
Old 21.10.2020, 12:03
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,343
Default

Can you please send logins to support@jdownloader.org so I can check this
__________________
JD-Dev & Server-Admin
Reply With Quote
  #11  
Old 21.10.2020, 13:29
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,140
Default

@nathan1
Works fine here!

According to your screenshot, you've taken the value of "xf_user" and put it in the crawler rule as "xf_session".
You need to get the value of your "xf_session" cookie and put it into the rule for this to work ...

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #12  
Old 21.10.2020, 20:53
nathan1 nathan1 is offline
JD VIP
 
Join Date: Apr 2012
Posts: 395
Default

I solved, thanks, I use edithiscookie of Chrome but is possible to add another rule to filter same files?



Quote:
In case you're wondering why some .zip files appear twice in your linkgrabber:
This rule will simply grab ALL .zip URLs which means if there is a mirror, it will be included as well.
Is it possible to filter identical names? (I know that are same files)

Last edited by Jiaz; 26.10.2020 at 19:46.
Reply With Quote
  #13  
Old 22.10.2020, 12:37
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,140
Default

You cannot filter same files/filenames with rules.
JD won't download the files twice anyways because they're in the same package.

... but if, for cosmetic reasons, you want JD to only find one file, the rule can be changed to nly grab the main downloadurls and not the mirrors.
For this, I've made minor changes to the 2nd rule - here is both again:
Code:
[ {
  "enabled" : true,
  "cookies" : [ ["xf_session", "CENSORED"] ],
  "updateCookies" : true,
  "logging" : false,
  "maxDecryptDepth" : 1,
  "name" : "downloads.khinsider.com loggedin 1: Grab add_album URL",
  "pattern" : "https?://downloads\\.khinsider\\.com/[^/]+/album/[^/]+",
  "rule" : "DEEPDECRYPT",
  "packageNamePattern" : null,
  "passwordPattern" : null,
  "formPattern" : null,
  "deepPattern" : "\"(https?://downloads\\.khinsider\\.com/cp/add_album/\\d+)\"",
  "rewriteReplaceWith" : null
},
{
  "enabled" : true,
  "cookies" : [ ["xf_session", "CENSORED"] ],
  "updateCookies" : true,
  "logging" : false,
  "maxDecryptDepth" : 1,
  "name" : "downloads.khinsider.com loggedin 2: Grab .zip files",
  "pattern" : "https?://downloads\\.khinsider\\.com/cp/add_album/\\d+",
  "rule" : "DEEPDECRYPT",
  "packageNamePattern" : null,
  "passwordPattern" : null,
  "formPattern" : null,
  "deepPattern" : "\"(https?://[^\"]+\\.zip)\">Click here",
  "rewriteReplaceWith" : null
} ]
Rules in plaintext:
pastebin.com/158CbiPs

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #14  
Old 22.10.2020, 22:54
nathan1 nathan1 is offline
JD VIP
 
Join Date: Apr 2012
Posts: 395
Default

Your solution works great!
Thank you very much
Reply With Quote
  #15  
Old 23.10.2020, 14:11
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,140
Default

Thanks for your feedback.

In case the rule ever fails:
First renew your cookies before reporting any errors here.
Session cookies do not always last forever!

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #16  
Old 30.08.2022, 19:49
nathan1 nathan1 is offline
JD VIP
 
Join Date: Apr 2012
Posts: 395
Default

Is possible to fix? This pattern seems don't work and I don't understand why

Code:
"pattern" : "https?://downloads\\.khinsider\\.com/[^/]+/album/[^/]+",
I used linkcrawl above and I set xf_session correctly

Debug LOG
Code:
30.08.22 16.40.54 <--> 30.08.22 16.40.54 jdlog://0359211370661/

Last edited by Jiaz; 30.08.2022 at 20:00.
Reply With Quote
  #17  
Old 30.08.2022, 20:00
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,343
Default

@nathan1: you must update deepPattern as the URL is now relative in html, in Grab add_album URL
Code:
"deepPattern" : "\"((?:https?://downloads\\.khinsider\\.com)?/cp/add_album/\\d+)\"",
__________________
JD-Dev & Server-Admin

Last edited by Jiaz; 30.08.2022 at 20:09.
Reply With Quote
  #18  
Old 30.08.2022, 21:05
nathan1 nathan1 is offline
JD VIP
 
Join Date: Apr 2012
Posts: 395
Default

Thank you Jiaz, but I don't understand why some links are still not crawled. For example these is like invisible for JD, take a look in LOG

**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

LOG
30.08.22 18.03.37 <--> 30.08.22 18.03.37 jdlog://2359211370661/
Reply With Quote
  #19  
Old 30.08.2022, 21:45
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,343
Default

@nathan1: have you updated the deepPattern? Can you send me the cookie and your current rules to support@jdownloader.org, then I will check it by tomorrow
__________________
JD-Dev & Server-Admin
Reply With Quote
  #20  
Old 30.08.2022, 22:06
nathan1 nathan1 is offline
JD VIP
 
Join Date: Apr 2012
Posts: 395
Default

Yes, I update cookie. Ok, check email. I sent you now - problem seems when you crawl a large number of url at same time (for example 50-60 links).
I attach you also url list to control this
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 12:50.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.