[Jiaz]

@nathan1: thanks, I will check by tomorrow. most likely some sort of rate limit causing the issue

[pspzockerscene]

@nathan1:
1. Your cookie doesn't seem to work here.
Please keep in mind that cookies can expire and they're also often bound to a specific IP or at least a specific range/country that IP belongs to.
To do further testing, please provide your mail- and password for khinsider.com.

2. I tested it using another test-account and I wasn't even able to download a single .zip file due to the following errormessage:
Screenshot:

[nathan1]

@psp

I sent you the credentials by replying to your last message in the email

[pspzockerscene]

I haven't tested it 100% yet but one part of the problem is definitely that khinsider.com changed the "/add_album" URLs inside their html code.
They're now represented as relative URLs vs absolute URLs and the provided LinkCrawler Rule was made for absolute URLs only.

This would be the new rule:

[
 {
  "cookies"            : [
                          [
                           "xf_session",
                           "CENSORED"
                          ]
                         ],
  "deepPattern"        : "(/cp/add_album/\\d+)\"",
  "formPattern"        : null,
  "maxDecryptDepth"    : 1,
  "name"               : "downloads.khinsider.com loggedin 1: Grab add_album URL",
  "packageNamePattern" : null,
  "passwordPattern"    : null,
  "pattern"            : "https?://downloads\\.khinsider\\.com/[^/]+/album/[^/]+",
  "rule"               : "DEEPDECRYPT",
  "enabled"            : true,
  "logging"            : true,
  "updateCookies"      : true
 },
 {
  "cookies"            : [
                          [
                           "xf_session",
                           "CENSORED"
                          ]
                         ],
  "deepPattern"        : "\"(https?://[^\"]+\\.zip)\">Click here",
  "formPattern"        : null,
  "maxDecryptDepth"    : 1,
  "name"               : "downloads.khinsider.com loggedin 2: Grab .zip files",
  "packageNamePattern" : null,
  "pattern"            : "https?://downloads\\.khinsider\\.com/cp/add_album/\\d+",
  "rule"               : "DEEPDECRYPT",
  "enabled"            : true,
  "logging"            : true,
  "updateCookies"      : true
 }
]

Rule as plaintext for easier copy & paste:
pastebin.com/raw/Si4bfhjm

I've highlighted the relevant changed part.

[pspzockerscene]

Now I'm willing to admit that I'm also a lazy person so I'm not planning to let it run through all of your ~770 example URLs.

Let's say that the fixed rule is not enough and let's assume there is still a rate limit which is only triggered when checking all of those .zip direct-URLs.
Try the following:
1. Go to Settings -> Advanced Settings -> Search for LinkCollector.dolinkcheck --> Disable this
2. Now add some- or all links.
You will notice that they will get added with a blue questionmark and without onlinestatus and with unknown filesize.

JDownloader will now skip the linkcheck of all added items.
This has several disadvantages but it might help in this case plus they will appear in your linkgrabber faster.

I recommend to turn that setting back on once you're done downloading those links.

[Jiaz]

Originally Posted by pspzockerscene

I haven't tested it 100% yet but one part of the problem is definitely that khinsider.com changed the "/add_album" URLs inside their html code.
They're now represented as relative URLs vs absolute URLs and the provided LinkCrawler Rule was made for absolute URLs only.

see my previous answer https://board.jdownloader.org/showpo...1&postcount=17

[nathan1]

@psp

Thank you very much,
I will follow your directions.

[pspzockerscene]

Originally Posted by Jiaz

see my previous answer https://board.jdownloader.org/showpo...1&postcount=17

Sorry my attention span was non existant at this time yesterday.
Either way nathan1 now has the complete modified rule available and also all other users who are interested in using it.

[Jiaz]

@nathan1: please test and provide feedback

[nathan1]

@jiaz
@psp

mm.. I test but this solution doesn't work well, I also disable dolinkcheck but links are not well crawled well, I copied and paste 150 links but it continues to idle detecting 5 or 6 links

07.09.22 19.22.03 <--> 07.09.22 19.34.24 jdlog://8479211370661/

[Jiaz]

@nathan1: hmm, log contains around 150 succesful parsed links/zip files !?
sure you don't have any filter rules active? the download domain is different in case you filter on domain
and also check linkgrabber right sidebar, that you have not filtered hoster/filetype

[nathan1]

@jiaz

No, I don't use any link filter rules.
However I think to understand, I tried again on a clean server and now after about 2 minutes the links started to appear, but I usually waited at most one minute and so they didn't appear to me.
Check out this video I made

**External links are only visible to Support Staff****External links are only visible to Support Staff**

Debug LOG

07.09.22 19.21.42 <--> 07.09.22 19.21.42 jdlog://3579211370661/

Perhaps the problem could be considered solved

[Jiaz]

@nathan1:

Originally Posted by nathan1

Perhaps the problem could be considered solved

Thanks for the video! Please check again with next core update. maybe the results will show up faster but no guarantees