[jlonga]

This adaption from the last Core update does not work properly.
Especially when there are multiple images in a post, the 'download' property of the links are not always grabbed.
Example: **External links are only visible to Support Staff****External links are only visible to Support Staff**

[notice]

@jlonga: issue is unconnected to last core updates as the plugin has not been touched since march 1st

Originally Posted by jlonga

Especially when there are multiple images in a post, the 'download' property of the links are not always grabbed.

What do you mean by that? adding your example links results in 6 links. In case you mean better filename handling, works fine here. In case you can reproduce the issue, please provide a debug log, see https://support.jdownloader.org/Know...d-session-logs
Enable debug mode, restart JDownloader and reproduce the issue and then create log and post logID here

[Nimboid]

What is the function: link.getProperty('text'); intended to provide? In my tests it is always 'null', with preference 'Select text crawl mode: Always' set.

I was hoping it would provide the post's caption, the InnerText of

<h2>Content</h2>
<div class="post__content">
    <pre>
      "But rather late to the game than no game at all."
    </pre>
</div>

If that's not the intended function of link.getProperty('text');, could I request an additional Property to retrieve this text please?

[pspzockerscene]

@Nimboid
At this moment, the "text" property only gets set on .txt files crawled by the kemono.com plugin to save resources.
Go to Settings -> Plugins -> kemono.party -> Text crawl mode -> Always if available

After that, add a kemono.party URL and you should get a .txt element among the results -> It will have the "text" property.

[shinji2009]

hi. some files downloaded from kemono turn out corrupted with html message "429 Too Many Requests" at the begining of the flie, jd show them as 100% finished. the problem is rare but it occurs. can this be fixed?

https://imgur.com/a/PvqJOCu
https://imgur.com/a/cVnYfJ3

[pspzockerscene]

Please post your log-ID here
If your bugreport is about a specific website which JD supports via plugin, please also provide example URLs which can be used to reproduce the issue you are having.

Bitte poste deine Log-ID hier.
Falls dein gemeldetes Problem ein Problem mit einer Webseite ist, die per Plugin unterstützt wird, stelle bitte zusätzlich Testlinks zur Verfügung, mit denen sich dein Problem nachstellen lässt.

-psp-

[shinji2009]

the package i faced this issue was added aug 22 and finished sep 4 so this is all i got
03.09.23 20.49.35 <--> 02.09.23 15.44.53 jdlog://8157311370661/
package is same from this post https://board.jdownloader.org/showpo...7&postcount=17
looks like when you download something from kemono for very long period of time, you coud catch this issue

[pspzockerscene]

Changes for the next CORE-update:
- kemono.party items will now all be handled by a dedicated hosterplugin
- On error 429, all items will get a 1 minute wait state
- Updated plugin to start downloads sequentially to avoid running into said rate-limit
- These changes only affect links added after the release of said update!

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!
---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

-psp-

[shinji2009]

please don't restrict kemono to 1 download at a time, 429 is server side error, if there is too many users on site it can show it to everyone, not only to jd users. kemono know how to ban user if user is too greedy.

[pspzockerscene]

It is not restrocted to 1 parallel download.
Downloads are starting sequentially now.

[shinji2009]

when performing link re-grab, already downloaded files from kemono (from before core update) now not showing like "already in download list", although their links and names and everything are exactly the same. only txt files are "already in downloadlist".

[pspzockerscene]

Reverted handling for dupe-checking used for non-text downloads to the old one.

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!
---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

-psp-

[uNderdog_101]

There seems to be a couple of issues with kemono.party.

First, JDs linkgrabber doesn't work with kemono.su, which is the backup TLD in case kemono.party goes down, as it says on the top of the site.

**External links are only visible to Support Staff****External links are only visible to Support Staff** triggers linkgrabber, **External links are only visible to Support Staff****External links are only visible to Support Staff** does not.

Second: While **External links are only visible to Support Staff****External links are only visible to Support Staff** does trigger linkgrabber, it doesn't actually find anything, which is strange because the only link on the page is a very obvious Mega.nz link, which linkgrabber detects just fine if I copy it by itself.

[pspzockerscene]

Originally Posted by uNderdog_101

First, JDs linkgrabber doesn't work with kemono.su, which is the backup TLD in case kemono.party goes down, as it says on the top of the site.

Added support for that domain.

Originally Posted by uNderdog_101

Second: While https... does trigger linkgrabber, it doesn't actually find anything

It finds one .gif file here.

Originally Posted by uNderdog_101

the only link on the page is a very obvious Mega.nz link, which linkgrabber detects just fine if I copy it by itself.

There is one embedded .gif file and that mega.co.nz link.
If you want the kemono crawler to find that mega link, you need to enable that functionality first:
Settings -> Plugins -> kemono.party -> "Crawl http links in post text" -> Enable this

For all mentioned code changes, the following information applies:

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!
---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

-psp-

[uNderdog_101]

Originally Posted by pspzockerscene

If you want the kemono crawler to find that mega link, you need to enable that functionality first:
Settings -> Plugins -> kemono.party -> "Crawl http links in post text" -> Enable this

That was already enabled, although on closer inspection it turns out there was a linkgrabber filter rule that was being weird. It was set to only allow video files from kemono, but would not let this mp4 through under any circumstances.

A slew of rules disallowing filetypes other than mp4 worked better than one simple rule of "file type - is not - videofile, source url - contains - *kemono*".

Even the simplest rule of "file type - is not - videofile" would not let it past.

Anyway, thanks for the help, JD was being weird, but I found a workaround.

[pspzockerscene]

You've probably used "source" to filter video files "from kemono" but if the mega.co.nz links is added through the kemono link, the source will also be kemono.
Solution: Use "download url" field for filtering and not "source".
When adding your kemono.party URL, the following rule would filter everything except that mega.co.nz URL:
Screenshot:

[uNderdog_101]

You've probably used "source" to filter video files "from kemono" but if the mega.co.nz links is added through the kemono link, the source will also be kemono.
Solution: Use "download url" field for filtering and not "source".

But I disabled the sourceurl and used a filter with only "Filetype - is not - video file" and it still wouldn't find any mega link. I even made a new filter that only lets video files through and ran with only that filter active and it still filtered the video.

So it seems to me that the problem is not with the construction of the filter, but rather with JD misidentifying what is a video file, or maybe mega itself?

[pspzockerscene]

I don't understand.
The mega link leads to a ".mp4" video file so you do not want to filter that.

[uNderdog_101]

Originally Posted by pspzockerscene

I don't understand.
The mega link leads to a ".mp4" video file so you do not want to filter that.

Correct, I want to filter everything but mp4 files. However there seems to be an issue where JD won't let that particular mp4 through, even with only a single filter with a single instruction that should let it.

I made a filter that only lets through video files, it blocked that video file.

I just now made a filter that only lets through "*.mp4" filenames, it blocked it.

Sorry, but I don't know how I can be any clearer. Either JD has an issue properly identifying mp4 files, or Mega has an issue identifying their files as mp4s.

Edit: I just inverted the "*.mp4" filter so it would block only mp4 files, and it did, so it seem to have no issue when actually blocking, just letting through.

[pspzockerscene]

All I can say is: The rule in my screenshot did work for me and the result was that when I was adding your kemono link, I only got the mega.co.nz file.