[nuri]

Many thanks!

[Jiaz]

@nuri: updates will be released upcomming week, sorry for the delay

[nuri]

1 more thing, would i be possible to save the text content into a txt also?

[Jiaz]

@nuri: What text content in particular? Can you give an example?

[nuri]

Sure, for example, this has only text, would it be possible to save it as txt?
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

[Jiaz]

@nuri:
I think that should be possible I've updated our existing ticket

[pspzockerscene]

Added settings to crawl/download text of single posts.
By default, text will only be added if no media items are found (external URLs in post-text do not count as media items).

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!
---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

-psp-

[Viessa]

Hello, I have a problem where, for instance, the linkgraber doesn't pull the mega links when I copy a tab with multiple photos and mega links.
Example **External links are only visible to Support Staff****External links are only visible to Support Staff**
or this site
**External links are only visible to Support Staff****External links are only visible to Support Staff**

[pspzockerscene]

@Viessa
Merged kemono.party threads.

About kemono.party and your reported bug / requested feature:
Please read the last page of this thread especially from this post until the end.

Regarding f95zone.to:
Please read this forum thread and post in that thread if you got more questions regarding plugin support for this website.

[Viessa]

Sorry to bump this I don't know if it is relevant or not but kemono updated their site including UI changes.

[pspzockerscene]

Does the plugin still work for you?
If not, please provide a log and new example URLs.
EDIT

I just did a quick check and the plugin appears to be working fine.

[Viessa]

Spoiler:

**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Spoiler:

**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Some of those links have mega links but jdownloader doesn't get them:(

[pspzockerscene]

Please read post #35 and the following.

Short answer:
That feature has been added but the updates haven't been released yet.
If you can't wait, you can setup JD in IDE and use the dev version, we're open source.

[jlonga]

The link searcher only appears to load the first site of results.
Example link loading 48 packages, instead of all of them:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

[pspzockerscene]

Fixed by Jiaz.
In the meanwhile you will have to add all posts of each page one by one or use our developer build.

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!
---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

-psp-

[pspzockerscene]

CORE-Updates have been released!
All announced bugfixes and features are live!
Please update your JDownloader and report any issues you find asap.
If this thread gets marked as "[Solved]" by our forum staff you can still post in it and we will read- and reply to it!

CORE-Updates wurden released!
Alle angekündigten Bugfixes/Features sind nun verfügbar!
Bitte JDownloader updaten und eventuelle Bugs schnellstmöglich an uns melden.
Falls dieser Thread vom Team als "[Erledigt]" markiert wird, kannst du weiterhin darin antworten und wir lesen/beantworten auch solche Threads!

-psp-

[sandz]

Kemono seems to have recently changed their link structure where the normal filename of the link is in a new attribute called "download" on the anchor tags, which is causing the link grabber to just use whatever server filename kemono has.

For example from this page **External links are only visible to Support Staff****External links are only visible to Support Staff** the list of post attachments shows this where one of the downloaded files is named "67b7fefcea3b30fc305de7f931ddc0e9151d3fe889e57458ab356d0a5f4b55c8.mp4" versus the readable "Lift me up v1 1080p 30fps.mp4"

Is this something that can be updated?

[sandz]

Kemono seems to have recently changed their link structure for post attachments, which seems to have caused the link grabber to just use whatever server filename kemono has that doesn't match the readable filename you see in the post.

For example from this page **External links are only visible to Support Staff****External links are only visible to Support Staff** the list of post attachments shows this where one of the downloaded files is named "67b7fefcea3b30fc305de7f931ddc0e9151d3fe889e57458ab356d0a5f4b55c8.mp4" versus the readable "Lift me up v1 1080p 30fps.mp4"

[pspzockerscene]

Merged duplicated posts.

Updated plugin to try to obtain "better filename" from the new place it is at now.

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!
---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

-psp-

[pspzockerscene]

CORE-Updates have been released!
All announced bugfixes and features are live!
Please update your JDownloader and report any issues you find asap.
If this thread gets marked as "[Solved]" by our forum staff you can still post in it and we will read- and reply to it!

CORE-Updates wurden released!
Alle angekündigten Bugfixes/Features sind nun verfügbar!
Bitte JDownloader updaten und eventuelle Bugs schnellstmöglich an uns melden.
Falls dieser Thread vom Team als "[Erledigt]" markiert wird, kannst du weiterhin darin antworten und wir lesen/beantworten auch solche Threads!

-psp-

[jlonga]

This adaption from the last Core update does not work properly.
Especially when there are multiple images in a post, the 'download' property of the links are not always grabbed.
Example: **External links are only visible to Support Staff****External links are only visible to Support Staff**

[notice]

@jlonga: issue is unconnected to last core updates as the plugin has not been touched since march 1st

Originally Posted by jlonga

Especially when there are multiple images in a post, the 'download' property of the links are not always grabbed.

What do you mean by that? adding your example links results in 6 links. In case you mean better filename handling, works fine here. In case you can reproduce the issue, please provide a debug log, see https://support.jdownloader.org/Know...d-session-logs
Enable debug mode, restart JDownloader and reproduce the issue and then create log and post logID here

[Nimboid]

What is the function: link.getProperty('text'); intended to provide? In my tests it is always 'null', with preference 'Select text crawl mode: Always' set.

I was hoping it would provide the post's caption, the InnerText of

<h2>Content</h2>
<div class="post__content">
    <pre>
      "But rather late to the game than no game at all."
    </pre>
</div>

If that's not the intended function of link.getProperty('text');, could I request an additional Property to retrieve this text please?

[pspzockerscene]

@Nimboid
At this moment, the "text" property only gets set on .txt files crawled by the kemono.com plugin to save resources.
Go to Settings -> Plugins -> kemono.party -> Text crawl mode -> Always if available

After that, add a kemono.party URL and you should get a .txt element among the results -> It will have the "text" property.

[shinji2009]

hi. some files downloaded from kemono turn out corrupted with html message "429 Too Many Requests" at the begining of the flie, jd show them as 100% finished. the problem is rare but it occurs. can this be fixed?

https://imgur.com/a/PvqJOCu
https://imgur.com/a/cVnYfJ3

[pspzockerscene]

Please post your log-ID here
If your bugreport is about a specific website which JD supports via plugin, please also provide example URLs which can be used to reproduce the issue you are having.

Bitte poste deine Log-ID hier.
Falls dein gemeldetes Problem ein Problem mit einer Webseite ist, die per Plugin unterstützt wird, stelle bitte zusätzlich Testlinks zur Verfügung, mit denen sich dein Problem nachstellen lässt.

-psp-

[shinji2009]

the package i faced this issue was added aug 22 and finished sep 4 so this is all i got
03.09.23 20.49.35 <--> 02.09.23 15.44.53 jdlog://8157311370661/
package is same from this post https://board.jdownloader.org/showpo...7&postcount=17
looks like when you download something from kemono for very long period of time, you coud catch this issue

[pspzockerscene]

Changes for the next CORE-update:
- kemono.party items will now all be handled by a dedicated hosterplugin
- On error 429, all items will get a 1 minute wait state
- Updated plugin to start downloads sequentially to avoid running into said rate-limit
- These changes only affect links added after the release of said update!

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!
---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

-psp-

[shinji2009]

please don't restrict kemono to 1 download at a time, 429 is server side error, if there is too many users on site it can show it to everyone, not only to jd users. kemono know how to ban user if user is too greedy.

[pspzockerscene]

It is not restrocted to 1 parallel download.
Downloads are starting sequentially now.

[shinji2009]

when performing link re-grab, already downloaded files from kemono (from before core update) now not showing like "already in download list", although their links and names and everything are exactly the same. only txt files are "already in downloadlist".

[pspzockerscene]

Reverted handling for dupe-checking used for non-text downloads to the old one.

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!
---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

-psp-

[uNderdog_101]

There seems to be a couple of issues with kemono.party.

First, JDs linkgrabber doesn't work with kemono.su, which is the backup TLD in case kemono.party goes down, as it says on the top of the site.

**External links are only visible to Support Staff****External links are only visible to Support Staff** triggers linkgrabber, **External links are only visible to Support Staff****External links are only visible to Support Staff** does not.

Second: While **External links are only visible to Support Staff****External links are only visible to Support Staff** does trigger linkgrabber, it doesn't actually find anything, which is strange because the only link on the page is a very obvious Mega.nz link, which linkgrabber detects just fine if I copy it by itself.

[pspzockerscene]

Originally Posted by uNderdog_101

First, JDs linkgrabber doesn't work with kemono.su, which is the backup TLD in case kemono.party goes down, as it says on the top of the site.

Added support for that domain.

Originally Posted by uNderdog_101

Second: While https... does trigger linkgrabber, it doesn't actually find anything

It finds one .gif file here.

Originally Posted by uNderdog_101

the only link on the page is a very obvious Mega.nz link, which linkgrabber detects just fine if I copy it by itself.

There is one embedded .gif file and that mega.co.nz link.
If you want the kemono crawler to find that mega link, you need to enable that functionality first:
Settings -> Plugins -> kemono.party -> "Crawl http links in post text" -> Enable this

For all mentioned code changes, the following information applies:

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!
---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

-psp-

[uNderdog_101]

Originally Posted by pspzockerscene

If you want the kemono crawler to find that mega link, you need to enable that functionality first:
Settings -> Plugins -> kemono.party -> "Crawl http links in post text" -> Enable this

That was already enabled, although on closer inspection it turns out there was a linkgrabber filter rule that was being weird. It was set to only allow video files from kemono, but would not let this mp4 through under any circumstances.

A slew of rules disallowing filetypes other than mp4 worked better than one simple rule of "file type - is not - videofile, source url - contains - *kemono*".

Even the simplest rule of "file type - is not - videofile" would not let it past.

Anyway, thanks for the help, JD was being weird, but I found a workaround.

[pspzockerscene]

You've probably used "source" to filter video files "from kemono" but if the mega.co.nz links is added through the kemono link, the source will also be kemono.
Solution: Use "download url" field for filtering and not "source".
When adding your kemono.party URL, the following rule would filter everything except that mega.co.nz URL:
Screenshot:

[uNderdog_101]

You've probably used "source" to filter video files "from kemono" but if the mega.co.nz links is added through the kemono link, the source will also be kemono.
Solution: Use "download url" field for filtering and not "source".

But I disabled the sourceurl and used a filter with only "Filetype - is not - video file" and it still wouldn't find any mega link. I even made a new filter that only lets video files through and ran with only that filter active and it still filtered the video.

So it seems to me that the problem is not with the construction of the filter, but rather with JD misidentifying what is a video file, or maybe mega itself?

[pspzockerscene]

I don't understand.
The mega link leads to a ".mp4" video file so you do not want to filter that.

[uNderdog_101]

Originally Posted by pspzockerscene

I don't understand.
The mega link leads to a ".mp4" video file so you do not want to filter that.

Correct, I want to filter everything but mp4 files. However there seems to be an issue where JD won't let that particular mp4 through, even with only a single filter with a single instruction that should let it.

I made a filter that only lets through video files, it blocked that video file.

I just now made a filter that only lets through "*.mp4" filenames, it blocked it.

Sorry, but I don't know how I can be any clearer. Either JD has an issue properly identifying mp4 files, or Mega has an issue identifying their files as mp4s.

Edit: I just inverted the "*.mp4" filter so it would block only mp4 files, and it did, so it seem to have no issue when actually blocking, just letting through.

[pspzockerscene]

All I can say is: The rule in my screenshot did work for me and the result was that when I was adding your kemono link, I only got the mega.co.nz file.