JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #61  
Old 22.04.2023, 10:33
jlonga jlonga is offline
Modem User
 
Join Date: Sep 2022
Posts: 2
Default

This adaption from the last Core update does not work properly.
Especially when there are multiple images in a post, the 'download' property of the links are not always grabbed.
Example: **External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #62  
Old 22.04.2023, 17:19
notice notice is offline
JD Supporter
 
Join Date: Mar 2023
Posts: 506
Default

@jlonga: issue is unconnected to last core updates as the plugin has not been touched since march 1st
Quote:
Originally Posted by jlonga View Post
Especially when there are multiple images in a post, the 'download' property of the links are not always grabbed.
What do you mean by that? adding your example links results in 6 links. In case you mean better filename handling, works fine here. In case you can reproduce the issue, please provide a debug log, see https://support.jdownloader.org/Know...d-session-logs
Enable debug mode, restart JDownloader and reproduce the issue and then create log and post logID here

Last edited by notice; 22.04.2023 at 17:23.
Reply With Quote
  #63  
Old 22.06.2023, 02:20
Nimboid Nimboid is offline
Vacuum Cleaner
 
Join Date: Jan 2023
Location: UK
Posts: 18
Default

What is the function: link.getProperty('text'); intended to provide? In my tests it is always 'null', with preference 'Select text crawl mode: Always' set.

I was hoping it would provide the post's caption, the InnerText of
Code:
<h2>Content</h2>
<div class="post__content">
    <pre>
      "But rather late to the game than no game at all."
    </pre>
</div>
If that's not the intended function of link.getProperty('text');, could I request an additional Property to retrieve this text please?
Reply With Quote
  #64  
Old 22.06.2023, 11:17
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,730
Default

@Nimboid
At this moment, the "text" property only gets set on .txt files crawled by the kemono.com plugin to save resources.
Go to Settings -> Plugins -> kemono.party -> Text crawl mode -> Always if available

After that, add a kemono.party URL and you should get a .txt element among the results -> It will have the "text" property.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #65  
Old 04.09.2023, 10:20
shinji2009 shinji2009 is offline
Ultra Loader
 
Join Date: Aug 2021
Posts: 49
Default

hi. some files downloaded from kemono turn out corrupted with html message "429 Too Many Requests" at the begining of the flie, jd show them as 100% finished. the problem is rare but it occurs. can this be fixed?

https://imgur.com/a/PvqJOCu
https://imgur.com/a/cVnYfJ3

Last edited by shinji2009; 04.09.2023 at 10:35.
Reply With Quote
  #66  
Old 04.09.2023, 13:04
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,730
Default

Please post your log-ID here
If your bugreport is about a specific website which JD supports via plugin, please also provide example URLs which can be used to reproduce the issue you are having.

Bitte poste deine Log-ID hier.
Falls dein gemeldetes Problem ein Problem mit einer Webseite ist, die per Plugin unterstützt wird, stelle bitte zusätzlich Testlinks zur Verfügung, mit denen sich dein Problem nachstellen lässt.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #67  
Old 04.09.2023, 13:23
shinji2009 shinji2009 is offline
Ultra Loader
 
Join Date: Aug 2021
Posts: 49
Default

the package i faced this issue was added aug 22 and finished sep 4 so this is all i got
03.09.23 20.49.35 <--> 02.09.23 15.44.53 jdlog://8157311370661/
package is same from this post https://board.jdownloader.org/showpo...7&postcount=17
looks like when you download something from kemono for very long period of time, you coud catch this issue
Reply With Quote
  #68  
Old 04.09.2023, 15:49
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,730
Default

Changes for the next CORE-update:
- kemono.party items will now all be handled by a dedicated hosterplugin
- On error 429, all items will get a 1 minute wait state
- Updated plugin to start downloads sequentially to avoid running into said rate-limit
- These changes only affect links added after the release of said update!

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 04.09.2023 at 15:55.
Reply With Quote
  #69  
Old 04.09.2023, 20:14
shinji2009 shinji2009 is offline
Ultra Loader
 
Join Date: Aug 2021
Posts: 49
Default

please don't restrict kemono to 1 download at a time, 429 is server side error, if there is too many users on site it can show it to everyone, not only to jd users. kemono know how to ban user if user is too greedy.
Reply With Quote
  #70  
Old 05.09.2023, 11:49
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,730
Default

It is not restrocted to 1 parallel download.
Downloads are starting sequentially now.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #71  
Old 06.09.2023, 14:28
shinji2009 shinji2009 is offline
Ultra Loader
 
Join Date: Aug 2021
Posts: 49
Default

when performing link re-grab, already downloaded files from kemono (from before core update) now not showing like "already in download list", although their links and names and everything are exactly the same. only txt files are "already in downloadlist".

Last edited by shinji2009; 06.09.2023 at 14:42.
Reply With Quote
  #72  
Old 06.09.2023, 16:57
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,730
Default

Reverted handling for dupe-checking used for non-text downloads to the old one.

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #73  
Old 14.09.2023, 17:21
uNderdog_101 uNderdog_101 is offline
Modem User
 
Join Date: Sep 2023
Posts: 4
Default

There seems to be a couple of issues with kemono.party.

First, JDs linkgrabber doesn't work with kemono.su, which is the backup TLD in case kemono.party goes down, as it says on the top of the site.

**External links are only visible to Support Staff****External links are only visible to Support Staff** triggers linkgrabber, **External links are only visible to Support Staff****External links are only visible to Support Staff** does not.

Second: While **External links are only visible to Support Staff****External links are only visible to Support Staff** does trigger linkgrabber, it doesn't actually find anything, which is strange because the only link on the page is a very obvious Mega.nz link, which linkgrabber detects just fine if I copy it by itself.
Reply With Quote
  #74  
Old 14.09.2023, 18:01
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,730
Default

Quote:
Originally Posted by uNderdog_101 View Post
First, JDs linkgrabber doesn't work with kemono.su, which is the backup TLD in case kemono.party goes down, as it says on the top of the site.
Added support for that domain.

Quote:
Originally Posted by uNderdog_101 View Post
Second: While https... does trigger linkgrabber, it doesn't actually find anything
It finds one .gif file here.

Quote:
Originally Posted by uNderdog_101 View Post
the only link on the page is a very obvious Mega.nz link, which linkgrabber detects just fine if I copy it by itself.
There is one embedded .gif file and that mega.co.nz link.
If you want the kemono crawler to find that mega link, you need to enable that functionality first:
Settings -> Plugins -> kemono.party -> "Crawl http links in post text" -> Enable this

For all mentioned code changes, the following information applies:

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #75  
Old 14.09.2023, 20:17
uNderdog_101 uNderdog_101 is offline
Modem User
 
Join Date: Sep 2023
Posts: 4
Default

Quote:
Originally Posted by pspzockerscene View Post
If you want the kemono crawler to find that mega link, you need to enable that functionality first:
Settings -> Plugins -> kemono.party -> "Crawl http links in post text" -> Enable this
That was already enabled, although on closer inspection it turns out there was a linkgrabber filter rule that was being weird. It was set to only allow video files from kemono, but would not let this mp4 through under any circumstances.

A slew of rules disallowing filetypes other than mp4 worked better than one simple rule of "file type - is not - videofile, source url - contains - *kemono*".

Even the simplest rule of "file type - is not - videofile" would not let it past.

Anyway, thanks for the help, JD was being weird, but I found a workaround.
Reply With Quote
  #76  
Old 15.09.2023, 10:48
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,730
Default

You've probably used "source" to filter video files "from kemono" but if the mega.co.nz links is added through the kemono link, the source will also be kemono.
Solution: Use "download url" field for filtering and not "source".
When adding your kemono.party URL, the following rule would filter everything except that mega.co.nz URL:
Screenshot:
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #77  
Old 15.09.2023, 16:09
uNderdog_101 uNderdog_101 is offline
Modem User
 
Join Date: Sep 2023
Posts: 4
Default

Quote:
You've probably used "source" to filter video files "from kemono" but if the mega.co.nz links is added through the kemono link, the source will also be kemono.
Solution: Use "download url" field for filtering and not "source".
But I disabled the sourceurl and used a filter with only "Filetype - is not - video file" and it still wouldn't find any mega link. I even made a new filter that only lets video files through and ran with only that filter active and it still filtered the video.

So it seems to me that the problem is not with the construction of the filter, but rather with JD misidentifying what is a video file, or maybe mega itself?
Reply With Quote
  #78  
Old 18.09.2023, 10:38
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,730
Default

I don't understand.
The mega link leads to a ".mp4" video file so you do not want to filter that.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #79  
Old 18.09.2023, 15:36
uNderdog_101 uNderdog_101 is offline
Modem User
 
Join Date: Sep 2023
Posts: 4
Default

Quote:
Originally Posted by pspzockerscene View Post
I don't understand.
The mega link leads to a ".mp4" video file so you do not want to filter that.
Correct, I want to filter everything but mp4 files. However there seems to be an issue where JD won't let that particular mp4 through, even with only a single filter with a single instruction that should let it.

I made a filter that only lets through video files, it blocked that video file.

I just now made a filter that only lets through "*.mp4" filenames, it blocked it.

Sorry, but I don't know how I can be any clearer. Either JD has an issue properly identifying mp4 files, or Mega has an issue identifying their files as mp4s.

Edit: I just inverted the "*.mp4" filter so it would block only mp4 files, and it did, so it seem to have no issue when actually blocking, just letting through.

Last edited by uNderdog_101; 18.09.2023 at 15:50.
Reply With Quote
  #80  
Old 18.09.2023, 16:40
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,730
Default

All I can say is: The rule in my screenshot did work for me and the result was that when I was adding your kemono link, I only got the mega.co.nz file.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 18:20.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.