JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #81  
Old 22.10.2023, 09:01
shinji2009 shinji2009 is offline
Ultra Loader
 
Join Date: Aug 2021
Posts: 49
Default

hi. now kemono.party moves to kemono.su. is there a way to make jd handle kemono.su links as kemono.party links and not download what was already downloaded from kemono.party?
Reply With Quote
  #82  
Old 23.10.2023, 11:10
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,822
Default

Domain kemono.su is already supported.
If it doesn't work, please provide example URLs and a debug-log.

Please post your log-ID here
If your bugreport is about a specific website which JD supports via plugin, please also provide example URLs which can be used to reproduce the issue you are having.

Bitte poste deine Log-ID hier.
Falls dein gemeldetes Problem ein Problem mit einer Webseite ist, die per Plugin unterstützt wird, stelle bitte zusätzlich Testlinks zur Verfügung, mit denen sich dein Problem nachstellen lässt.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 23.10.2023 at 11:10. Reason: Fixed typo
Reply With Quote
  #83  
Old 23.10.2023, 14:18
shinji2009 shinji2009 is offline
Ultra Loader
 
Join Date: Aug 2021
Posts: 49
Default

i know it is supported, my question is not about support
Reply With Quote
  #84  
Old 23.10.2023, 14:19
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,822
Default

The duplicate detection should already work across domains if you mean that.
If it doesn't work for you, please provide example URLs.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #85  
Old 23.10.2023, 15:11
shinji2009 shinji2009 is offline
Ultra Loader
 
Join Date: Aug 2021
Posts: 49
Default

basically every artist crawls anew. except txt files.
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #86  
Old 23.10.2023, 16:04
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,822
Default

This time kemono has also changed the domain inside the data-URLs.
I've tried to add a better duplicate detection some time ago but that broke backward compatibility.
I did then revert those changes upon your request.
Reference:
https://board.jdownloader.org/showth...055#post525055

I will re-add the new method for the next set of CORE-updates.

You will still loose backward-compatibility for duplicate check on previously added items.
Here is what you will need to do after(!) said update:
1. Remove all previously added/downloaded items from your downloadlist.
2. Re-add those items to your downloadlist.
3. Now duplicate detection will also work against new items and independent from the domain used inside the URLs.

About text files:
Those didn't exist in beforehand so they're already using the new dupe-check IDs -> Text-files dupecheck will work cntinuously for old- and new items.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 23.10.2023 at 16:05. Reason: Added more information
Reply With Quote
  #87  
Old 23.10.2023, 16:22
shinji2009 shinji2009 is offline
Ultra Loader
 
Join Date: Aug 2021
Posts: 49
Default

if backward-compatibility not working now and will be not working after re-adding the new method, is there a point of this re-adding? i mean. i still have to download everything if i don't want to lose time manually picking what to download. or by 1. and 2. you mean something but downloading it agan?

Last edited by shinji2009; 23.10.2023 at 16:26.
Reply With Quote
  #88  
Old 23.10.2023, 16:27
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,822
Default

Depends on you:
If you got a lot of items in your downloadlist which you want to use for duplicate checking, you might want to refresh them.
Either way you can also just create a backup of your settings and downloadlist, wait for the update and then just see what fits you better.

I know that this is not ideal but please keep in mind that JDownloader was never ment to be a precise database-like archiving tool so problems like this can happen over time.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 23.10.2023 at 16:27. Reason: Added Link to backup instructions
Reply With Quote
  #89  
Old 23.10.2023, 16:34
shinji2009 shinji2009 is offline
Ultra Loader
 
Join Date: Aug 2021
Posts: 49
Default

what do you mean by refresh. i edited my previous post, please check. if this can be done by not downloading everything again, please make it more clear how to do it

yes i understand about database and i am very grateful for your support
Reply With Quote
  #90  
Old 23.10.2023, 16:37
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,822
Default

No you will not need to re-download the items, just delete them from your download list, re-add them and disable them so that the check "is already in downloadlist" in the linkgrabber will work fine for all newer items then.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #91  
Old 23.10.2023, 17:14
shinji2009 shinji2009 is offline
Ultra Loader
 
Join Date: Aug 2021
Posts: 49
Default

so i need to
1. wait for core update
2. backup download list
3. empty download list
4. stop downloads
5. restore download list
6. disable kemono links in download list

why i have to disable links after restore, don't they backuped as already downloaded?
Reply With Quote
  #92  
Old 23.10.2023, 17:15
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,822
Default

Quote:
Originally Posted by shinji2009 View Post
why i have to disable links after restore, don't they backuped as already downloaded?
Becaue you probably do not want to re-download the files - you just want the duplicate-check to work.

Also, you can already create the backup now.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #93  
Old 23.10.2023, 18:31
shinji2009 shinji2009 is offline
Ultra Loader
 
Join Date: Aug 2021
Posts: 49
Default

not working, all the same - only txt files are highlited red.
download list restored as downloaded, so jd didn't try to download files again.

Last edited by shinji2009; 23.10.2023 at 18:36.
Reply With Quote
  #94  
Old 23.10.2023, 18:36
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,822
Default

I said that what I wrote counts once the next CORE-update is released.

That update and the changes haven't been released yet and I can't provide any ETA for the release of said changes.
Please be patient and wait.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #95  
Old 23.10.2023, 18:38
shinji2009 shinji2009 is offline
Ultra Loader
 
Join Date: Aug 2021
Posts: 49
Default

oh sorry i was thinking "you can already create the backup now" means everything is done. ok.
Reply With Quote
  #96  
Old 25.10.2023, 16:26
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,822
Default

The data on kemono.party / coomer.party is static, right?
Once a post is published, new items are not being added to it, right?
I'm looking for a good way for duplicate checking.
At this moment, I'd do it like this:
Example:
Code:
kemono.su/patreon/user/24010882/post/89769521
Unique ID for each file would be something like this:
Code:
kemono://patreon/user/24010882/post/89769521/file/1
(The "/1" at the end simply represents the position of the item.)
Alternatively I could also use the "f" parameter inside their URLs since it's mostly given e.g.:
Code:
c3.kemono.su/data/1d/c0/CENSORED_BY_PSP_DUE_TO_NSFW.jpg?f=4R4A0159.jpg
-> Unique ID:
Code:
kemono://patreon/user/24010882/post/89769521/file/4R4A0159.jpg
I'm waiting for your input before doing any code changes on the new dupe-IDs.
EDIT

This would work fine as long as a post will never have multiple files with the same name according to the parabeter "f" inside the URL.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 26.10.2023 at 14:00. Reason: EDIT
Reply With Quote
  #97  
Old 26.10.2023, 14:30
shinji2009 shinji2009 is offline
Ultra Loader
 
Join Date: Aug 2021
Posts: 49
Default

i don't understand what is the question
Reply With Quote
  #98  
Old 26.10.2023, 14:40
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,822
Default

Okay again:

You want JDownloade to be able to recognize duplicates of this website in a reliable way.
My question is: What's the best way to create the duplicate detection in this case.

I'm asking you as you are more familiar with this website.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 26.10.2023 at 14:53. Reason: Fixed two typos
Reply With Quote
  #99  
Old 26.10.2023, 15:08
shinji2009 shinji2009 is offline
Ultra Loader
 
Join Date: Aug 2021
Posts: 49
Default

best way will be probably more flexible one, which will not fail/will be easy adjustable in the future if they change domain again. or structure of links. or something.

also please remeber that without https://board.jdownloader.org/showpo...18&postcount=8 jd miss a lot of files from kemono sometimes. i don't know if this can affect to dupe checking
Reply With Quote
  #100  
Old 26.10.2023, 15:12
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,822
Default

Quote:
Originally Posted by shinji2009 View Post
best way will be probably more flexible one, which will not fail/will be easy adjustable in the future if they change domain again. or structure of links. or something.
I know and that's exactly why I'm asking you too.
Okay so...to be more precise:
Do you think that it is possible that one post contains two or more URLs with the same filename (leading to different files) according to the "f" parameter inside the URLs?

Quote:
Originally Posted by shinji2009 View Post
also please remeber that without https://board.jdownloader.org/showpo...18&postcount=8 jd miss a lot of files from kemono sometimes. i don't know if this can affect to dupe checking
This will not be affected by my upcoming changes since I will not touch the filenames.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 19:27.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.