[Doom]

As the title said, can you add original file name option to the sankakucomplex plugin like you did for other similar sites?

Sankakucomplex seem to not have that but got other stuff like adding tags, but what I mostly want is the file names we got when we saves pics from the site manually

[pspzockerscene]

I've decided against a setting since in this case, using the "original" filenames may result in a lot of duplicated file names.

Instead, I've added a plugin property called "directurl_filename" which you can set as filename using a Packagizer rule, see:
https://support.jdownloader.org/know...paketverwalter

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!
---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

-psp-

[Doom]

I've been downloading manually from this site for a decade by now, and never had any duplicate files from it once as far as I recall though.

Won't using Packagizer will enable it for every site I'm downloading from?

And either even reading the manual for that, I'm not sure I know how to use it and will need some step by step guide ;/

[pspzockerscene]

Originally Posted by Doom

I've been downloading manually from this site for a decade by now, and never had any duplicate files from it once as far as I recall though.

Maybe I've mixed up two plugins or the situation has changed.

Originally Posted by Doom

Won't using Packagizer will enable it for every site I'm downloading from?

No.
Looks like you didn't even bother reading any of the articles I linked :(
https://support.jdownloader.org/know...paketverwalter
->
Read at least this one:
https://support.jdownloader.org/know...the-packagizer

Originally Posted by Doom

I know how to use it and will need some step by step guide ;/

Read the guide, then come back with your questions.

[pspzockerscene]

CORE-Updates have been released!
All announced bugfixes and features are live!
Please update your JDownloader and report any issues you find asap.
If this thread gets marked as "[Solved]" by our forum staff you can still post in it and we will read- and reply to it!

CORE-Updates wurden released!
Alle angekündigten Bugfixes/Features sind nun verfügbar!
Bitte JDownloader updaten und eventuelle Bugs schnellstmöglich an uns melden.
Falls dieser Thread vom Team als "[Erledigt]" markiert wird, kannst du weiterhin darin antworten und wir lesen/beantworten auch solche Threads!

-psp-

[pspzockerscene]

Example Packagizer rule sankakucomplex.com use "original" filenames:
Screenshot:


As text:
If downloadurl -> contains -> sankakucomplex.com
... then set
filename -> <jd:prop:directurl_filename>

[Doom]

No.
Looks like you didn't even bother reading any of the articles I linked :(

I did fast read it, but had some hard time grasp the idea there

CORE-Updates have been released!
All announced bugfixes and features are live!
Please update your JDownloader and report any issues you find asap.
If this thread gets marked as "[Solved]" by our forum staff you can still post in it and we will read- and reply to it!

I don't see any changes after the update, was it relate the SK plugin? ;o

Originally Posted by pspzockerscene

Example Packagizer rule sankakucomplex.com use "original" filenames:
Screenshot:


As text:
If downloadurl -> contains -> sankakucomplex.com
... then set
filename -> <jd:prop:directurl_filename>

Thx I will give it a try,

Also unrelated but Twitter/X not let us use JD to download videos from it anymore
Just thought I should report it on the way instead of opening a new thread just for that xD

[Jiaz]

Originally Posted by Doom

Also unrelated but Twitter/X not let us use JD to download videos from it anymore
Just thought I should report it on the way instead of opening a new thread just for that xD

Please see https://board.jdownloader.org/showthread.php?t=97337

Originally Posted by Doom

Thx I will give it a try,

In case you're stuck or need help, just let us know!

[Doom]

Originally Posted by Jiaz

Please see **External links are only visible to Support Staff**...

In case you're stuck or need help, just let us know!

Guess I will need to use other site to download stuff form X now I assume ; o


Seems like the Packagizer only did half the trick, but I should elaborate
Using SK over the years and depend how I've copied the link, would've gave me the files original name or some other names depend on what they changed at the time in their site,

So while single links now seem to show the ID right I can't be sure it solved it once and for all,


The other issue is that if you're copying a link from a tag search page (page 1,2, etc.) in SK Chan site, JD will detect all pics in the page but will only show them if a different name than their IDs again,

I've made another rule in the Packagizer so it should also use original names for anything that involves chan.sankakucomplex like in the pic you showed, but it not seem to work.

https://board.jdownloader.org/attach...1&d=1746056273

[Jiaz]

@Doom: If you encounter problems with packagizer rules and want help, it's always best to also include test links so we can actual test it!

Originally Posted by Doom

Guess I will need to use other site to download stuff form X now I assume ; o

We have not yet deep dived into that topic, so can't tell what direction this will take

[Doom]

@Doom: If you encounter problems with packagizer rules and want help, it's always best to also include test links so we can actual test it!

Alright here
05.05.25 09.46.16 <--> 05.05.25 09.48.04 jdlog://4721511370661/

It's worth to note that not only SK doesn't change the file names from a tag link (By tag link I mean: right click on a tag name and press copy it for the link grabber to detect it),
It's also doesn't catch all of the images past the tag's first page (usually only contain 30 pics per page),

It does change to the right name or detect any pic if I go into any pic link manually and copy its link directly though, but not if you're trying to grab all of the pics from the tag by copy the tag link, while in sites like gelbooru it works just fine (you can get all of the pics from the tag).


Speaking of gelbooru, while I don't want to slide from the subject too much, can you add the option to let us add our account in the account manager and let us see hidden pics?
The thing with gelbooru is that it also got hidden pics and you can change the option for them to be visible to you only if you have an account, but JD doesn't even have an entry for it in the account manager, so we can't do that there, nor have an option to see hidden pics in the plugins tab,
So as result the hidden pics not show up in the link grabber list.

[pspzockerscene]

Originally Posted by Doom

The other issue is that if you're copying a link from a tag search page (page 1,2, etc.) in SK Chan site, JD will detect all pics in the page but will only show them if a different name than their IDs again,

Yap and the reason for that is a technical one:
When adding all links of a tag page, the sankakucomplex.com crawler skips the linkcheck of these single items because it already knows that they are online.
The "original filename" property though can only be found when performing a single linkcheck on these items as only then, the direct download-URL is obtained by the plugin.
As a side-effect of this, the property "directurl_filename" is not available at the stage where the Packagizer rules are processed.

Possible solutions for this include:

1. You: Use an EventScripter script that ensures that the "original" filename is used for these items on download-start (most efficient custom solution)
2. or: Me: implement "original filename" plugin setting"
3. or: Me: Implement "Fast linkcheck" plugin setting -> You could then deactivate this and it would make things work. This is the most inefficient way which would bombard the website with lots of http requests.

I'm for option 1 since at this moment, not a single other user has asked for this feature so I (still) do not see the need for a dedicated plugin setting.

EventScripter subforum:
https://board.jdownloader.org/forumdisplay.php?f=52
EventScripter help article:
https://support.jdownloader.org/know...event-scripter

Originally Posted by Doom

It's also doesn't catch all of the images past the tag's first page (usually only contain 30 pics per page),

Example URLs please.
According to your logs:
/en/?tags=citlali_%28genshin_impact%29
->

[jd.plugins.decrypter.SankakucomplexComCrawler(crawlTagsPostsWebsite)] -> Stopping because: Reached user defined max page limit of 1

-> See Settings -> Plugins -> sankakucomplex.com -> Set the limit values to "-1" if you do not want the crawler to stop earlier.

Originally Posted by Doom

Speaking of gelbooru, while I don't want to slide from the subject too much, can you add the option to let us add our account in the account manager and let us see hidden pics?

Open a separate thread for this suggestion and provide all the information needed:
- Example links
- Login credentials -> Send to support@jdownloader.org

[Doom]

Yap and the reason for that is a technical one:
When adding all links of a tag page, the sankakucomplex.com crawler skips the linkcheck of these single items because it already knows that they are online.
The "original filename" property though can only be found when performing a single linkcheck on these items as only then, the direct download-URL is obtained by the plugin.
As a side-effect of this, the property "directurl_filename" is not available at the stage where the Packagizer rules are processed.

Possible solutions for this include:
You: Use an EventScripter script that ensures that the "original" filename is used for these items on download-start (most efficient custom solution)
or: Me: implement "original filename" plugin setting"
or: Me: Implement "Fast linkcheck" plugin setting -> You could then deactivate this and it would make things work. This is the most inefficient way which would bombard the website with lots of http requests.
I'm for option 1 since at this moment, not a single other user has asked for this feature so I (still) do not see the need for a dedicated plugin setting.

EventScripter subforum:
https://board.jdownloader.org/forumdisplay.php?f=52
EventScripter help article:
https://support.jdownloader.org/know...event-scripter

I see,

I've tried the EventScripter but idk a jack about Java so I can't make a script past the trigger point ;/
Is there any example I could use?

Example URLs please.
According to your logs:
/en/?tags=citlali_%28genshin_impact%29
->
Code:
[jd.plugins.decrypter.SankakucomplexComCrawler(crawlTagsPostsWebsite)] -> Stopping because: Reached user defined max page limit of 1
-> See Settings -> Plugins -> sankakucomplex.com -> Set the limit values to "-1" if you do not want the crawler to stop earlier.

Thx, that worked, but only half way,
It seem to detect more links now, but it will still won't show all of them,
For the tag in the log for example there's currently 303 links,
However JD only grabs 273, and in SK case the plugin does use my account so it should be able to see if anything is hidden I think.

Open a separate thread for this suggestion and provide all the information needed:
- Example links
- Login credentials -> Send to support@jdownloader.org

Ah..... ehhhh I will do so.... eventually I guess >.>

What is Login credentials?
My username and pass?

[pspzockerscene]

gelbooru.com:
For the next update:
Added test version of plugin with login support.
I was unable to find links with "hidden" items so I was unable to test if it's working in the expected way.

Originally Posted by Doom

I've tried the EventScripter but idk a jack about Java so I can't make a script past the trigger point ;/
Is there any example I could use?

Ask in our EventScripter subforum:
https://board.jdownloader.org/forumdisplay.php?f=52

Originally Posted by Doom

For the tag in the log for example there's currently 303 links,
However JD only grabs 273

You are talking about the link "/en/?tags=citlali_%28genshin_impact%29", right?
I can see the problem though I'm not going to look for the specific missing items.
Please name some postIDs that are missing.
In the past, such problems were sometimes server-side aka the total number displayed by such a website was wrong due to it including items that had been deleted a long time ago.

Originally Posted by Doom

What is Login credentials?
My username and pass?

Yes though as mentioned at the beginning of this post, next update will contain a test-version with login support which with a bit of lock, will already work in the way you expect it to work (find "hidden" items).

[Jiaz]

Originally Posted by pspzockerscene

I can see the problem though I'm not going to look for the specific missing items.
Please name some postIDs that are missing.

Please check again with next update. Optimized removal of ads/news and such unwanted items.

[pspzockerscene]

@Jiaz
Finds 311 items here now.
This matches the results I got after completely removing our ad-filter code.
EDIT

Okay my bad:
This item contains a total of 312 items now.
This means that now if at all, one item is missing.
EDIT2
Without any ad removal code && without ads from sankakucomplex, I still only get 311 of 312 items.
Possibly a server side problem?

[Doom]

For the next update:
Added test version of plugin with login support.
I was unable to find links with "hidden" items so I was unable to test if it's working in the expected way.

Yes though as mentioned at the beginning of this post, next update will contain a test-version with login support which with a bit of lock, will already work in the way you expect it to work (find "hidden" items).

Thx I will give it a try and see if it detects everything,
Even if someone is logged in, it doesn't mean the settings are the same (by default hidden stuff are off even if you're logged in until you changes it) so depending on how it goes it may need some option in JD plugin... if it even be possible.

EDIT,
So far it still seem to not detect hidden IDs I think,
That **External links are only visible to Support Staff**link for example has 2255 IDs but JD only picks 2231 from gelbooru even with user logged in.

Also from what they're saying you actually doesn't need an account to enable that setting,
So if that really is the case maybe we can add it to the plugin after all?

Ask in our EventScripter subforum:
https://board.jdownloader.org/forumdisplay.php?f=52

Alright I will try to open thread there.

Without any ad removal code && without ads from sankakucomplex, I still only get 311 of 312 items.
Possibly a server side problem?

Nice progress so far :o
I won't be surprise if it's on their end but can't really check,
The site got too many stuff on it to pinpoint things one by one.

[pspzockerscene]

About gelbooru:

Originally Posted by Doom

Also from what they're saying you actually doesn't need an account to enable that setting,

Yap indeed.
That setting is on the options page which can also be accessed without account:
gelbooru.com/index.php?page=account&s=options

Originally Posted by Doom

So if that really is the case maybe we can add it to the plugin after all?

As far as I can see that setting simply sets a cookie called "fringeBenefits" with the value "yup".
The plugin already does that.
(It already did that before you had posed your question.)

Please collect some items that are missing and tell me on which page they are located so I can look deeper into this.
Also, I still recommend to open a separate thread for "gelbooru.com" as it is not related to "sankakucomplex".

Originally Posted by Doom

but can't really check,

Yes you can:
Look into the html code of each page and count the number of times you find the text "/posts/".
For the first page, substract/ignore the ad-items.

You need to do this for all pages; you can find the hidden "pagination links" in your own JD logs, search for text nextPageURL = .

Page 1:
/en/?tags=citlali_%28genshin_impact%29
Page 2:
/en/posts?next=P7RL5jkloM6&page=2&tags=citlali_%28genshin_impact%29
...and so on, see JD sankakucomplex plugin logs.

Page 11 (because that along with page 1 is the most interesting):
/en/posts?next=8yrxO0JWAaE&page=11&tags=citlali_%28genshin_impact%29

Instrunctions on how to view your own JD logs:
https://support.jdownloader.org/know...d-session-logs

-> Debug mode needs to be active otherwise you will not find this detailed information about sankakucomplex crawl processes.

My results:
Page 1: 29 items
Page 2-10: 30 items each
Page 11: 12 Items

If you come to the same conclusion, it might be worth reporting this to the sankakucomplex.com team.
Possible outcomes:

• we are wrong -> Bug in plugin
• or: the total number of items on sankakucomplex.com is wrong
• or: one item is actually missing and or one item is duplicated by sankakucomplex (duplicates are filtered by JD)

[Jiaz]

Originally Posted by Doom

for example has 2255 IDs but JD only picks 2231 from gelbooru even with user logged in.

What makes you think that ther are 2255 links? There are 53 pages *42 items + 5 items on last page = 2231 items.

Edit: Ah the number on the left. I guess those numbers are either not updated often or does also include unavailable/not visible items

Edit2: JDownloader found all available items. I manually have clicked through all pages and came up with exact same number (with and without being logged in)

Originally Posted by pspzockerscene

I still only get 311 of 312 items.

We found the cause, wait for next plugin update

[Doom]

Ahhh,
Overall from the last posts it's sound like you more or less fixed all there is to be fixed and the rest of the stuff like wrong number of posts may be due to the reasons you listed?

Do I still need to do the log thing then?
Also unless I've missed anything there, the link that show how to view the logs only show how to enable and send them over rather than tell me how to view them, I do know where the log folder is, but dk which file is relevant and with what kind of app I need to open it (notepad? code viewer?) in order to look into it.


As long as gelbooru detect all of the hidden posts,
And SK detect all images in each page now (which are 20 pics per page on my end btw, not 30) then all that I have left is to go to the EventScripter sub forum and try to solve the other issue with IDs now.

[Jiaz]

@Doom: You don't need the "log thing" enabled any longer. Can't tell if we have fixed all reported issues but we tried our best and fixed what we found/could reproduce. You should still report any findings on errors or missing images but at the moment I was not able to reproduce any such error.
The log folder is the "logs" folder within your JDownloader, see https://support.jdownloader.org/de/k...tion-directory.

Originally Posted by Doom

Also unless I've missed anything there, the link that show how to view the logs only show how to enable and send them over rather than tell me how to view them, I do know where the log folder is, but dk which file is relevant and with what kind of app I need to open it (notepad? code viewer?) in order to look into it.

It explains it all at the beginning. It cannot explain where to look as this totally happens from what kind of error you encounter. For plugin errors, they should be located within files that have the host-/sitename in filename

In case you want to manually take a look at your logs: Logs are kept within your 'installation path\logs\'.
Different sessions are stored in different subdirectories.
Logs are kept in raw text and you can open them in your preferred text-editor.

[Doom]

Ok so,
I've looked for a tag with short image pages in SK so I could count all tabs,
And seems like the issue is still around.

**External links are only visible to Support Staff**This tag got 38 images (And I've count this time around)
But JD grabber detect only 31

23.05.25 10.27.40 <--> 23.05.25 10.28.06 jdlog://6071511370661/


Edit: I've took the opportunity to test the same tag on gelbooru,
in gelbooru the tag got 51 images and JD grabber detected all the 51 of them.

[Jiaz]

@Doom: You have to login at sk, then JDownloader will find 38 instead of 31 (same as in browser) images. Also wait for next plugin update, as it seems the login either expires fast or not recommended to use account in multiple tools (eg browser and JDownloader) at the same time. For me sometimes JDownloader session is no longer valid and needs to be refreshed (added with next update)

[Doom]

Alright,
I will see if it work after the update

[Jiaz]

@Doom: Update is live, please test and provide feedback. With being logged in, JDownloader was able to find all 38 images from your example link