[Anomalous]

When adding links, it seems that JD can see the PNGs, but when I start the downloads they revert to low quality jpgs instead. I would like to grab the PNGs.

**External links are only visible to Support Staff****External links are only visible to Support Staff**

Original is a 1.27mb png, but a 147kb jpg is downloaded instead

[pspzockerscene]

Fixed.

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!
---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

Important notice:
Our ticket system & knowledgebase are currently under maintenance.
If this is still the case while you are reading my posts and you can't access help articles linked by our staff, use the Internet archive/wayback machine to be able to view those articles:
archive.org/web/
Enter the URL -> Click on "Browse history" -> Select one of the latest dates available
If the date you selected does not lead you to the support article try the next oldest one.

[Anomalous]

Thanks! It works for public/swf images, but doesn't for images with an 18+ rating
example: **External links are only visible to Support Staff****External links are only visible to Support Staff**

It still grabs the low quality jpgs for some reason

[pspzockerscene]

I'm unable to find any "original" image for this one.
Disclaimer: I'm not logged in - the JDownloader plugin also is not logged-in, maybe that would make a difference in this case?
EDIT

Got it working.

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!
---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

-psp-

[Anomalous]

Oh, cool. Yeah, I'm able to paste the actual image URL into another browser that's not logged in and I'm still able to download PNGs, so I figured maybe it's possible without an account. Thanks for looking into this!

Edit: Is there some packagizer setting I can use so I can have JD rename the files after the image url/post ID?

[pspzockerscene]

Originally Posted by Anomalous

Edit: Is there some packagizer setting I can use so I can have JD rename the files after the image url/post ID?

Sure, see Packagizer docs:
https://support.jdownloader.org/de/k...paketverwalter

[Jiaz]

@Anomalous: In case you need help/got questions with packagizer, please just ask

[Anomalous]

Thank you! I was looking for a way to name the downloaded files after the post ID from the url with something like <jd:prop:x>, but I suppose those vary by plugins and if they even exist to begin with. I'm guessing it's also possible with regex but I have no idea how to be honest.

[pspzockerscene]

No problem - there is an easy website to learn and test regex: regex101.com.

You can simply extract the ID from the source URL and add it to your desired filename.

[pspzockerscene]

Looks like while I was writing my last post, civitai.com has updated their website which has rendered our plugin broken for now.

[Anomalous]

Got it. Yeah, Looks like some posts work and some don't. And thanks, I'll look into the regex stuff eventually.

[Jiaz]

@Anomalous: we'll check on plugin by monday

[nobody-U-know]

You fixed it already?

After almost six hours, it's working again.

[Jiaz]

@nobody-U-know: no changes from our side. most likely they reverted their changes

[VanTuz]

The program downloads the reduced versions of the images again

[Jiaz]

@VanTuz: Can you provide examples? Still looking good here and working to download the original.

[VanTuz]

**External links are only visible to Support Staff****External links are only visible to Support Staff** - if you insert this link into the program, a 145 kb file with a resolution of 832x1216 will be downloaded.
**External links are only visible to Support Staff****External links are only visible to Support Staff** - direct link to the file, 240 Kb, 1200x1754

[Jiaz]

@VanTuz: the 145kb one is the original, you can check the download button in browser. the url contains original=true, while the other one is a resize+compression one

[VanTuz]

OK then. The only thing is a pity that the program cannot extract links to images by itself, as it does with kemono, but at least some kind of opportunity to download images pleases.

[Jiaz]

@VanTuz: what do you mean by *cannot extract links to images*? I does support /images/ links and others but currently does not have account support and thus can only parse/find links that are public available without account

[VanTuz]

I probably put it wrong. I meant that you can't put a link to the author's gallery and get all the images.

[Jiaz]

Originally Posted by VanTuz

I probably put it wrong. I meant that you can't put a link to the author's gallery and get all the images.

Check again with next update

[VanTuz]

After the update, the program found 309 out of 1,700 images.

[Jiaz]

Originally Posted by VanTuz

After the update, the program found 309 out of 1,700 images.

Please provide example links so I can check this. My tests were okay but maybe those are age restricted images and/or models.

[VanTuz]

**External links are only visible to Support Staff****External links are only visible to Support Staff** - I inserted this link into the program

[pspzockerscene]

We are using the following API request which does not seem to return more items:

github.com/civitai/civitai/wiki/REST-API-Reference#get-apiv1images

-> Example request:

civitai.com/api/v1/images?username=<username>&limit=100

That is processed until the field "nextPage" does not exist anymore or is null.
Please check that we are using the correct API request and if so, report this possible API bug to the civitai.com support.

[Jiaz]

@VanTuz: Can you please check the link in browser, in incognito tab. My guess is that this account has many mature/age restricted images, and those are not part of api response when not using account. JDownloader does not yet support account and thus can only access/handle given images when they are restricted but api will not return any restricted items at all. For sure I don't get/see 1700 images in browser when scrolling down, so most likely this is the root cause.

[VanTuz]

I checked in incognito mode- and it's true, only sfw images are displayed

[pspzockerscene]

Please send your civitai.com to us via support@jdownloader.org then we can check to add login-support for this website.

[pspzockerscene]

Addendum:
Fixed!
I found a bug in their API. Access to your civitai.com account is not needed anymore.
Quoting their API docs about optional URL-parameter "nsfw":

nsfw (OPTIONAL) boolean | enum (None, Soft, Mature, X) Filter to images that contain mature content flags or not (undefined returns all)

Indeed, undefined does not return all!
Defining "nsfw" and setting it to "X" will return all items:

civitai.com/api/v1/images?username=<username>&limit=100&nsfw=X

@VanTuz
I highly recommend reporting this bug to the support staff of civitai.com since either their docs are wrong or their API contains said bug and other developers will definitely run into the same problem.

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!
---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

-psp-

[VanTuz]

I am not an expert in programming. What exactly do I need to write to them?

[pspzockerscene]

No worries I just did that.
Public report:

github.com/civitai/civitai/issues/1277

[VanTuz]

Thanks. Best support ever.

[pspzockerscene]

Thanks for that compliment.

Said JD update is live.

[VanTuz]

**External links are only visible to Support Staff****External links are only visible to Support Staff** - The author's page indicates that he has more than 9,000 works, but the program finds only about 5,500. Do I need to do some manipulations to get all the images or is this how it should be?

[Jiaz]

@VanTuz: most likely they have changed api and no longer return restricted items. we will check that

[pspzockerscene]

@VanTuz
In the future, please always(!) provide logs in such cases because debugging such things can be very time consuming!

About the problem:
The API is sometimes returning non-full pages (e.g. 5 items instead of 10) which made the plugin think that it has reached the last page.
This is another potential API bug [or some items have been deleted from those pages in the meantime] but I won't report this one.
I've updated the plugin to just continue crawling until a page contains zero new items.

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!
---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

-psp-

[Jiaz]

@VanTuz: fixed with next update. there are some deleted/removed images that broke pagination.

[VanTuz]

Thanks a lot