[ozora]

Hi,

The pixiv plugin seems to have issues determining the difference between a single image submission and a multi image submission when crawling galleries.

When crawling a gallery such as **External links are only visible to Support Staff****External links are only visible to Support Staff** , it correctly manages to find all of the submissions in the gallery by ID, but then treats them all as multi image submissions, which use a different URL than single image submissions. In the case of this gallery, that means most of the data links are broken and display "Plugin Defect!member_illust.php".

For example, one of the download links here was
**External links are only visible to Support Staff****External links are only visible to Support Staff**
which is broken, the correct link for this type of submission should be
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Even when crawling a single image link (eg **External links are only visible to Support Staff****External links are only visible to Support Staff**) directly, it returns "Plugin Defect!member_illust.php", so perhaps site changes have just left single image links broken.

[Jiaz]

I've optimized crawler to better handle single/multi-image links.
Please wait for next plugin update. Please enable debug mode in Settings-Advanced Settings-Log.debugmodeenabled and restart JDownloader.
In case you encounter Plugin defect again, please create a log, see https://support.jdownloader.org/Know...d-session-logs and post the shown logID here

[Galuthien]

Hi, I wanted to know if it is possible to download Flash / animations in Pixiv using the Jdownloader add-on ...

I can download all the images with the help of the add-on, but the animations are downloaded in a zip file, then, when I extract the file, several images (in sequence) are extracted from the animation I want to download.

Is it possible that the animations are downloaded in Jdownloader directly as swf files and not as zip files?

[Jiaz]

JDownloader can only download what is available and as far as I know the animations are just single images that are played back in browser, so no, no swf file available to download. But of course I can check, please provide example links

[simon_7617118]

Hi. I'm not sure if the plugin has been updated, but I'm experiencing the same issue as the first poster. Links from image sets seem to be crawled correctly, albeit with a lot of extraneous broken links. Single image posts are not getting picked up.
28.05.18 15.37.06 <--> 28.05.18 15.41.47 jdlog://1698854433151/
Thank you.

[Galuthien]

Originally Posted by Jiaz

JDownloader can only download what is available and as far as I know the animations are just single images that are played back in browser, so no, no swf file available to download. But of course I can check, please provide example links

In this link there are some animations:

**External links are only visible to Support Staff****External links are only visible to Support Staff**

[Jiaz]

@simon_7617118: Please provide example links. I could not reproduce any issue. I did test gallery links and single image links without any error. Your log does not contain a single error?!

[Jiaz]

@Galuthien: The animation is provided as zip and JDownloader also shows the zip when you add the link/gallery.

[simon_7617118]

This would be a good one to test because it's huge and has a mix of single and multi image entries:
**External links are only visible to Support Staff**...

There are 317 entries, but JD is grabbing only 87 multi-image entries. All the single posts are ignored when I use the gallery url, and produce a "Plugin Defect!member illust" entry when I input them individually.

This happens with every gallery. My JD version is up to date.

[Galuthien]

@Jiaz: Yes, it happens to me...

Maybe in the future it would be good to consider correcting that flaw so that you can download animations from Pixiv with the addon in Jdownloader.

[Jiaz]

@simon_7617118: can you please send the link to support@jdownloader.org
Also please provide a debug log for the plugin defect!
Enable Settings-Advanced Settings-https://support.jdownloader.org/Knowledgebase/Article/View/47/0/how-to-create-and-upload-session-logs and restart JDownloader
Now reproduce the issue and create log, see https://support.jdownloader.org/Know...d-session-logs
and post the shown logID or send to support@jdownloader.org

[Jiaz]

@Galuthien: JDownloader already supports downloading the animations as zips. What flaw do you mean then?

[Jiaz]

I cannot reproduce any issue, so please provide logs (see post above) and example links. In case you're using an account, please also send me logins to support@jdownloader.org, maybe the issues are linked to account usage as I'm not using any account at all

[simon_7617118]

The problem has become more complicated with some investigation.

Pixiv seems to have been rolling out a new layout to only some accounts. My old account login uses the new layout. I created a new account, and it uses the old layout. It seems this is random and one does not have control over it, nor can it be reverted.

Urls are the same, image urls are the same, but the layout of the page is different. I've copied them to Pastebin so you can take a look.

**External links are only visible to Support Staff****External links are only visible to Support Staff**

Old layout style. Account that get this old layout can still grab links correctly in JDownloader:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

New layout style. Accounts that get this cannot grab links properly in JDownloader:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

I hope this helps.

[Galuthien]

Originally Posted by Jiaz

@Galuthien: JDownloader already supports downloading the animations as zips. What flaw do you mean then?

The problem is that after extracting the zip file does not appear the flash animation in swf format, but several images appear .jpg (in sequence) of the animation that I want to download ...

The normal thing would be that after downloading the animation in Jdownloader it should appear directly in .swf format, and not in a sequence of images in jpg format ...

I know a page where I can download the Pixiv animations, but I find it tedious to do it by that method since the page can not download all the animations at once, because I have to download the animations one by one ...

[Jiaz]

@Galuthien: The animation does not exist as swf but the zip from server simply contains the single images and played back via javascript. There is no swf at all. I will try to find an easy solution that can put images into swf file.

[Jiaz]

@simon: Thanks for the information and html source

You do get new layout only with account, don't you?
Or also without any account at all?

[simon_7617118]

Without account, the plugin works fine with one caveat: it's not grabbing anything past the first gallery page, because only registered users get full access.

My personal account, which is pretty old, has been rolled to the new layout. The account I just registered uses the old layout, but I assume somewhere down the line it will switch over. I bet this is why people with newer accounts aren't getting problems in JDownloader yet.

Multi-image posts aren't getting this problem yet at all, because as far as I can tell the layout for those posts are unchanged.

[Jiaz]

Could you please provide some more pastebins? one/two? if possible old/new ?

[simon_7617118]

Hello,

Single Pic
**External links are only visible to Support Staff****External links are only visible to Support Staff**
New format: **External links are only visible to Support Staff****External links are only visible to Support Staff**
Old Format: **External links are only visible to Support Staff****External links are only visible to Support Staff**

Single Pic
**External links are only visible to Support Staff****External links are only visible to Support Staff**
New format: **External links are only visible to Support Staff****External links are only visible to Support Staff**
Old Format: **External links are only visible to Support Staff****External links are only visible to Support Staff**

Multi-pic (12) (the images open in a second window/page 2)
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
New format page 1: **External links are only visible to Support Staff****External links are only visible to Support Staff**
New format page 2: **External links are only visible to Support Staff****External links are only visible to Support Staff**
Old format page 1: **External links are only visible to Support Staff****External links are only visible to Support Staff**
Old format page 2: **External links are only visible to Support Staff****External links are only visible to Support Staff**