JDownloader Community - Appwork GmbH
 

Notices

Reply
 
Thread Tools Display Modes
  #1  
Old 26.02.2020, 01:27
accelheim accelheim is offline
JD Addict
 
Join Date: Jan 2020
Posts: 158
Default Pixiv packages

I pasted 500 links into jDownloader but somehow when finished grabbing the links it only lists 450 packages. I'm not sure if that's normal or if links are now missing and aren't downloaded. What could be the reason for that?

Every link is in this format:

**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #2  
Old 26.02.2020, 01:34
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,140
Default

Hi,
your URL only leads to a single picture.
Please provide the mentioned 500 items so we have something to test with.
Are you sure that among those 500 items, there were no duplicates?
JDownloader will usually detect dupes and only list them once.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #3  
Old 26.02.2020, 02:06
accelheim accelheim is offline
JD Addict
 
Join Date: Jan 2020
Posts: 158
Default

I will check if there are any duplicates. Other than that, I also see that the packages are downloaded much slower than about 2 months ago. Pixiv also got a new layout and the url for user profiles changed. Is that the reason?
Reply With Quote
  #4  
Old 26.02.2020, 02:10
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,140
Default

Quote:
Originally Posted by accelheim View Post
I will check if there are any duplicates.
Again:
When I add your URL, I only get one image.
There is no way for me to test your report without adding the 5XX items you did ...

Quote:
Originally Posted by accelheim View Post
Other than that, I also see that the packages are downloaded much slower than about 2 months ago. Pixiv also got a new layout and the url for user profiles changed. Is that the reason?
This is possible.
Yes their website has changed and yes, I also updated our plugin then.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #5  
Old 26.02.2020, 17:27
accelheim accelheim is offline
JD Addict
 
Join Date: Jan 2020
Posts: 158
Default

Thanks for the feedback. I now tried to "add links" instead of "paste" them, and it found all the packages. What's the reason for this?
Reply With Quote
  #6  
Old 26.02.2020, 17:33
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,140
Default

Quote:
Originally Posted by accelheim View Post
Thanks for the feedback. I now tried to "add links" instead of "paste" them, and it found all the packages. What's the reason for this?
Again without your proper example URLs I'am unable to give you any answer.
There is no intentional function made by us to hide/lose items.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #7  
Old 26.02.2020, 21:18
accelheim accelheim is offline
JD Addict
 
Join Date: Jan 2020
Posts: 158
Default

My bad, I checked the links and indeed there were duplicates! However there where a link that didn't get downloaded with the message "invalid download directory" although it were downloaded in the same as the rest.
Link:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Another question regarding Pixiv: is there a way to download gif/video/ugoira files? They always come out as jpg.
Example:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #8  
Old 26.02.2020, 21:40
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,140
Default

Quote:
Originally Posted by accelheim View Post
My bad, I checked the links and indeed there were duplicates! However there where a link that didn't get downloaded with the message "invalid download directory" although it were downloaded in the same as the rest.
Link:[...]
Some systems do not like very long filenames or specified chars in filenames.
The filename of this particular item seems to be very long.
Shorten it (you can edit it in JDownloader in the download list) and it should be downloadable - at least it is here.

Quote:
Originally Posted by accelheim View Post
Another question regarding Pixiv: is there a way to download gif/video/ugoira files? They always come out as jpg.
Example:[...]
Please add more information.
What is "ugoira"?
Also when I open your URL, I don't see moving image (= a gif) at all.
Our crawler finds one single image and two .rar archives containing more images in differen qualities (?)
Code:
79746651_master1200.jpg
and
79746651_ugoira600x600_600x600.zip
and
79746651_ugoira1920x1080_1920x1080.zip
-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #9  
Old 26.02.2020, 22:33
accelheim accelheim is offline
JD Addict
 
Join Date: Jan 2020
Posts: 158
Default

Here is another example of an ugiora file:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

A UGOIRA file is an animated image file created by pixiv, a Japanese online community of artists. ... UGOIRA files are similar to animated . GIF files and improve on the GIF format as they are not restricted to 256 colors and are commonly smaller in size.
Reply With Quote
  #10  
Old 26.02.2020, 22:42
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,140
Default

Quote:
Originally Posted by accelheim View Post
A UGOIRA file is an animated image file created by pixiv, a Japanese online community of artists. ... UGOIRA files are similar to animated . GIF files and improve on the GIF format as they are not restricted to 256 colors and are commonly smaller in size.
I've checked this out.
This is not a new file-format.
They're simply displaying a lot of .jpg files with a small delay:
Code:
pixiv.net/ajax/illust/79749222/ugoira_meta
-->
Code:
{"error":false,"message":"","body":{"src":"https:\/\/i-f.pximg.net\/img-zip-ugoira\/img\/2020\/02\/27\/00\/26\/32\/79749222_ugoira600x600.zip","originalSrc":"https:\/\/i-f.pximg.net\/img-zip-ugoira\/img\/2020\/02\/27\/00\/26\/32\/79749222_ugoira1920x1080.zip","mime_type":"image\/jpeg","frames":[{"file":"000000.jpg","delay":30},{"file":"000001.jpg","delay":30},{"file":"000002.jpg","delay":40},{"file":"000003.jpg","delay":30},{"file":"000004.jpg","delay":30},{"file":"000005.jpg","delay":40},{"file":"000006.jpg","delay":30},{"file":"000007.jpg","delay":30},{"file":"000008.jpg","delay":40},{"file":"000009.jpg","delay":30},{"file":"000010.jpg","delay":30},{"file":"000011.jpg","delay":40},{"file":"000012.jpg","delay":30},{"file":"000013.jpg","delay":30},{"file":"000014.jpg","delay":40},{"file":"000015.jpg","delay":30},{"file":"000016.jpg","delay":30},{"file":"000017.jpg","delay":40},{"file":"000018.jpg","delay":30},{"file":"000019.jpg","delay":30},{"file":"000020.jpg","delay":40},{"file":"000021.jpg","delay":30},{"file":"000022.jpg","delay":30},{"file":"000023.jpg","delay":40},{"file":"000024.jpg","delay":30},{"file":"000025.jpg","delay":30},{"file":"000026.jpg","delay":40},{"file":"000027.jpg","delay":30},{"file":"000028.jpg","delay":30},{"file":"000029.jpg","delay":40},{"file":"000030.jpg","delay":30},{"file":"000031.jpg","delay":30},{"file":"000032.jpg","delay":40},{"file":"000033.jpg","delay":30},{"file":"000034.jpg","delay":30},{"file":"000035.jpg","delay":40},{"file":"000036.jpg","delay":30},{"file":"000037.jpg","delay":30},{"file":"000038.jpg","delay":40},{"file":"000039.jpg","delay":30},{"file":"000040.jpg","delay":30},{"file":"000041.jpg","delay":40},{"file":"000042.jpg","delay":30},{"file":"000043.jpg","delay":30},{"file":"000044.jpg","delay":40},{"file":"000045.jpg","delay":30},{"file":"000046.jpg","delay":30},{"file":"000047.jpg","delay":40},{"file":"000048.jpg","delay":30},{"file":"000049.jpg","delay":30},{"file":"000050.jpg","delay":40},{"file":"000051.jpg","delay":30},{"file":"000052.jpg","delay":30},{"file":"000053.jpg","delay":40},{"file":"000054.jpg","delay":30},{"file":"000055.jpg","delay":30},{"file":"000056.jpg","delay":40},{"file":"000057.jpg","delay":30},{"file":"000058.jpg","delay":30},{"file":"000059.jpg","delay":40},{"file":"000060.jpg","delay":30},{"file":"000061.jpg","delay":30},{"file":"000062.jpg","delay":40},{"file":"000063.jpg","delay":30},{"file":"000064.jpg","delay":30},{"file":"000065.jpg","delay":40},{"file":"000066.jpg","delay":30},{"file":"000067.jpg","delay":30},{"file":"000068.jpg","delay":40},{"file":"000069.jpg","delay":30},{"file":"000070.jpg","delay":30},{"file":"000071.jpg","delay":40},{"file":"000072.jpg","delay":30},{"file":"000073.jpg","delay":30},{"file":"000074.jpg","delay":40}]}}
JDownloader is already downloading that .zip file containing all of these .jpg files which means if you want to have this as an animated image you will have to use external tools to e.g. create a gif out of all these pictures.

This is not a JDownloader bug or similar - JDownloader is already downloading everything there is from that page

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by raztoki; 27.02.2020 at 01:38.
Reply With Quote
  #11  
Old 26.02.2020, 23:34
accelheim accelheim is offline
JD Addict
 
Join Date: Jan 2020
Posts: 158
Default

Alright, nice one. Thanks for the help.
Reply With Quote
  #12  
Old 28.02.2020, 15:29
accelheim accelheim is offline
JD Addict
 
Join Date: Jan 2020
Posts: 158
Default

I don't know if this is only a windows issue or if some files got downloaded wrong, but there were a few images that doesn't let themselves copy or delete. The rest got copied without an issue, but these, when tried to delete or copy to another directory says "element not found" although it's there and can be opened. Maybe the file name jDownloader puts on some pictures is too long or the pictures got downloaded corrupted. I tried downloading them from pixiv manually and they're fine. Is this a known problem?
Reply With Quote
  #13  
Old 29.02.2020, 17:54
accelheim accelheim is offline
JD Addict
 
Join Date: Jan 2020
Posts: 158
Default

Anyone know why some images are corrupted?
Reply With Quote
  #14  
Old 02.03.2020, 18:49
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,140
Default

Quote:
Originally Posted by accelheim View Post
I don't know if this is only a windows issue or if some files got downloaded wrong, but there were a few images that doesn't let themselves copy or delete.
Probably a windows filename issues.
You should be able to rename/delete those using the windows commandline.

Quote:
Originally Posted by accelheim View Post
Anyone know why some images are corrupted?
Do you refer the the filename issue or something else?

As said it is probably a filename issue.
You can rename files inside JDownloader before it downloads them then you should not have these issues anymore.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #15  
Old 10.04.2020, 11:05
simon_7617118 simon_7617118 is offline
JD Alpha
 
Join Date: Oct 2015
Posts: 24
Default

Hi. I've noticed that the JDownloader Pixiv plugin does not properly scrape Pixiv entries that are categorized as "manga", which may explain the discrepancy.

Pixiv entries can be marked as either "illust" or "manga". Here's an example account:

**External links are only visible to Support Staff****External links are only visible to Support Staff** (Displays both types of entries)
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Additionally, Pixiv log-ins will time out and require logging in and solving a captcha. The plug-in does not always detect this reliably, instead showing a "Plug-in disabled" error for 1 hour.
Reply With Quote
  #16  
Old 14.04.2020, 12:36
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,140
Default

Please wait for the next update (supposed to be released today) and try again afterwards.

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #17  
Old 24.04.2020, 19:21
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,343
Default

@simon: feedback? login should be fixed with next update
__________________
JD-Dev & Server-Admin
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 12:23.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.