#1
|
|||
|
|||
Pixiv.net - Not all images analyzed
This user has over 500 galleries, but only 128 packets are analysed for me.
Link: **External links are only visible to Support Staff****External links are only visible to Support Staff** |
#2
|
||||
|
||||
@accelheim: Have you entered your pixiv account in JDownloader? not all images are available when not being logged in
You may also use cookie login method, see https://support.jdownloader.org/Know...n-instructions
__________________
JD-Dev & Server-Admin |
#3
|
|||
|
|||
Quote:
**External links are only visible to Support Staff****External links are only visible to Support Staff** The other user in my OP I scanned 5 times and still didn't get all images. |
#4
|
||||
|
||||
@accelheim: Thanks for the feedback. will look at it by tomorrow
__________________
JD-Dev & Server-Admin |
#5
|
||||
|
||||
Indeed they got some kind of rate-limit.
I've added a limit of one request every 500ms. Try again after the next CORE-update. Bitte auf das nächste CORE-Update warten! Please wait for the next CORE-Update! Wartest du auf einen angekündigten Bugfix oder ein neues Feature? Updates werden nicht immer sofort bereitgestellt! Bitte lies unser Update FAQ! | Please read our Update FAQ! --- Are you waiting for recently announced changes to get released? Updates to not necessarily get released immediately! Bitte lies unser Update FAQ! | Please read our Update FAQ! -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#6
|
|||
|
|||
I've tried again, and it seems to be analyzing more packages now, but lots are still missing.
Like this user with 897 galleries/packages: **External links are only visible to Support Staff****External links are only visible to Support Staff** I've now analyzed it 3 times. First time I got about 840 packages. Second time 5 new ones. Third time 4 new ones. |
#7
|
||||
|
||||
@accelheim: can you please provide a debug log, see https://support.jdownloader.org/Know...d-session-logs
__________________
JD-Dev & Server-Admin |
#8
|
||||
|
||||
@accelheim: issue is caused by rate limit/crawl protection. I've set higher request limits and limit concurrent use of plugin, maybe this helps but of course takes longer to complete
__________________
JD-Dev & Server-Admin |
#9
|
||||
|
||||
@accelheim: wait for next update, I've tweaked the request limits and looks like your example link can be crawled in one go but of course slower
__________________
JD-Dev & Server-Admin |
#10
|
|||
|
|||
It looks like it's working now! Thank you.
|
#11
|
||||
|
||||
Thanks for the feedback and you're welcome!
__________________
JD-Dev & Server-Admin |
Thread Tools | |
Display Modes | |
|
|