#1
|
|||
|
|||
Danbooru.donmai.us - Fetching posts interrupted mid-way
Hello.
The danbooru plugin works rather well in most circumstances, but sometimes it simply stops fetching the downloadable content. For example, JDownloader stops at the 57th result for this search: **External links are only visible to Support Staff****External links are only visible to Support Staff** ... while it should find over 2100. I suspect some specific posts to provoke an interruption in the plugin, due to unaivalable danbooru posts or something along those lines. System info: JRE 1.8.0 32bit JDownload build #44876 Windows 10 Home 64 bits Avast antivirus (deactivated) Log:
Spoiler:
22.08.21 15.46.38 <--> 22.08.21 16.44.54 jdlog://4776825302851/
Sorry if some info is missing or something, I'm not quite experienced in using those forums. For instance, I don't know where to see the plugin's version nor how to setup the log level. Thanks in advance ! |
#2
|
||||
|
||||
Works fine here.
Is it possible that a single page inbetween the search results can contain less than 15 or 20 items? Can you reproduce the issue also when using this host without an account? -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#3
|
|||
|
|||
Without using my ID, I get 1223 results, which is still not the over 2100 that should be returned, according to the searched tag.
With my Gold account API key properly setup in the plugin, I get 61 results right now, but then it still stops after the same ID. Given how Danbooru works, yes it is possible that a single page can return less than the theoric amount of results displayed per page. Typically when some posts are hidden (usually banned artists). For instance, in the given example, witout any account, browsing danbooru displays less than 20 results in the first 4 pages, and only tells that some are not displayed at the artist request in the 4th page of results. I don't even get all of the results even with my Gold account anyway. While I'm at it, I've just noticed that JDownloader only gets the post IDs in the filenames when the plugin doesn't use any API key. |
#4
|
||||
|
||||
Quote:
Seems like there is a bug in their API so sometimes the "id" field is missing. This lead to an NPE in our plugin. Quote:
Number of items via website: 2165 Number of items via API: 2198 Quote:
Via website the parser works a bit different and sets temporary filenames. Once you either let JD manually check them or start downloading, they will change to the ones you see right away when crawling via API Wartest du auf einen angekündigten Bugfix oder ein neues Feature? Updates werden nicht immer sofort bereitgestellt! Bitte lies unser Update FAQ! | Please read our Update FAQ! --- Are you waiting for recently announced changes to get released? Updates to not necessarily get released immediately! Bitte lies unser Update FAQ! | Please read our Update FAQ! -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#5
|
|||
|
|||
It seems to be able to fetch all the results now, thanks a bunch!
I'll donate a little something later, because the work done here is amazing. |
#6
|
||||
|
||||
@Fakline: Thanks for the feedback. Please know that we will also help without a donation but of course we say thank you Always remember only to donate if you are happy with JDownloader
__________________
JD-Dev & Server-Admin |
#7
|
||||
|
||||
@Fakline
Is there an official support E-Mail for danbooru? I'd like to report the bug I've found in their API Thanks for your feedback! -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#8
|
|||
|
|||
Quote:
Sorry fo the very late reply. I'm not very knowledged with their system, but from searching a bit it looks like their bug tracker is there: **External links are only visible to Support Staff****External links are only visible to Support Staff** |
#9
|
||||
|
||||
I do not have the testlinks to reproduce this anymore.
I've described the possible bug in this post. -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
Thread Tools | |
Display Modes | |
|
|