#1
|
|||
|
|||
Plugin for furaffinity.net
Edit: The thread title is wrong it's .net not .com sry for that I can't edit it.
Hello! I've been only able to find a 3 year old ticket regarding this and no proper forum threads, so I figured missing information/demand might be a cause for this not being a thing.^^ So I hope the following information/links help at least with that. If you find the time to work on it I'd really appreciate this feature. (I selected mostly links/images that will hopefully spare your sanity) For being able to see mature/adult submissions it has to be activated in the account options or via SFW button in the upper menue, so account login support is necessary. I'll send account information to pspzockerscene. Also a captcha has to be solved for logging in, on there are 2 types of captcha which can be changed with a button below the captcha **External links are only visible to Support Staff****External links are only visible to Support Staff** (link from button) links: sfw picture submission view: **External links are only visible to Support Staff****External links are only visible to Support Staff** sfw picture submission full view: **External links are only visible to Support Staff****External links are only visible to Support Staff** sfw picture source: **External links are only visible to Support Staff****External links are only visible to Support Staff** sfw picture download button link: **External links are only visible to Support Staff****External links are only visible to Support Staff** sfw audio submission view: **External links are only visible to Support Staff****External links are only visible to Support Staff** sfw flash submission view: **External links are only visible to Support Staff****External links are only visible to Support Staff** sfw gif submission view: **External links are only visible to Support Staff****External links are only visible to Support Staff** gallery: **External links are only visible to Support Staff****External links are only visible to Support Staff** page 2 of a gallery: **External links are only visible to Support Staff****External links are only visible to Support Staff** page 2 of scraps (nsfw-nudity):**External links are only visible to Support Staff****External links are only visible to Support Staff** page 2 of favs (a bit nsfw): **External links are only visible to Support Staff****External links are only visible to Support Staff** page 3 of favs(a bit nsfw): **External links are only visible to Support Staff****External links are only visible to Support Staff** scraps (is separate from gallery): **External links are only visible to Support Staff****External links are only visible to Support Staff** favorites: **External links are only visible to Support Staff****External links are only visible to Support Staff** mature rated picture submission view (is sfw): **External links are only visible to Support Staff****External links are only visible to Support Staff** mature rated picture submission full view (is sfw, just a zombie): **External links are only visible to Support Staff****External links are only visible to Support Staff** mature rated picture submission source (two comic dudes fighting, kinda sfw): **External links are only visible to Support Staff****External links are only visible to Support Staff** mature rated picture download button link (is sfw, just a zombie):**External links are only visible to Support Staff****External links are only visible to Support Staff** adult rated story submission (sfw if you don't read the story): **External links are only visible to Support Staff****External links are only visible to Support Staff** adult rated picture submission view (sfw just a cropped patreon preview): **External links are only visible to Support Staff****External links are only visible to Support Staff** adult rated picture submission full (sfw just a cropped patreon preview): **External links are only visible to Support Staff****External links are only visible to Support Staff** adult rated picture submission source(just a render of a girl in bikini): **External links are only visible to Support Staff****External links are only visible to Support Staff** adult rated picture download button link(just a render of a girl in bikini): **External links are only visible to Support Staff****External links are only visible to Support Staff** The file formats I've seen: jpg,png,mp3,txt,swf,gif Also some gifs only work in full view. And saving the picture from view/full and download button yield the same picture quality, it has only thumbnail quality when taken directly from favorites for example though. Some seemingly random number seems to be assigned to the pages of favorites I hope there's a way to still scrape the favs. I've also read of bans regarding mass downloading there, maybe putting an optional 24h pause after ~1000 downloads would make sense (or at least putting in a warning message somewhere) Thanks for reading and hopefully considering this request.^^ Last edited by Loberon; 05.10.2019 at 13:28. Reason: I made an error on the website link in the thread title |
#2
|
||||
|
||||
Ticket:
-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#3
|
||||
|
||||
I've added support to download single items from this website and a gallery crawler.
I haven't aded account support for now - just let me know if you still need that. -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#4
|
|||
|
|||
I think account access is needed, some artists lock their galleries so only logged in users can view their uploads, and most of the adult uploads require you to be logged in.
Last edited by DeusExBestia; 19.08.2020 at 22:23. Reason: Clarification |
#5
|
||||
|
||||
Quote:
-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#6
|
||||
|
||||
Added account support.
Wartest du auf einen angekündigten Bugfix oder ein neues Feature? Updates werden nicht immer sofort bereitgestellt! Bitte lies unser Update FAQ! | Please read our Update FAQ! --- Are you waiting for recently announced changes to get released? Updates to not necessarily get released immediately! Bitte lies unser Update FAQ! | Please read our Update FAQ! -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#7
|
|||
|
|||
The crawler seems to be a little overzealous.
For example, I added " **External links are only visible to Support Staff****External links are only visible to Support Staff** " as a link to test out the plugin, and it grabbed only 79 out of the 100 submissions, doesn't appear to have looked at the scraps... And then it went on a tangent and grabbed a whole mess of other things, looks like the images for some of the commenters on his page, banners, some sort of script.js from somewhere, then went on a crawling spree of a link to a twitter account posted on that page. |
#8
|
||||
|
||||
Hi,
our crawler only supports galleries so far. User-profiles are not (yet) supported. -psp- EDIT Which "100 submissions" do you mean? furaffinity.net/user/rionquosue --> furaffinity.net/gallery/rionquosue/ --> Contains 6 items
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download Last edited by pspzockerscene; 05.10.2020 at 14:52. |
#9
|
|||
|
|||
I created a user account. It's set to show all art, general/mature/adult etc. How do I send it to you?
Last edited by DeusExBestia; 05.10.2020 at 17:55. Reason: Removed logindata - NEVER post logindata in public! |
#10
|
||||
|
||||
@DeusExBestia
1. What do I need that account for? 2. Please post example URLs which lead to your proposed "100+ items gallery". -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#11
|
|||
|
|||
Quote:
**External links are only visible to Support Staff****External links are only visible to Support Staff** for example is one of the items you can't view if you don't have an account. |
#12
|
||||
|
||||
Okay now I understand.
Ticket: -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#13
|
|||
|
|||
I think there is already account support, the strange thing is that even when logged in not all the items are crawled in the gallery.
|
#14
|
||||
|
||||
Sorry - you're right.
I was in a rush yesterday so I didn't check everything and also, I actually got my own test-account already so - sorry again! Apart from that I wasn't able to reproduce your issue. Silgne URLs that are locked behind a login won't get displayed with their final filename in the linkgrabber but, if an account is present in JD, they will be downloaded just fine and filename will change accordingly once the download starts. Please add a new problem description and more example URLs and a log if you are able to reproduce this issue. -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#15
|
|||
|
|||
So, after a little bit more investigation I discovered that, as long as I load the /gallery/<username> and the /scraps/<username> as separate links, it grabs everything in those particular sections, at least on the few names I've tested. However if I add /user/<username> it grabs a bunch of random stuff, in addition to some/most of the gallery, and random things from whatever user commented on the page.
|
#16
|
||||
|
||||
Only /gallery/ and /view/ are supported. The others are processed via deep crawling (auto find all kind of links) and that's causing the random stuff.
Can you provide a /scraps/ example url?
__________________
JD-Dev & Server-Admin |
#17
|
|||
|
|||
Quote:
Looks like I have to ask someone to help create a "convert /user/" in an FurAffinity link to /gallery/ and /scraps/ event script xD Struggling to figure out how to adapt the twitter conversion script someone made for me. |
#18
|
||||
|
||||
Thanks! I think we can update plugin to support those links as well. I've updated the existing ticket
__________________
JD-Dev & Server-Admin |
#19
|
||||
|
||||
Done.
Wartest du auf einen angekündigten Bugfix oder ein neues Feature? Updates werden nicht immer sofort bereitgestellt! Bitte lies unser Update FAQ! | Please read our Update FAQ! --- Are you waiting for recently announced changes to get released? Updates to not necessarily get released immediately! Bitte lies unser Update FAQ! | Please read our Update FAQ! -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#20
|
||||
|
||||
Quote:
It will add both of these URLs whenever you add a "/user/" URL. Also it will create different packages depending on the added type (gallery/scraps). Wartest du auf einen angekündigten Bugfix oder ein neues Feature? Updates werden nicht immer sofort bereitgestellt! Bitte lies unser Update FAQ! | Please read our Update FAQ! --- Are you waiting for recently announced changes to get released? Updates to not necessarily get released immediately! Bitte lies unser Update FAQ! | Please read our Update FAQ! -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#21
|
|||
|
|||
Sweet! Thank you!
|
#22
|
|||
|
|||
Also, just an aside. In the webinterface for JDownloader on FreeBSD, I can't seem to pull up the furaffinity plugin under the plugin settings.
|
#23
|
||||
|
||||
@DeusExBestia: plugin doesn't provide any plugin settings
__________________
JD-Dev & Server-Admin |
|
|