JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #41  
Old 12.01.2022, 18:28
fuknuckle fuknuckle is offline
Black Hole
 
Join Date: Aug 2015
Posts: 253
Default

Quote:
Originally Posted by Jiaz View Post
@fuknuckle: please use board search
I did and only 2 post came up the most recent being this thread where the last post was March 31st 2018. https://board.jdownloader.org/showthread.php?t=74587 this thread didn't come up.

It doesn't look like there has been any movement on this ticket in almost 2 years. any idea why the deviantart plugin is getting no love?
Reply With Quote
  #42  
Old 12.01.2022, 18:32
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,044
Default

Quote:
Originally Posted by fuknuckle View Post
It doesn't look like there has been any movement on this ticket in almost 2 years. any idea why the deviantart plugin is getting no love?
1. Lack of time.
2. Deviantart is using a protection similar to Cloudflare some time ago, see ticket:


We're open source so you're free to contribute code/fix it yourself.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #43  
Old 06.03.2022, 13:25
dominika992 dominika992 is offline
JD Beta
 
Join Date: May 2020
Posts: 53
Default

I have the same issue, plugin outdated + can't grab and download from e.g.
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #44  
Old 07.03.2022, 16:39
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,044
Default

Hi,
please read the previous posts in this thread.
To sum it up:
Please do not expect a bugfix for this in the near future/ever.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #45  
Old 01.08.2022, 20:41
H-Visage H-Visage is offline
Super Loader
 
Join Date: Jul 2022
Posts: 28
Default DeviantArt Login is Down?

Hi this is the error I keep getting, hope this will be resolved soon?
https://imgur.com/a/P4qgq4A
Reply With Quote
  #46  
Old 02.08.2022, 11:42
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,044
Default

Merged deviantart threads.

@H-Visage
Please read the thread I've merged your post with.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #47  
Old 02.08.2022, 18:13
H-Visage H-Visage is offline
Super Loader
 
Join Date: Jul 2022
Posts: 28
Default

Well that's a bummer. Thanks anyways.
Reply With Quote
  #48  
Old 29.10.2022, 03:40
Fridolin_Fresh Fridolin_Fresh is offline
Vacuum Cleaner
 
Join Date: Jun 2020
Posts: 16
Default

Will it ever be possible again to download images from Deviantart using JDownloader? Until recently you could download at least half of the images, the other half just had the problem with the Deviantart logo. But now, the links aren't even pasted into JDownloader, and the plugin keeps reporting that it's out of date.-
Reply With Quote
  #49  
Old 31.10.2022, 14:42
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,044
Default

Quote:
Originally Posted by Fridolin_Fresh View Post
Will it ever be possible again to download images from Deviantart using JDownloader?
There is no definite answer to that question.
We're open source so you're free to work on it yourself.
EDIT

I didn't want to waste your time but a simple "No" would also be the wrong answer.
From my perspective: I don't see this being fixed.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 31.10.2022 at 14:49.
Reply With Quote
  #50  
Old 31.10.2022, 17:21
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,044
Default

Update:
I've looked at this again and here are my results:
Normal login attempts get blocked by their AntiDDoS protection but cookie login did work for me.

I've implemented some proof of concept changes and I'm waiting for your feedback.

Changes:
- Fixed login: Added cookie login support (no gurantees and no idea how long self added cookies will stay active)
- Fixed/added proof of concept profile crawler: Currently this will only crawl the first 24 items and only images. This will only listen to such URLs for now: deviantart.com/username

Before you ask:
I didn't put more time into this because if in the end, their AntiDDoS protection blocks most of those requests it wouldn't make any sense to put more time into this

What I'd need from you to work more on this:
- Feedback once the update is released (you may also build the dev version on your own and test right away)
- More example URLs especially for profiles that contain a lot of different item types like: images, videos, journals and also things like +18 content, blocked content, officially downloaded content, .zip downloadable items

For all changes mentioned in this post, the following information applies:

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #51  
Old 01.11.2022, 01:32
Fridolin_Fresh Fridolin_Fresh is offline
Vacuum Cleaner
 
Join Date: Jun 2020
Posts: 16
Default

I know very little about programming, but I just have a question. In fact, there is currently no browser extension or other program that manages to download entire galleries on DeviantArt. But I found a way. This is the gallery-dl. This works with Python and you simply enter a certain command line in cmd to download it, and all the pictures and other files in a gallery are downloaded in full quality. The disadvantage is that you have to insert each gallery into the command and then start it individually in cmd, which is of course very time-consuming if you want to download many galleries. Is it possibly somehow possible to connect that with the JDownloader? Maybe the question is stupid, but as I said, I don't really know much about programming.
Reply With Quote
  #52  
Old 02.11.2022, 14:17
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,044
Default

Quote:
Originally Posted by Fridolin_Fresh View Post
there is currently no browser extension or other program that manages to download entire galleries on DeviantArt
Of course there is.
Simply go to github.com and look for open source tools.
Having invested some seconds (didn't test it though), here are some findings:
github.com/xofred/deviantart-gallery-downloader
github.com/NC22/KellyC-Image-Downloader
github.com/mikf/gallery-dl

Quote:
Originally Posted by Fridolin_Fresh View Post
This is the gallery-dl.
Jup I found that one too.

Quote:
Originally Posted by Fridolin_Fresh View Post
Is it possibly somehow possible to connect that with the JDownloader?
No.
Please re-read my last post, wait for the update, provide feedback and if my changes do work for the majority of our users, I'm willing to put more time into fixing our existing deviantart plugins
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #53  
Old 16.11.2022, 20:38
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,044
Default

Updates have been released.
I've done quite some more changes to this plugin but officially I've only set the progress to 50%.
Biggest changes:
- fixed login
- fixed official downloads ("Download button downloads")
- re-designed settings for this plugin, see Settings -> Plugins -> deviantart.com
- fixed profile/gallery/favourites crawler

Please leave your feedback here and report anything you think is still broken.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #54  
Old 18.11.2022, 17:38
mwl mwl is offline
JD Fan
 
Join Date: Mar 2013
Posts: 77
Default

In some cases, instead of the actual item, it's downloading a DA logo. If you're looking for some way to detect it, it's 10648 bytes.

Also, there seems to be no way to craft a packagizer rule to differentiate between user galleries and favorites, as according to the rule tester both the Download URL and Source URL are the individual deviation URL rather than the gallery URL. I acknowledge that this might already be known.

Out of interest, what was the reason for sticking with scraping rather than trying to use the API?

Last edited by mwl; 18.11.2022 at 17:41.
Reply With Quote
  #55  
Old 18.11.2022, 18:01
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,232
Default

@mwl: can you provide logs/example for the *downloading DA logo*? Best would be debug log, see https://support.jdownloader.org/Know...d-session-logs
and post shown logID here

Quote:
Originally Posted by mwl View Post
Out of interest, what was the reason for sticking with scraping rather than trying to use the API?
Did not look at the API recently but for example , https://board.jdownloader.org/showpo...0&postcount=20
The situation might have changed meanwhile

Quote:
Originally Posted by mwl View Post
Also, there seems to be no way to craft a packagizer rule to differentiate between user galleries and favorites, as according to the rule tester both the Download URL and Source URL are the individual deviation URL rather than the gallery URL. I acknowledge that this might already be known.
pspzockerscene will answer this next week
__________________
JD-Dev & Server-Admin
Reply With Quote
  #56  
Old 18.11.2022, 18:08
mwl mwl is offline
JD Fan
 
Join Date: Mar 2013
Posts: 77
Default

Looking more closely, it looks like a lot of the ones generating a logo are "literature", and therefore won't have an image, but I'd need to check if this is the case for all of them. I'll spin up a log later if I can.
Reply With Quote
  #57  
Old 18.11.2022, 18:10
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,232
Default

@mwl: thanks for the feedback. Maybe literature support broken/not yet supported. Maybe can provide example links?
__________________
JD-Dev & Server-Admin
Reply With Quote
  #58  
Old 18.11.2022, 18:32
mwl mwl is offline
JD Fan
 
Join Date: Mar 2013
Posts: 77
Default

What might be (/have been) missing from the API?

If they know what they're doing, it should have proper rate-limiting support which will communicate back to the client how long to back off for, which should work a little better than cookie-sharing and having to reset it regularly. Then again, "should" is one of my favourite English words. I'll take a look at some other API clients to see what they can and can't do.
Reply With Quote
  #59  
Old 18.11.2022, 18:38
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,232
Default

Quote:
Originally Posted by mwl View Post
What might be (/have been) missing from the API?
I'm sorry but lost in history, I don't remember, too long ago.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #60  
Old 18.11.2022, 18:39
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,232
Default

Quote:
Originally Posted by mwl View Post
which should work a little better than cookie-sharing and having to reset it regularly.
"Should" not be necessary to regulary reset it as you don't have to regulary re-login at website. But I'm not familiar with current plugin at all.
__________________
JD-Dev & Server-Admin
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 06:01.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.