JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 03.08.2024, 23:31
VanTuz VanTuz is offline
Fibre Channel User
 
Join Date: Oct 2018
Posts: 124
Default Plugin request "frosting.ai"

This is a site for generating images like civitai. On the author's page, if you use the browser plugin to preview images, you can see that the site allows you to download them in full size manually. Moreover, you can save the page via "save as", and some of the full-size images will be saved, but not all of them. At the same time, the jdownloader does not see the image at all.
**External links are only visible to Support Staff****External links are only visible to Support Staff** -I tried to download something from this page, but without success.
Reply With Quote
  #2  
Old 03.08.2024, 23:47
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 80,887
Default

@VanTuz: images are not part of html but fetched via javascript and hence JDownloader does not *see* them.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #3  
Old 04.08.2024, 00:08
VanTuz VanTuz is offline
Fibre Channel User
 
Join Date: Oct 2018
Posts: 124
Default

Got it. I'm just not a programmer and didn't know about such features.
Reply With Quote
  #4  
Old 05.08.2024, 11:24
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 72,628
Default

@VanTuz
It is extremely unlikely that a plugin for said website will be added.
Please use the following instructions as a helper to download content from this website in a semi-automatic way:
https://support.jdownloader.org/de/k...orted-websites
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #5  
Old 06.08.2024, 00:01
VanTuz VanTuz is offline
Fibre Channel User
 
Join Date: Oct 2018
Posts: 124
Default

None of these methods helps, because the link collectors do not see any links, most likely for the same reasons that the jdownloader does not detect them
Reply With Quote
  #6  
Old 06.08.2024, 10:53
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 72,628
Default

Looks like you did not read said article.
Using LinkCrawler rules, you can "make it see those links" for example such image-directlinks:
Code:
api.frosting.ai/api/v1/files/cdn/post/6682d9258e049a0ab260fffa/66b1037e2396f4cf26470933/image
Re-read and ask if you need help to create said rule(s).
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #7  
Old 06.08.2024, 11:17
VanTuz VanTuz is offline
Fibre Channel User
 
Join Date: Oct 2018
Posts: 124
Default

I think I'm going to need help, because I have no idea how to set up anything there.
Reply With Quote
  #8  
Old 06.08.2024, 11:32
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 72,628
Default

So did you even take a look at the examples and try?

Just to be clear - that will help you to crawl single images of said website slash add the ability to add single image links via copy & paste but it will not automate the process of e.g. grabbing all items of a user.
EDIT

So here is an example rule which will make JD accept direct image links from frosting.ai like the one I put in my last post:
Code:
[
  {
    "enabled": true,
    "logging": false,
    "maxDecryptDepth": 1,
    "name": "example rule of type DIRECTHTTP for direct links from website 'frosting.ai'",
    "pattern": "**External links are only visible to Support Staff**,
    "rule": "DIRECTHTTP"
  }
]
Rule as raw text:
pastebin.com/raw/rCS22NhH
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 06.08.2024 at 11:48. Reason: EDIT
Reply With Quote
  #9  
Old 06.08.2024, 12:57
VanTuz VanTuz is offline
Fibre Channel User
 
Join Date: Oct 2018
Posts: 124
Default

I'm not a programmer and I don't understand anything about it. And it turns out that this code is practically the same as downloading manually?
Reply With Quote
  #10  
Old 06.08.2024, 13:16
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 72,628
Default

Quote:
Originally Posted by VanTuz View Post
I'm not a programmer and I don't understand anything about it.
You don't need to be a programmer to understand a json syntax and work with examples to create such rules.
In our forums you can find tons of examples, those alone are helpful to understand how those rules work.
More initiative from your side would be great.

Quote:
Originally Posted by VanTuz View Post
And it turns out that this code is practically the same as downloading manually?
That sentence doesn't really make sense.
As explained, this code 'teaches' JD to handle those links.
Now you still need to collect them.
Random example:
Code:
frosting.ai/user/dimpus
-> Use your browsers' developer tools to find the source of those items:
Code:
api.frosting.ai/api/v1/posts/users/6682d84a8e049a0ab2607e02
-> In that text, search & replace "post/" with "https...api.frosting.ai/api/v1/files/cdn/post/" -> Now you could all those links to JDownloader.

TL;DR
We do not have the capacities to add plugins for all requested websites.
Using external tools combined with JDownloaders' features, you could easily make JDownloader download such items though that requires some time & effort from you in order to make it work.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 06.08.2024 at 13:31. Reason: Fixed typo
Reply With Quote
  #11  
Old 06.08.2024, 13:41
VanTuz VanTuz is offline
Fibre Channel User
 
Join Date: Oct 2018
Posts: 124
Default

I'm honestly trying to figure out what I need to do. Through the developer tools, I was able to find these links. How do I copy them all?
**External links are only visible to Support Staff****External links are only visible to Support Staff**
UPD - I founded how.

Last edited by VanTuz; 06.08.2024 at 13:45.
Reply With Quote
  #12  
Old 06.08.2024, 13:45
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 72,628
Default

You don't need them - you just need to find the "source text" that contains all of them:
Code:
api.frosting.ai/api/v1/posts/users/<someHashHere>
---> So that is the link you are looking for.
-> Then modify the json ("text") so that the links aren't relative links anymore but absolute links and then JD can eat them.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #13  
Old 06.08.2024, 14:02
VanTuz VanTuz is offline
Fibre Channel User
 
Join Date: Oct 2018
Posts: 124
Default

**External links are only visible to Support Staff****External links are only visible to Support Staff** - For my case. Either I found the wrong cache, or something else.
Reply With Quote
  #14  
Old 06.08.2024, 14:10
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 72,628
Default

Remove the slash at the ending then that link will be valid.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 06.08.2024 at 14:16. Reason: Fixed bad English
Reply With Quote
  #15  
Old 06.08.2024, 22:28
VanTuz VanTuz is offline
Fibre Channel User
 
Join Date: Oct 2018
Posts: 124
Default

You wrote that you need to change some json to remove the links from there. Where can I get it and how can I change it?
UPD. I found the file. how can I change it?
UPD2. search and replace solved the problem

And I noticed that the program doesn't seem to be able to download the file or something. She seems to have downloaded it 100%, but is in no hurry to move on to downloading the next one.

Last edited by VanTuz; 07.08.2024 at 00:26.
Reply With Quote
  #16  
Old 07.08.2024, 11:35
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 72,628
Default

Quote:
Originally Posted by VanTuz View Post
And I noticed that the program doesn't seem to be able to download the file or something. She seems to have downloaded it 100%, but is in no hurry to move on to downloading the next one.
Please post your log-ID here
If your report is about a specific website which JD supports via plugin, please also provide example URLs which can be used to reproduce the issue you are having.
If your report is related to a login specific problem with a plugin supported website, enable debug mode before creating logs, see previously linked instructions.

Bitte poste deine Log-ID hier.
Falls dein Problem ein Problem mit einer Webseite ist, die per Plugin unterstützt wird, stelle bitte zusätzlich Testlinks zur Verfügung, mit denen sich dein Problem nachstellen lässt.
Geht es um einen nicht funktionierenden Account-Login, aktiviere vor dem Erstellen deines Logs den debug Modus (siehe zuvor verlinkte Anleitung).

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 06:51.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.