JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 04.09.2023, 07:05
Doom Doom is offline
Wind Gust
 
Join Date: Apr 2019
Posts: 42
Default Few sites that I would like their plugin updated/get plugin if possible wotaburo.net

Recently a lot sites I know got updated in recent years and not being supported anymore by Jdownloder,

I don't know if they had plugin but I know that now site like
**External links are only visible to Support Staff****External links are only visible to Support Staff** and J-list/J-box (like this one **External links are only visible to Support Staff****External links are only visible to Support Staff**) won't let JD to detect their links and instead will show "Blocked by!Cloudflare Site-Protection" when you try to pick something from them


Aside from that I would like to ask if it be possible to make a plugin for sites like **External links are only visible to Support Staff****External links are only visible to Support Staff**,

Basically, if you go into one of their reviews (like this **External links are only visible to Support Staff**one)
JD may only detect the previews at best,
The site got dual links and no option to right click as some security measures,
I can easily bypass them but will having to click on each link one by one, so I wanted to know if there's any chance JDownloder will be able to detect the source images when you copy the page URL to spare me a lot of time.


Thx in advance.

Last edited by Doom; 04.09.2023 at 07:08.
Reply With Quote
  #2  
Old 04.09.2023, 12:38
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,121
Default

Okay one by one:
ouo.io:
Website is supported and no issues are known.
If you think there is a problem, please provide example URLs and a log.

jlist.com:
There is no plugin available for this website and I also don't see the need of adding one.
If you get that "Cloudflare" Problem: Please read our Cloudflare FAQ
If our deep-parser already can't get through Cloudflare, a plugin is not possible anyways.

wotaburo.net or in general, adding support for more website:
Anything is possible.
In the end it comes down to how much time is needed to add that plugin and how many users would like to have a plugin for that website.
That website looks very simple thus I would say a plugin is not needed: Just use 1-2 LinkCrawler Rules to download from it.
You can find more example-rules throughout our forums.

Quote:
Originally Posted by Doom View Post
The site got dual links and no option to right click as some security measures,
--> Does not matter as all JD sees is their html code and they did not bother adding any kind of other protection to hide the URLs in there.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #3  
Old 05.09.2023, 12:05
Doom Doom is offline
Wind Gust
 
Join Date: Apr 2019
Posts: 42
Default

Quote:
Originally Posted by pspzockerscene View Post
Okay one by one:
ouo.io:
Website is supported and no issues are known.
If you think there is a problem, please provide example URLs and a log.

jlist.com:
There is no plugin available for this website and I also don't see the need of adding one.
If you get that "Cloudflare" Problem: Please read our **External links are only visible to Support Staff**...
If our deep-parser already can't get through Cloudflare, a plugin is not possible anyways.

wotaburo.net or in general, adding support for more website:
Anything is possible.
In the end it comes down to how much time is needed to add that plugin and how many users would like to have a plugin for that website.
That website looks very simple thus I would say a plugin is not needed: Just use 1-2 **External links are only visible to Support Staff**... to download from it.
You can find more example-rules throughout our forums.


--> Does not matter as all JD sees is their html code and they did not bother adding any kind of other protection to hide the URLs in there.

Here's a log for ouo.io as well as J-list

05.09.23 12.57.21 <--> 05.09.23 13.00.08 jdlog://7357311370661/

And random links for both

**External links are only visible to Support Staff****External links are only visible to Support Staff**

**External links are only visible to Support Staff****External links are only visible to Support Staff**

With J-Box I just wanted JD to work to spare me being a clicking monkey if I want an image from their stuff,
It worked well for long time till they updated stuff in their site,
If it's impossible though, not much that can be done I guess ;/


As for wotaburo,
I'm kinda dumb with coding or commands stuff so an example will be welcome,
Can I add link crawler rule to work only on this site?
Also will it take only the deeper image links or will make JD to detect both previews and inner image links?

Last edited by Doom; 05.09.2023 at 12:08.
Reply With Quote
  #4  
Old 05.09.2023, 12:14
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,121
Default

ouo.io:
Your log shows that ouo.io fails due to Cloudflare (same as here for me).
As explained please read the Cloudflare thread. This is not a JD bug.

jlist.com:
For me when adding the jlist.com link, the deep-parser does find items so technically it should be possible to write a LinkCrawler rule for jlist.com as well.

wotaburo.net and LinkCrawler rules:
Quote:
Originally Posted by Doom View Post
I'm kinda dumb with coding or commands stuff so an example will be welcome,
As explained you will find countless examples in our forums.
You can also find some basic examples in our knowledgebase:
https://support.jdownloader.org/Know...kcrawler-rules

Quote:
Originally Posted by Doom View Post
Can I add link crawler rule to work only on this site?
Yes. This is what LinkCrawler rules are usually used for: For specific websites.

Quote:
Originally Posted by Doom View Post
Also will it take only the deeper image links or will make JD to detect both previews and inner image links?
Depends on how you will design your custom LinkCrawler Rule.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #5  
Old 08.09.2023, 04:12
Doom Doom is offline
Wind Gust
 
Join Date: Apr 2019
Posts: 42
Default

Quote:
jlist.com:
For me when adding the jlist.com link, the deep-parser does find items so technically it should be possible to write a LinkCrawler rule for jlist.com as well.
The items its find are probably not the main product pictures though,
If I'm trying to copy paste their url I got the Cloudflare thingy again


Quote:
As explained you will find countless examples in our forums.
You can also find some basic examples in our knowledgebase:
https://support.jdownloader.org/Know...kcrawler-rules

Yes. This is what LinkCrawler rules are usually used for: For specific websites.

Depends on how you will design your custom LinkCrawler Rule.
I'm bad with coding stuff so it will be a bit hard for me,
But what I'm mostly scared of is ruining the current settings of the LinkCrawler which work fine for most of the sites I'm using it at aside few,

Is there a way to not touch the default LinkCrawler and make a new one with a new ID or something of the sort?
Or I must always edit the settings in the same LinkCrawler?
Reply With Quote
  #6  
Old 08.09.2023, 13:27
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,121
Default

Quote:
Originally Posted by Doom View Post
The items its find are probably not the main product pictures though,
As long as Cloudflare is not blocking, those product pictures should be found since the deep-parser will add all items it finds inside the html code and the product images are linked as clear-text in html code e.g.:
jlist.com/media/cache/sylius_shop_product_original/ea/e9/ed03d4c347a06eda18f1d48aa0f2.jpg

Quote:
Originally Posted by Doom View Post
If I'm trying to copy paste their url I got the Cloudflare thingy again
As explained please read the Cloudflare thread. This is not a JD bug.
As long as Cloudflare is blocking at this stage, you will not be able to use JD to grab/download anything from jlist.com either way.
Cloudflare FAQ English:
https://board.jdownloader.org/showthread.php?t=83712


Quote:
Originally Posted by Doom View Post
I'm bad with coding stuff so it will be a bit hard for me,
Creating such rules has nothing to do with coding abilities.

Quote:
Originally Posted by Doom View Post
But what I'm mostly scared of is ruining the current settings of the LinkCrawler which work fine for most of the sites I'm using it at aside few,
This won't happen.
If you are using LinkCrawler rules created by other users: Just create a backup before creating custom rules.
If you are afraid of changing other settings or "destrying" your setup with changed settings: Just create a full backup in beforehand and then start playing around.
Help article about backup of settings:
https://support.jdownloader.org/Know...-configuration

Quote:
Originally Posted by Doom View Post
Is there a way to not touch the default LinkCrawler and make a new one with a new ID or something of the sort?
I think you misunderstood me:
Link Crawler rules work additionally to the default "deep crawler".
By default there is only one LinkCrawler rule in the advanced setting "LinkCrawler.linkcrawlerrules".
If you are messing anything up by adding custom rules, you can just reset that setting to default or disable Link Crawler rules globally.
All the rest about creating such rules is explained here:
https://support.jdownloader.org/Know...kcrawler-rules
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 09:22.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.