[Doom]

Recently a lot sites I know got updated in recent years and not being supported anymore by Jdownloder,

I don't know if they had plugin but I know that now site like
**External links are only visible to Support Staff****External links are only visible to Support Staff** and J-list/J-box (like this one **External links are only visible to Support Staff****External links are only visible to Support Staff**) won't let JD to detect their links and instead will show "Blocked by!Cloudflare Site-Protection" when you try to pick something from them


Aside from that I would like to ask if it be possible to make a plugin for sites like **External links are only visible to Support Staff****External links are only visible to Support Staff**,

Basically, if you go into one of their reviews (like this **External links are only visible to Support Staff**one)
JD may only detect the previews at best,
The site got dual links and no option to right click as some security measures,
I can easily bypass them but will having to click on each link one by one, so I wanted to know if there's any chance JDownloder will be able to detect the source images when you copy the page URL to spare me a lot of time.


Thx in advance.

[pspzockerscene]

Okay one by one:
ouo.io:
Website is supported and no issues are known.
If you think there is a problem, please provide example URLs and a log.

jlist.com:
There is no plugin available for this website and I also don't see the need of adding one.
If you get that "Cloudflare" Problem: Please read our Cloudflare FAQ
If our deep-parser already can't get through Cloudflare, a plugin is not possible anyways.

wotaburo.net or in general, adding support for more website:
Anything is possible.
In the end it comes down to how much time is needed to add that plugin and how many users would like to have a plugin for that website.
That website looks very simple thus I would say a plugin is not needed: Just use 1-2 LinkCrawler Rules to download from it.
You can find more example-rules throughout our forums.

Originally Posted by Doom

The site got dual links and no option to right click as some security measures,

--> Does not matter as all JD sees is their html code and they did not bother adding any kind of other protection to hide the URLs in there.

[Doom]

Originally Posted by pspzockerscene

Okay one by one:
ouo.io:
Website is supported and no issues are known.
If you think there is a problem, please provide example URLs and a log.

jlist.com:
There is no plugin available for this website and I also don't see the need of adding one.
If you get that "Cloudflare" Problem: Please read our **External links are only visible to Support Staff**...
If our deep-parser already can't get through Cloudflare, a plugin is not possible anyways.

wotaburo.net or in general, adding support for more website:
Anything is possible.
In the end it comes down to how much time is needed to add that plugin and how many users would like to have a plugin for that website.
That website looks very simple thus I would say a plugin is not needed: Just use 1-2 **External links are only visible to Support Staff**... to download from it.
You can find more example-rules throughout our forums.


--> Does not matter as all JD sees is their html code and they did not bother adding any kind of other protection to hide the URLs in there.

Here's a log for ouo.io as well as J-list

05.09.23 12.57.21 <--> 05.09.23 13.00.08 jdlog://7357311370661/

And random links for both

**External links are only visible to Support Staff****External links are only visible to Support Staff**

**External links are only visible to Support Staff****External links are only visible to Support Staff**

With J-Box I just wanted JD to work to spare me being a clicking monkey if I want an image from their stuff,
It worked well for long time till they updated stuff in their site,
If it's impossible though, not much that can be done I guess ;/


As for wotaburo,
I'm kinda dumb with coding or commands stuff so an example will be welcome,
Can I add link crawler rule to work only on this site?
Also will it take only the deeper image links or will make JD to detect both previews and inner image links?

[pspzockerscene]

ouo.io:
Your log shows that ouo.io fails due to Cloudflare (same as here for me).
As explained please read the Cloudflare thread. This is not a JD bug.

jlist.com:
For me when adding the jlist.com link, the deep-parser does find items so technically it should be possible to write a LinkCrawler rule for jlist.com as well.

wotaburo.net and LinkCrawler rules:

Originally Posted by Doom

I'm kinda dumb with coding or commands stuff so an example will be welcome,

As explained you will find countless examples in our forums.
You can also find some basic examples in our knowledgebase:
https://support.jdownloader.org/Know...kcrawler-rules

Originally Posted by Doom

Can I add link crawler rule to work only on this site?

Yes. This is what LinkCrawler rules are usually used for: For specific websites.

Originally Posted by Doom

Also will it take only the deeper image links or will make JD to detect both previews and inner image links?

Depends on how you will design your custom LinkCrawler Rule.

[Doom]

jlist.com:
For me when adding the jlist.com link, the deep-parser does find items so technically it should be possible to write a LinkCrawler rule for jlist.com as well.

The items its find are probably not the main product pictures though,
If I'm trying to copy paste their url I got the Cloudflare thingy again

As explained you will find countless examples in our forums.
You can also find some basic examples in our knowledgebase:
https://support.jdownloader.org/Know...kcrawler-rules

Yes. This is what LinkCrawler rules are usually used for: For specific websites.

Depends on how you will design your custom LinkCrawler Rule.

I'm bad with coding stuff so it will be a bit hard for me,
But what I'm mostly scared of is ruining the current settings of the LinkCrawler which work fine for most of the sites I'm using it at aside few,

Is there a way to not touch the default LinkCrawler and make a new one with a new ID or something of the sort?
Or I must always edit the settings in the same LinkCrawler?

[pspzockerscene]

Originally Posted by Doom

The items its find are probably not the main product pictures though,

As long as Cloudflare is not blocking, those product pictures should be found since the deep-parser will add all items it finds inside the html code and the product images are linked as clear-text in html code e.g.:
jlist.com/media/cache/sylius_shop_product_original/ea/e9/ed03d4c347a06eda18f1d48aa0f2.jpg

Originally Posted by Doom

If I'm trying to copy paste their url I got the Cloudflare thingy again

As explained please read the Cloudflare thread. This is not a JD bug.
As long as Cloudflare is blocking at this stage, you will not be able to use JD to grab/download anything from jlist.com either way.
Cloudflare FAQ English:
https://board.jdownloader.org/showthread.php?t=83712

Originally Posted by Doom

I'm bad with coding stuff so it will be a bit hard for me,

Creating such rules has nothing to do with coding abilities.

Originally Posted by Doom

But what I'm mostly scared of is ruining the current settings of the LinkCrawler which work fine for most of the sites I'm using it at aside few,

This won't happen.
If you are using LinkCrawler rules created by other users: Just create a backup before creating custom rules.
If you are afraid of changing other settings or "destrying" your setup with changed settings: Just create a full backup in beforehand and then start playing around.
Help article about backup of settings:
https://support.jdownloader.org/Know...-configuration

Originally Posted by Doom

Is there a way to not touch the default LinkCrawler and make a new one with a new ID or something of the sort?

I think you misunderstood me:
Link Crawler rules work additionally to the default "deep crawler".
By default there is only one LinkCrawler rule in the advanced setting "LinkCrawler.linkcrawlerrules".
If you are messing anything up by adding custom rules, you can just reset that setting to default or disable Link Crawler rules globally.
All the rest about creating such rules is explained here:
https://support.jdownloader.org/Know...kcrawler-rules