[nicknick]

Hello friends, first of all I want to thank and greet all the JDownlaoder team and the whole forum as this is my first time here.

I'm trying to get JDownlaoder to download free 3D Blender files from this open source website and free 3D files without copyright (smutba.se and open3dlab.com, but if I have to choose one of the 2, I prefer smutba.se):

Example:

I go to **External links are only visible to Support Staff****External links are only visible to Support Staff** and click on a 3D model, for example this one:

**External links are only visible to Support Staff****External links are only visible to Support Staff**

Scrolling down the page, the files available for download will appear, with the green "DOWNLOAD" button:

(screenshot)
https://i.imgur.com/5I0zsFK.png

So, let's imagine that I only want to download the 3D file "batman_gk_minor_fix.blend".

If you right click, you won't be able to get the url in the context menu, but if you left click, the list of available download servers will appear, with a green button.

In this case the 2 free download servers available are the green ones, in my case, the European server on the left:

(screenshot)
https://i.imgur.com/4WGZTlA.png

If you right click on the green download server button and click "copy link"

(screenshot)
https://i.imgur.com/MR9noXx.png

You will get this link:

**External links are only visible to Support Staff****External links are only visible to Support Staff**

But the JDownloader link grabber does not capture the links when copying this link, (this is what I want to achieve, that JDownloader recognizes this link and captures the file "batman_gk_minor_fix.blend" in the link grabber).

Then, as JDownloader does not recognize this link, I add it manually to the link grabber:

https://i.imgur.com/vVD94si.png

Now JDownloader does find the ".blend" file, but also other files that I don't want:

(The red ones are the unwanted files, and the green one is the ".blend" file I want to download. Sometimes it can be a ".rar" or ".zip" file.)

(screenshot)
https://i.imgur.com/sU1tmbJ.png

This is not really a problem, as I can clean the other files (png, js, webp, etc.) manually, and get only the ".blend" file. It's slow, though, but I don't mind).

Now, JDownloader is supposed to have learned to download automatically from the "**External links are only visible to Support Staff** link, by right clicking on the download server and copying the link, but nope.

If I try to download another 3D file, for example this one:

**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

When I right click and "copy link", JDownloader does not capture this link, and I have to manually add it back to the link grabber, each link.

____________________________________________________________________________

Since JDownloader can't learn to capture that link automatically (that's what I'm trying to do), I was thinking of another alternative:

Normal left click on the European download server:

(screenshot)
https://i.imgur.com/4WGZTlA.png

And this new window will appear in the following link:

**External links are only visible to Support Staff****External links are only visible to Support Staff**

(screenshot)
https://i.imgur.com/mzwSDZN.png

And the file will start downloading via Mozilla Firefox (in my case), but I cancel the download, and copy the download directly from the European server, by right clicking "copy link" in this part of the manual download link:

(screenshot)
https://i.imgur.com/kSNY4su.png

Then I get the following direct download link from the European server of the file:

**External links are only visible to Support Staff****External links are only visible to Support Staff**

I make JDownloader learn it by adding it manually, and JDownloader learns it. But I have to download each file manually, cancel the download from Mozilla Firefox, and right click for JDownloader to capture it, it's kind of annoying to have to do this 1200 times.

I would like to be able to capture the blend, rar, etc files by right clicking on the green button on the European server, as I don't know any other easier method.

Because I don't think JDownloader can detect the files from the main link "**External links are only visible to Support Staff** (this would be almost impossible to do, I think).

This seems to be a very difficult case, as I have been using JDownlaoder for a short time and I don't know how to program or anything like that.

____________________________________________________________________________

In the case of "open3dlab.com", it works the same as "smutba.se", same graphical interface, and same direct server download link.

SMUTBA.SE => **External links are only visible to Support Staff****External links are only visible to Support Staff**....

OPEN3DLAB => **External links are only visible to Support Staff****External links are only visible to Support Staff**...

If you can only add one site, the best one is SMUTBA.SE, because it is the one I need to download all the 3D files and the site that everybody uses.

Sorry to cause you so much trouble, also sorry for my bad English.

Thanks again for your time and help.

[raztoki]

Hi nicknick, basically this should require a plugin, either both decrypter and hoster, or just hoster plugin. Their have been plugins like this before where you mirrors in different locations for free and paid streams. Please wait for someone to make you an issue ticket for tracking purposes, else you make the plugin/s yourself if you feel your up to it.

raztoki

[pspzockerscene]

Added simple host plugin for links like:
open3dlab.com/project/file/download/12345/ams1/

Once that update is out, you can easily create a simple LinkCrawler rule (type DEEPDECRYPT) which can find all single file download URLs inside URLs like:
open3dlab.com/project/12345/

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!
---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

-psp-

[nicknick]

Originally Posted by pspzockerscene

Added simple host plugin for links like:
open3dlab.com/project/file/download/12345/ams1/

Once that update is out, you can easily create a simple **External links are only visible to Support Staff**... (type DEEPDECRYPT) which can find all single file download URLs inside URLs like:
open3dlab.com/project/12345/

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser **External links are only visible to Support Staff**...! | Please read our **External links are only visible to Support Staff**...!
---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser **External links are only visible to Support Staff**...! | Please read our **External links are only visible to Support Staff**...!

-psp-

Wait, does this mean that when JDownloader is updated, I will be able to download it without having to do anything? Omg, that's fantastic, thank you very much!

Please Mr. administrator, one last request, for me it's the most important, can you also add the page **External links are only visible to Support Staff****External links are only visible to Support Staff** please?

It is the twin site of **External links are only visible to Support Staff****External links are only visible to Support Staff**, it is also open source and free files without copyright.

I would like to be able to download about 1200 files from this site to have a complete 3D repository, can you accept the request to add to the JDownlaoder repository of this site please?

As both sites are almost the same, the download url is almost the same, as you can see in this example:

(smutba.se)
**External links are only visible to Support Staff****External links are only visible to Support Staff**
(open3dlab.com)
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Maybe I should open another thread with a request? smutba.se is the most famous website for free 3D models.

I will be very grateful, thanks again for all your help!

[pspzockerscene]

Originally Posted by nicknick

Wait, does this mean that when JDownloader is updated, I will be able to download it without having to do anything?

It means what it states in my post.
Once released, you can test it and provide further feedback.

Originally Posted by nicknick

Please Mr. administrator, one last request, for me it's the most important, can you also add the page smutba.se please?

I'm sorry but we can't add plugins for "all" websites.
Also that website looks to be simple and the final direct-URLs you desire are listed plain inside its HTML code.
This means that you could easily setup a rule to make JD only grab what you want - an extra plugin is not needed.
More information:
https://support.jdownloader.org/Know...kcrawler-rules
You need this kind of rule:
https://support.jdownloader.org/Know...deepdecrypt/22

Originally Posted by nicknick

As both sites are almost the same, the download url is almost the same, as you can see in this example:

Please provide real life example URLs.
If "smutba.be" really is a "sister site" of "open3dlab.com" and is technically the same, it would be easy for me to also add it to the new "open3dlab.com" plugin.

[nicknick]

Originally Posted by pspzockerscene

Please provide real life example URLs.
If "smutba.be" really is a "sister site" of "open3dlab.com" and is technically the same, it would be easy for me to also add it to the new "open3dlab.com" plugin.

Thank you again for your help sir, sorry for my bad English, I will try to explain myself as best as possible.

Example:

I go to **External links are only visible to Support Staff****External links are only visible to Support Staff** and click on a 3D model, for example this one:

**External links are only visible to Support Staff****External links are only visible to Support Staff**

Scrolling down the page, the files available for download will appear, with the green "DOWNLOAD" button:

(screenshot)
https://i.imgur.com/5I0zsFK.png

So, let's imagine that I only want to download the 3D file "batman_gk_minor_fix.blend".

If you right click, you won't be able to get the url in the context menu, but if you left click, the list of available download servers will appear, with a green button.

In this case the 2 free download servers available are the green ones, in my case, the European server on the left:

(screenshot)
https://i.imgur.com/4WGZTlA.png

If you right click on the green download server button and click "copy link"

(screenshot)
https://i.imgur.com/MR9noXx.png

You will get this link:

**External links are only visible to Support Staff****External links are only visible to Support Staff**

But the JDownloader link grabber does not capture the links when copying this link, (this is what I want to achieve, that JDownloader recognizes this link and captures the file "batman_gk_minor_fix.blend" in the link grabber).

Then, as JDownloader does not recognize this link, I add it manually to the link grabber:

https://i.imgur.com/vVD94si.png

Now JDownloader does find the ".blend" file, but also other files that I don't want:

(The red ones are the unwanted files, and the green one is the ".blend" file I want to download. Sometimes it can be a ".rar" or ".zip" file.)

(screenshot)
https://i.imgur.com/sU1tmbJ.png

This is not really a problem, as I can clean the other files (png, js, webp, etc.) manually, and get only the ".blend" file. It's slow, though, but I don't mind).

Now, JDownloader is supposed to have learned to download automatically from the "**External links are only visible to Support Staff** link, by right clicking on the download server and copying the link, but nope.

If I try to download another 3D file, for example this one:

**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

When I right click and "copy link", JDownloader does not capture this link, and I have to manually add it back to the link grabber, each link.

____________________________________________________________________________

Since JDownloader can't learn to capture that link automatically (that's what I'm trying to do), I was thinking of another alternative:

Normal left click on the European download server:

(screenshot)
https://i.imgur.com/4WGZTlA.png

And this new window will appear in the following link:

**External links are only visible to Support Staff****External links are only visible to Support Staff**

(screenshot)
https://i.imgur.com/mzwSDZN.png

And the file will start downloading via Mozilla Firefox (in my case), but I cancel the download, and copy the download directly from the European server, by right clicking "copy link" in this part of the manual download link:

(screenshot)
https://i.imgur.com/kSNY4su.png

Then I get the following direct download link from the European server of the file:

**External links are only visible to Support Staff****External links are only visible to Support Staff**

I make JDownloader learn it by adding it manually, and JDownloader learns it. But I have to download each file manually, cancel the download from Mozilla Firefox, and right click for JDownloader to capture it, it's kind of annoying to have to do this 1200 times.

I would like to be able to capture the blend, rar, etc files by right clicking on the green button on the European server, as I don't know any other easier method.

Because I don't think JDownloader can detect the files from the main link "**External links are only visible to Support Staff** (this would be almost impossible to do, I think).

This seems to be a very difficult case, as I have been using JDownlaoder for a short time and I don't know how to program or anything like that.

____________________________________________________________________________

In the case of "open3dlab.com", it works the same as "smutba.se", same graphical interface, and same direct server download link.

SMUTBA.SE => **External links are only visible to Support Staff****External links are only visible to Support Staff**....

OPEN3DLAB => **External links are only visible to Support Staff****External links are only visible to Support Staff**...

If you can only add one site, the best one is SMUTBA.SE, because it is the one I need to download all the 3D files and the site that everybody uses.

Sorry to cause you so much trouble, also sorry for my bad English.

Thanks again for your time and help.

[pspzockerscene]

Too much text.

As smutba.se is technically the same as "open3dlab.com", I've also added it.
Please wait for the next CORE-update and provide feedback then.

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!
---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

-psp-

[nicknick]

Hi all friends.

A kind admin/developer accepted a request for a plugin for a website. It is currently in "[Wait for JD2 Core Update]" status.

I have to wait for a new Core update before I can start using it, right? At least that's what I understood in the FAQ of the thread.

Is this the correct link to know if the new Core update is out?

https://support.jdownloader.org/Know...pdate-behavior

Right now that link shows the update:

Latest Revision: 47256 Date: Mon Jan 09 14:48:02 CET 2023

And my JDownloader has the same update, so the Plugin/Core update will be available in the next update.

Is that correct, or is there something I didn't understand because of my bad English?

Thanks in advance friends.

[pspzockerscene]

Merged your posts/threads.

@nicknick
Why do you think I'am linking our update FAQ with big letters in every relevant post?
Because that FAQ will answer your questions.
The FAQ also states information about ETAs.

We're open for suggestions so if you think that that help article can be improved, please let us know which information in it is unclear to you.
EDIT

Originally Posted by nicknick

I have to wait for a new Core update before I can start using it, right?

Yes.

Originally Posted by nicknick

Is this the correct link to know if the new Core update is out?
https://support.jdownloader.org/Know...pdate-behavior

Yes.

Originally Posted by nicknick

And my JDownloader has the same update, so the Plugin/Core update will be available in the next update.

Is that correct, or is there something I didn't understand because of my bad English?

Yes, that is correct.

[pspzockerscene]

I've also added a crawler for such links:
/project/12345/

CORE-Updates have been released!
All announced bugfixes and features are live!
Please update your JDownloader and report any issues you find asap.
If this thread gets marked as "[Solved]" by our forum staff you can still post in it and we will read- and reply to it!

CORE-Updates wurden released!
Alle angekündigten Bugfixes/Features sind nun verfügbar!
Bitte JDownloader updaten und eventuelle Bugs schnellstmöglich an uns melden.
Falls dieser Thread vom Team als "[Erledigt]" markiert wird, kannst du weiterhin darin antworten und wir lesen/beantworten auch solche Threads!

-psp-

[nicknick]

Originally Posted by pspzockerscene

I've also added a crawler for such links:
/project/12345/

CORE-Updates have been released!
All announced bugfixes and features are live!
Please update your JDownloader and report any issues you find asap.
If this thread gets marked as "[Solved]" by our forum staff you can still post in it and we will read- and reply to it!

CORE-Updates wurden released!
Alle angekündigten Bugfixes/Features sind nun verfügbar!
Bitte JDownloader updaten und eventuelle Bugs schnellstmöglich an uns melden.
Falls dieser Thread vom Team als "[Erledigt]" markiert wird, kannst du weiterhin darin antworten und wir lesen/beantworten auch solche Threads!

-psp-

Omg, I just updated JDownloader and it works PERFECT!

Thank you so much for your fast and efficient work Mr. pspzockerscene, everything works perfectly, this will really save a lot of time for me and thousands of Blender users that use these two websites every day.

I opened the other thread in the General subforum not to fill this thread with unnecessary questions (thanks for merging both threads), I wasn't sure if I understood everything well because of my bad English. But the FAQ is correctly written and clear, it's just my fault that I'm a bit clumsy.

Again, thank you very much to you and all the JDownloader team, I really don't know how to thank you for all your work, I'm really happy with this.

If I find any bugs or anything like that I will report it here quickly.

Thanks again for all your help!

Originally Posted by raztoki

Hi nicknick, basically this should require a plugin, either both decrypter and hoster, or just hoster plugin. Their have been plugins like this before where you mirrors in different locations for free and paid streams. Please wait for someone to make you an issue ticket for tracking purposes, else you make the plugin/s yourself if you feel your up to it.

raztoki

Thanks also to you for your help Mr. raztoki, I forgot to reply to your message sorry!

[pspzockerscene]

Thanks for your detailed feedback.

[nicknick]

Originally Posted by pspzockerscene

Thanks for your detailed feedback.

I found a "bug" but it is not serious.

When you copy the link 3D models that have almost the same name or start with the same word, both files are put in the same folder instead of in folders with different names. Maybe it is due to incompatibility with special characters " - : [ ] ( )" due to the link grabber, otherwise everything works correctly.

For example, this should be in different folders, but the link grabber places all files in the first folder:

Lara Croft - Shadow of the Tomb Raider
**External links are only visible to Support Staff****External links are only visible to Support Staff**
Lara Croft [Shadow of the Tomb Raider]
**External links are only visible to Support Staff****External links are only visible to Support Staff**

https://i.imgur.com/rJIn7L0.png

By the way do you think it would be too much work to make the link grabber able to capture the 3D models per page or per individual user profile?

For example, by page number:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Or for example user profile:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Thanks again for all your time and help!

[nicknick]

Thanks for the new feature/mirror/filter, I tested it with over 300 files and it works perfectly!

https://i.imgur.com/bw4boD4.png

This addon is really helping me a lot both to save time and to sort everything correctly without losing files. I'm sure it will help many people who also use these 2 websites!

[pspzockerscene]

Originally Posted by nicknick

I found a "bug" but it is not serious.

When you copy the link 3D models that have almost the same name or start with the same word, both files are put in the same folder instead of in folders with different names. Maybe it is due to incompatibility with special characters " - : [ ] ( )" due to the link grabber, otherwise everything works correctly.

For example, this should be in different folders, but the link grabber places all files in the first folder:

This is not a bug.
You can do the following to avoid this:
Settings -> Advanced Settings -> GeneralSettings.cleanupfilenames -> Disable this and restart JDownloader

Originally Posted by nicknick

By the way do you think it would be too much work to make the link grabber able to capture the 3D models per page or per individual user profile?

I'm sorry but we're not adding functionality that endorses creating so called "site rips".
You can manuelly collect the JD-supported links behind such links as described here:
https://support.jdownloader.org/Know...orted-websites

[nicknick]

Originally Posted by pspzockerscene

This is not a bug.
You can do the following to avoid this:
Settings -> Advanced Settings -> GeneralSettings.cleanupfilenames -> Disable this and restart JDownloader

Thank you very much for all your help.

I have disabled the option you told me and restarted JDownloader, but the packer keeps merging different names in the same folder, for example these 2 different names, they are merged in the same folder:

Blackcat
black cat

They are 2 different names, separate, upper/lower case, 2 different links:

**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

But JDownloader packer joins all files in the same folder/package:

https://i.imgur.com/s1whAYn.png

The packager should create the folders "Blackcat" and "black cat" since they are 2 different links and 2 different 3D model names.

But don't worry, it is not a serious "bug"! I just wanted to say this in case anyone didn't know about it.

(By the way, if you copy the links in reverse order, the first folder will contain the name of the first copied link, and the files from the second link will be merged with the first folder.

I have only seen this behavior with some names that resemble each other.)

Originally Posted by pspzockerscene

Additional information:
I've added support for crawling user profiles.

Please still keep in mind that we're not adding support for types of links which when crawled could easily result in a "site rip" such as "search query links", "tag search query links", "category links" or generic "endless pagination" links.

Thank you very much, it really works perfectly! This will save me a lot of work when it comes to grouping the models by user name and downloading them.

I will report back if I find any errors.

Thanks again!

[pspzockerscene]

Additional information:
I've added support for crawling user profiles.

Please still keep in mind that we're not adding support for types of links which when crawled could easily result in a "site rip" such as "search query links", "tag search query links", "category links" or generic "endless pagination" links.

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!
---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

-psp-

[pspzockerscene]

CORE-Updates have been released!
All announced bugfixes and features are live!
Please update your JDownloader and report any issues you find asap.
If this thread gets marked as "[Solved]" by our forum staff you can still post in it and we will read- and reply to it!

CORE-Updates wurden released!
Alle angekündigten Bugfixes/Features sind nun verfügbar!
Bitte JDownloader updaten und eventuelle Bugs schnellstmöglich an uns melden.
Falls dieser Thread vom Team als "[Erledigt]" markiert wird, kannst du weiterhin darin antworten und wir lesen/beantworten auch solche Threads!

-psp-

[pspzockerscene]

Fixed.

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!
---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

-psp-

[nicknick]

Originally Posted by pspzockerscene

Fixed.

Works perfect now!

https://i.imgur.com/piCTTzW.png

Thanks again!