JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 02.11.2022, 21:55
hishtnik011 hishtnik011 is offline
Registered / Inactive
 
Join Date: Aug 2021
Posts: 20
Default GUIDE: Monster script for downloading porn gallieries

Since people recently helped me automate this I thought I'd post the script I use and a guide how to make it work properly (should be fairly easy).

This let's you download galleries from many sites and support for the ones I've encountered is pre-added.

UPDATE: The script and instructions have been ported over to github
LINK: github.com/arandom0/jdownloader-automated-gallery-download

Last edited by hishtnik011; 25.11.2022 at 07:38.
Reply With Quote
  #2  
Old 03.11.2022, 13:50
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 73,127
Default

Good job!

Even though I'm not working a lot with JS you created some nicely readable code with documentation and errorhandling.

A few suggestions when it comes to poosting this in our forums:
  • I recommend putting in in a github.com repo (or similar) so you can maintain it easier and other users can follow easier. Also IK'm quite sure that this one will not be the final version of that script
  • If you wish to keep the code directly in your post in our forums, I recommend to at least additionally putting it into a pastbin service like pastebin.com and link it here so that our forum URL-censor cannot potentially mess with the syntax of that script -> When quickly looking over it though, it doesn't seem like our forum broke any of the syntax so far.

Quote:
Originally Posted by hishtnik011 View Post
When downloading exclusively photos like this, you can speed up the process by going to Jdownloader, Settings, Advanced Settings, Linkcollector: Do Link Check
and unticking its checkbox. Then restart Jdownloader.
You can remove this part from your instructions.
The restart is not needed anymore though it used to be required in the past.
Whenever you're changing settings that require a restart, JDownloader will let you know this in a dialog box.

Quote:
Originally Posted by hishtnik011 View Post
It also has the potential not to include the file extension with a few image hosts.
While this is correct, I'd nearly call this a design flaw of JD or let's call it a missing feature:
By using the Packagizer rule, the final filename will be set regardless of whether or not a file-extension is present.
It's like when you modify filenames inside JDownloader: You will force it to use those.
Now it would probably be nice if we had a setting like "correct/add file-extension whenever it is missing" because for most of all cases, the file-extension will be given via the Content-Type header when starting the download.
This feature would preserver the previously set file-title and only touch the file-extension.
At this moment this is not possible though and the file-extension will be missing in such cases.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 03.11.2022 at 13:53.
Reply With Quote
  #3  
Old 03.11.2022, 21:41
hishtnik011 hishtnik011 is offline
Registered / Inactive
 
Join Date: Aug 2021
Posts: 20
Default

Ok thanks. I may create a github. I also edited the post as you suggested.

As for the filename thing, in my eyes it's not a big deal because my file manager (Thunar) has a bulk rename feature built in. I can easily select a bunch of files and add an extension. Windows probably has some bulk-rename program like that as well. In any case, I'd much rather have the correct filename and no extension than the other way around. Moreover this only happens with LinkCheck disabled (which most people don't do) and only with 1 or 2 of the image hosts I've encountered. Imx.to is one of them.
Reply With Quote
  #4  
Old 04.11.2022, 12:49
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 73,127
Default

Alternatively if no extension is given but you know it, you could add each link one by one and force the filename.
This would eliminate the need of the Packagizer rule completely but add more complexity to your script.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #5  
Old 17.11.2022, 12:05
cstern cstern is offline
Mega Loader
 
Join Date: Jul 2012
Location: Denmark
Posts: 61
Default

maybe this should be sticky? (and ammended with a link to the github project if it becomes available)
Reply With Quote
  #6  
Old 23.11.2022, 07:45
hishtnik011 hishtnik011 is offline
Registered / Inactive
 
Join Date: Aug 2021
Posts: 20
Default

Quote:
Originally Posted by cstern View Post
maybe this should be sticky? (and ammended with a link to the github project if it becomes available)
I added a github, though idk what's good about it other than in the case of updates:
github.com/arandom0/jdownloader-automated-gallery-download

Last edited by pspzockerscene; 23.11.2022 at 13:49. Reason: Removed URL-censoring so users can see that github link
Reply With Quote
  #7  
Old 23.11.2022, 13:49
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 73,127
Default

This thread is now a sticky.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #8  
Old 25.11.2022, 07:40
hishtnik011 hishtnik011 is offline
Registered / Inactive
 
Join Date: Aug 2021
Posts: 20
Default

Quote:
Originally Posted by pspzockerscene View Post
This thread is now a sticky.
Ok thank you! I edited the top comment to include the github link. You were right, it is more convenient. I just added support for 2 other sites and and did some bug fixes and don't have to edit that complex post I had
Reply With Quote
  #9  
Old 25.11.2022, 13:19
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 73,127
Default

I'm happy you like it.
I'll leave that one up as a sticky as long as your script is actively maintained and/or working fine for its purpose.
Thanks for your contribution!
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #10  
Old 06.02.2023, 17:21
verheiratet1952 verheiratet1952 is offline
JD VIP
 
Join Date: Jan 2016
Posts: 346
Default

Quote:
Originally Posted by hishtnik011 View Post
Since people recently helped me automate this I thought I'd post the script I use and a guide how to make it work properly (should be fairly easy).

This let's you download galleries from many sites and support for the ones I've encountered is pre-added.

UPDATE: The script and instructions have been ported over to github
LINK: github.com/arandom0/jdownloader-automated-gallery-download

great script!

I added everything from README.md on github

I also added some test.crawljob file to my folderwatch with UTF-8

example links inside .crawljob file

**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

it does not work...
it does not collect any files, and it does not start with any crawling !?

my question is: how does JD and Tampermonkey extension (I am using FIREFOX) can start working together?
how to RUN or START a filelist/crawljob? when adding a .crawljob file there is nothing happening...



by the way:
the extension with your script is working fine with Firefox as standalone for savong a gallery one by one...
but not together with jdownloader to be able to run batch process with .crawljob file


you forget about any steps in between or is there anything you take it for granted, as a basic setting and not being mentioned!?

Last edited by verheiratet1952; 09.02.2023 at 16:10. Reason: wrong links
Reply With Quote
  #11  
Old 23.02.2023, 19:04
hishtnik011 hishtnik011 is offline
Registered / Inactive
 
Join Date: Aug 2021
Posts: 20
Default

Quote:
Originally Posted by verheiratet1952 View Post
great script!

I added everything from README.md on github

I also added some test.crawljob file to my folderwatch with UTF-8

example links inside .crawljob file

**External links are only visible to Support Staff**...
**External links are only visible to Support Staff**...
**External links are only visible to Support Staff**...
**External links are only visible to Support Staff**...
**External links are only visible to Support Staff**...
**External links are only visible to Support Staff**...
**External links are only visible to Support Staff**...
**External links are only visible to Support Staff**...
**External links are only visible to Support Staff**...
**External links are only visible to Support Staff**...
**External links are only visible to Support Staff**...
**External links are only visible to Support Staff**...
**External links are only visible to Support Staff**...
**External links are only visible to Support Staff**...
**External links are only visible to Support Staff**...
**External links are only visible to Support Staff**...
**External links are only visible to Support Staff**...
**External links are only visible to Support Staff**...
**External links are only visible to Support Staff**...
**External links are only visible to Support Staff**...
**External links are only visible to Support Staff**...
**External links are only visible to Support Staff**...
**External links are only visible to Support Staff**...
**External links are only visible to Support Staff**...
**External links are only visible to Support Staff**...
**External links are only visible to Support Staff**...

it does not work...
it does not collect any files, and it does not start with any crawling !?

my question is: how does JD and Tampermonkey extension (I am using FIREFOX) can start working together?
how to RUN or START a filelist/crawljob? when adding a .crawljob file there is nothing happening...



by the way:
the extension with your script is working fine with Firefox as standalone for savong a gallery one by one...
but not together with jdownloader to be able to run batch process with .crawljob file


you forget about any steps in between or is there anything you take it for granted, as a basic setting and not being mentioned!?

The way tampermonkey and jdownloader work together is for any of the sites in that Tampermonkey script you installed, there should be a button to get the links when you're viewing a gallery. The script will get the links and save a crawljob file on your computer, which Jdownloader will pick up.

And yes, it is supposed to be 1 by 1 gallery. I'm not sure exactly what you mean when you say "batch". Do you mean add one link containing multiple galleries and it handles all them at once? If that's the case, the script is not made for that, sorry.
Reply With Quote
  #12  
Old 23.02.2023, 19:05
hishtnik011 hishtnik011 is offline
Registered / Inactive
 
Join Date: Aug 2021
Posts: 20
Default

I updated the Github repo and added other (helper) scripts as well. The "thenude" ones and redirect one are very useful. Thenude website has all the info about models and their photos, and with the script, underneath each set there will be buttons that take you to sites likely to contain it.

More info about the "thenude" script:
For vipergirls (VG button) you need the vipergirls search addon script
For hqnp (NP button) you need to register in that site (link commented at the beginning of script "thenude - behavior - cust btns"). Also, If you haven't visited that site in a few days (I believe), you will have to manually go to it the first time, potentially login if you haven't and search something (link without vip.)

Last edited by hishtnik011; 19.03.2023 at 10:34.
Reply With Quote
  #13  
Old 24.09.2024, 19:42
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 73,127
Default

I've just un-pinned this thread to make room for others.
Whoever needs it, will find this thread.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 12:31.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.