JDownloader Community - Appwork GmbH
 

Notices

Reply
 
Thread Tools Display Modes
  #21  
Old 28.06.2022, 18:52
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,344
Default

Quote:
Originally Posted by Beer View Post
2. Will all files have names or dates? Videos and pictures, or multiple within a single post.
I'm sure pspzockerscene will answer once he's back in forum
__________________
JD-Dev & Server-Admin
Reply With Quote
  #22  
Old 28.06.2022, 22:03
Beer Beer is offline
Giga Loader
 
Join Date: Oct 2019
Posts: 99
Default

Quote:
Originally Posted by Jiaz View Post
I try my best to release it by tomorrow
I shall count the hours... lol.

Quote:
Originally Posted by Jiaz View Post
I'm sure pspzockerscene will answer once he's back in forum
There is one tampermonkey script which obtains filenames for both pictures and videos on sleazyfork, but its so slow. Probably because it .zips all files.

As far as the crawl speed. Can we expect something similar to Twitter? For example. Twitter plugin can crawl thousands of videos and pictures within a couple of minutes.

Last edited by Beer; 28.06.2022 at 22:07.
Reply With Quote
  #23  
Old 29.06.2022, 10:23
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,344
Default

Quote:
Originally Posted by Beer View Post
As far as the crawl speed. Can we expect something similar to Twitter? For example. Twitter plugin can crawl thousands of videos and pictures within a couple of minutes.
Heavily depends on DDOS-GUARD protection, if it kicks in or not.In simple tests I was getting good crawling speeds.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #24  
Old 29.06.2022, 10:27
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,344
Default

Quote:
Originally Posted by Beer View Post
2. Will all files have names or dates? Videos and pictures, or multiple within a single post.
JDownloader will use the original names of the files as served on website. I would recommend to wait for plugin release and then check by yourself and then ask for changes
What do you mean by *will all files have dates*?
__________________
JD-Dev & Server-Admin
Reply With Quote
  #25  
Old 29.06.2022, 14:27
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,144
Default

Quote:
Originally Posted by Beer View Post
I have a couple of questions.
Sure go ahead.

Quote:
Originally Posted by Beer View Post
1. Is there an ETA on the CORE update?
That information is included in the Update-FAQ I've linked in my last reply.
Here it is again:
https://board.jdownloader.org/showthread.php?t=42523

Quote:
Originally Posted by Beer View Post
2. Will all files have names or dates? Videos and pictures, or multiple within a single post.
So far no.
Default/server-filenames are used.
Please test it once you got the update and provide feedback in this thread.

Quote:
Originally Posted by Beer View Post
As far as the crawl speed. Can we expect something similar to Twitter? For example. Twitter plugin can crawl thousands of videos and pictures within a couple of minutes.
I would say yes.
In my tests I neither ran into DDoS-Guard nor did I run into any form of rate-limits but I guess if a lot of users are using our plugin this could change
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by Jiaz; 29.06.2022 at 15:23.
Reply With Quote
  #26  
Old 29.06.2022, 20:39
Beer Beer is offline
Giga Loader
 
Join Date: Oct 2019
Posts: 99
Default

Thank you both for the comprehensive answers. When i mentioned dates and filenames i was basing myself on the experience i got from this script:

**External links are only visible to Support Staff**... (kemono downloader - Sleazy Fork)

Original fileserver names are fine by me. So many models using a vast number of emojis on their filenames makes me unable to use them for what i need, and i still haven't found an effective way to remove them.

The dates are way more pressing. Without them the files can't be ordered properly. For the videos, this can be done using the EXIF data. Not 100% effective, or the right way to date files based on their release date, but good enough.

This only applies to .m4v files. .mp4's won't contain this data because they have been touched. At least from all the files i have handled so far. So far the big majority of files were .m4v, the rest i could add manually by opening the posts on the browser via JD2 (searching the title on downloads tab).

The pictures are the real issue i guess. Without dates they can't be ordered properly and they're far too many. I think having dates on any OnlyFans related plugin is crucial, but this is already a major improvement, and i am very thankful for it. I know don't if the data on the script is something you could use.

Last edited by Beer; 29.06.2022 at 20:41. Reason: grammar lol
Reply With Quote
  #27  
Old 29.06.2022, 20:57
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,344
Default

@Beer: so you want the date to be part of the filename?
__________________
JD-Dev & Server-Admin
Reply With Quote
  #28  
Old 29.06.2022, 22:22
Beer Beer is offline
Giga Loader
 
Join Date: Oct 2019
Posts: 99
Default

Quote:
Originally Posted by Jiaz View Post
@Beer: so you want the date to be part of the filename?
Yes, if possible. In YYYY-MM-DD format. I think i speak for most people. You could have the option in the plugin, and even if not people can always remove it with a renaming program.

Thank you.
Reply With Quote
  #29  
Old 30.06.2022, 11:02
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,344
Default

@Beer: What do you think would be a good filename format scheme?
Quote:
userid-postid-date-postContentIndex-(original filename)
so for example
Quote:
yeah_123121_2022-14_04-01.jpg
yeah_123121_2022-14_04-02.jpg
yeah_123121_2022-14_04-03.jpg
or
yeah_123121_2022-14_04-fjalöfjajflöa.jpg (in case of single item)
yeah_123121_2022-14_04-01-fjalöfjajflöa.jpg
yeah_123121_2022-14_04-02-dasfjlfgaguf.jpg
__________________
JD-Dev & Server-Admin
Reply With Quote
  #30  
Old 30.06.2022, 14:44
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,144
Default

@Beer
Please use the Packagizer for custom filenames.
You can use the plugin property "date" to get the date.
EDIT

Further plugin properties (most of all should be sehr explanatory):
  • portal (e.g. "patreon")
  • userid
  • postid
EDIT2

This thread might be interesting to you as we're discussing new/better generic ways to create custom filenames.
Feel free to leave your opinion in that thread.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 05.10.2022 at 11:40. Reason: Fixed text of last hyperlink
Reply With Quote
  #31  
Old 30.06.2022, 20:20
Beer Beer is offline
Giga Loader
 
Join Date: Oct 2019
Posts: 99
Default

Quote:
Originally Posted by Jiaz View Post
@Beer: What do you think would be a good filename format scheme?
date-userid-(original filename)-postContentIndex-postid

Date comes first, then the name which presents no changes in order, the original filenames next, postContentIndex and postid (optional perhaps).

EDIT 1

P.S: Or maybe the name first. I don't think the name should really be there. Original filenames are usually so long you're going to end up cutting them anyways not to exceed the 256 path limit.

EDIT 2

Actually the original filename should come last, because its likely gonna need to be cut.

date-postid-postContentIndex-(original filename)

No userid, or before or after date.

Quote:
Originally Posted by pspzockerscene View Post
@Beer
Please use the Packagizer for custom filenames.
You can use the plugin property "date" to get the date.
EDIT

Further plugin properties (most of all should be sehr explanatory):
  • portal (e.g. "patreon")
  • userid
  • postid
Thank you. The update hasn't been released yet, has it?

Last edited by Beer; 01.07.2022 at 02:01.
Reply With Quote
  #32  
Old 01.07.2022, 15:23
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,144
Default

Quote:
Originally Posted by Beer View Post
date-userid-(original filename)-postContentIndex-postid
As explained, please:
1. Wait for the update.
2. Then use the packagizer to create your desired filenames for this host.
If you need further help with that, you may ask us after the update has been released.

We will not be releasing the next CORE-update before next week as we did a lot of changes.
We're open source so if you want, you can check out our unreleased changes as described here:
https://support.jdownloader.org/Know...up-ide-eclipse
...or just wait for the next CORE-update.

Quote:
Originally Posted by Beer View Post
Actually the original filename should come last, because its likely gonna need to be cut.
date-postid-postContentIndex-(original filename)
What should "postContentIndex" be?
Index of each URL inside a /post/<id> URL e.g. "1" for first url, "2" for 2nd url and so on?

Quote:
Originally Posted by Beer View Post
Thank you. The update hasn't been released yet, has it?
No.

Please re-read our update FAQ:

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #33  
Old 02.07.2022, 00:01
Beer Beer is offline
Giga Loader
 
Join Date: Oct 2019
Posts: 99
Default

Quote:
Originally Posted by pspzockerscene View Post
As explained, please:
1. Wait for the update.
2. Then use the packagizer to create your desired filenames for this host.
If you need further help with that, you may ask us after the update has been released.

We will not be releasing the next CORE-update before next week as we did a lot of changes.
We're open source so if you want, you can check out our unreleased changes as described here:
**External links are only visible to Support Staff**...
...or just wait for the next CORE-update.
Much appreciated, i will if need to.

Quote:
Originally Posted by pspzockerscene View Post
What should "postContentIndex" be?
Index of each URL inside a /post/<id> URL e.g. "1" for first url, "2" for 2nd url and so on?
Sure, that would be fine. Thanks for the awesome support and hard work. Looking forward for those updates.

Have a good weekend!
Reply With Quote
  #34  
Old 07.07.2022, 16:49
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,144
Default

Quote:
Originally Posted by Beer View Post
Sure, that would be fine.
Added as property "postContentIndex".

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #35  
Old 06.09.2022, 14:03
nuri nuri is offline
DSL Light User
 
Join Date: Aug 2009
Posts: 31
Default

Is there a way to have it crawl the links inside the posts too?
Reply With Quote
  #36  
Old 06.09.2022, 14:13
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,344
Default

@nuri: can you provide examples?
__________________
JD-Dev & Server-Admin
Reply With Quote
  #37  
Old 06.09.2022, 16:58
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,144
Default

Added setting for that for coomer.party and kemono.party.

Please test it after the next CORE-update and provide feedback.
Please keep in mind that, if those are links which JD cannot handle, they will not appear in your Linkgrabber at all.

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #38  
Old 11.09.2022, 00:38
nuri nuri is offline
DSL Light User
 
Join Date: Aug 2009
Posts: 31
Default

Quote:
Originally Posted by Jiaz View Post
@nuri: can you provide examples?
Sure:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

And there is also 1 more type where the link is not readily apparent, but cannot find an example currently.
Reply With Quote
  #39  
Old 11.09.2022, 13:20
nuri nuri is offline
DSL Light User
 
Join Date: Aug 2009
Posts: 31
Default

Here is 2 where the link is in the middle of the post, with additional links:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #40  
Old 12.09.2022, 13:06
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,344
Default

@nuri: Thanks for example links, should be working with next plugin update. You have to enable it in Settings->Plugins->see https://board.jdownloader.org/showpo...4&postcount=37
__________________
JD-Dev & Server-Admin
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 14:12.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.