JDownloader Community - Appwork GmbH
 

Go Back   JDownloader Community - Appwork GmbH > English Support > Suggestions & Requests
Reply
 
Thread Tools Display Modes
  #1  
Old 30.05.2023, 19:59
bre_wok bre_wok is offline
I will play nice!
 
Join Date: May 2023
Posts: 5
Default xhamster.com crawl rules for "/pornstars"?

i want to download videos based on creator or pornstar which is not in the plugin. I'm confused about how to give rules to detect other pages. what's in the "formPattern"? because if you put it in "pattern" when entering url rules it won't be detected (I have tried it in linkfilter) or there is an error in my regex. please need feedback.

Quote:
[
{
"deepPattern" : "href=(".*videos/.*")",
"formPattern" : "href=(".*/creators/[^"]+/\\d+-")",
"maxDecryptDepth" : 1,
"name" : "XH/C",
"pattern" : "https?://xhamster2\\.com/.*creators\\/[^"]+",
"rule" : "DEEPDECRYPT",
"enabled" : true,
"logging" : false
},
{
"deepPattern" : "href=(".*videos/.*")",
"formPattern" : "href=(".*/pornstars/[^"]+/\\d+-")",
"maxDecryptDepth" : 1,
"name" : "XH/P",
"pattern" : "https?://xhamster2\\.com/.*pornstars\\/[^"]+",
"rule" : "DEEPDECRYPT",
"enabled" : true,
"logging" : false
}
]
Reply With Quote
  #2  
Old 31.05.2023, 11:08
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,121
Default

Quote:
Originally Posted by bre_wok View Post
i want to download videos based on creator or pornstar which is not in the plugin
Why don't you just ask us to add support for it?
In this case, as you've already noticed, a plugin already exists so we are usually willing to extend it.

Quote:
Originally Posted by bre_wok View Post
I'm confused about how to give rules to detect other pages.
LinkCrawler rules help articles overview:
https://support.jdownloader.org/Know...kcrawler-rules
Basic explanation:
https://support.jdownloader.org/Know...awler-rules/22

Quote:
Originally Posted by bre_wok View Post
what's in the "formPattern"?
That is only needed for rules of type SUBMITFORM, see:
https://support.jdownloader.org/Know...awler-rules/22
and:
https://support.jdownloader.org/Know...-submitform/22

--> It shouldn't be needed in this case.

Please provide example links that are supposed to match your given pattern.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #3  
Old 31.05.2023, 14:03
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,121
Default

I was able to locate the kind of URLs you wanted JDownloader to be able to crawl and I've added support for both of them.

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #4  
Old 02.06.2023, 09:22
bre_wok bre_wok is offline
I will play nice!
 
Join Date: May 2023
Posts: 5
Default

[QUOTE]
Quote:
Originally Posted by pspzockerscene View Post
Why don't you just ask us to add support for it?
In this case, as you've already noticed, a plugin already exists so we are usually willing to extend it.
thanks for the feedback, will it be listed in the plugin update?

Quote:
Please provide example links that are supposed to match your given pattern.
example links:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

actually for creators/pornstars who have few videos or few pages I can still trick it with an input analysis like this:
Quote:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
If I do without crawl rules that will also fetch related content such as other creators.
Reply With Quote
  #5  
Old 02.06.2023, 11:08
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,121
Default

Quote:
Originally Posted by bre_wok View Post
will it be listed in the plugin update?
As said, yes.
Please read the Update FAQ I linked.

Quote:
Originally Posted by bre_wok View Post
example links:
h...xhamster2.com/creators/...
Implemented!

Quote:
Originally Posted by bre_wok View Post
I can still trick it with an input analysis like this:
You can "trick an input analysis" for anything unsupported as it will usually go through the deep-parser which will simply parse- and return all http URLs on a specific page.
Sometimes the following method may be easier:
https://support.jdownloader.org/Know...orted-websites

Regarding all code changes/added features/bugfixes mentioned in this post, the following information applies:
Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #6  
Old 02.06.2023, 16:15
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,121
Default

CORE-Updates have been released!
All announced bugfixes and features are live!
Please update your JDownloader and report any issues you find asap.
If this thread gets marked as "[Solved]" by our forum staff you can still post in it and we will read- and reply to it!

CORE-Updates wurden released!
Alle angekündigten Bugfixes/Features sind nun verfügbar!
Bitte JDownloader updaten und eventuelle Bugs schnellstmöglich an uns melden.
Falls dieser Thread vom Team als "[Erledigt]" markiert wird, kannst du weiterhin darin antworten und wir lesen/beantworten auch solche Threads!

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #7  
Old 02.06.2023, 18:31
bre_wok bre_wok is offline
I will play nice!
 
Join Date: May 2023
Posts: 5
Default

[QUOTE]
Quote:
Originally Posted by pspzockerscene View Post
As said, yes.
Please read the Update FAQ I linked.
yes, I guess I should create a new thread or another.

[QUOTE]
Quote:
Originally Posted by pspzockerscene View Post
Implemented!
I have tested and it works as I intended

Quote:
You can "trick an input analysis" for anything unsupported as it will usually go through the deep-parser which will simply parse- and return all http URLs on a specific page.
Sometimes the following method may be easier:
**External links are only visible to Support Staff**...
Yes, I've tried that. But I'm using the packagizer rules so it doesn't stick to the package name anymore, for example entering several people/creators.
actually I am new to this "deep-parser" does it just do deepanalyse or not? yeah it's already solved anyway
Reply With Quote
  #8  
Old 02.06.2023, 21:38
bre_wok bre_wok is offline
I will play nice!
 
Join Date: May 2023
Posts: 5
Default

[QUOTE]
Quote:
Originally Posted by pspzockerscene View Post
CORE-Updates have been released!
All announced bugfixes and features are live!
Please update your JDownloader and report any issues you find asap.
If this thread gets marked as "[Solved]" by our forum staff you can still post in it and we will read- and reply to it!
oh yeah I just noticed. can you fix it for another orientation too? as you're working on it. I have tested but the plugin doesn't detect it.

here is an example link:
**External links are only visible to Support Staff**...
**External links are only visible to Support Staff**...
Reply With Quote
  #9  
Old 06.06.2023, 00:03
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,121
Default

Due to a rare forum bug, those links are lost.
Please post them again or put them into a .txt document and attach that to your next post.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #10  
Old 09.06.2023, 01:10
bre_wok bre_wok is offline
I will play nice!
 
Join Date: May 2023
Posts: 5
Default

Quote:
Originally Posted by pspzockerscene View Post
Due to a rare forum bug, those links are lost.
Please post them again or put them into a .txt document and attach that to your next post.
sorry for taking so long
Attached Files
File Type: txt Eg urls.txt (344 Bytes, 1 views)
Reply With Quote
  #11  
Old 18.07.2023, 15:50
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,121
Default

Added support for URLs matching that pattern.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
Reply


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 20:16.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.