#1
|
|||
|
|||
Pornhub.com and pornhubpremium.com profile crawling function put results in 1 package
Dear team happy december to all and wish you'll a great healthy weeks ahead. Pornhub.com and pornhubpremium.com profile crawling function currently places all the contents in one single package no matter how many profiles we crawl which makes it hard to keep it organize.
Please make a default function to the crawl plugin to put each profile contents in its own package with profile name on it like how xhamster.com crawl works. Thankyou |
#2
|
||||
|
||||
@jeonje: Please provide example links and how do you add the links? have you setup any custom packagizer rule that changes package name?
__________________
JD-Dev & Server-Admin |
#3
|
||||
|
||||
Hi,
by default, for pornhub items one package per video is created. I don't know what you changed but crawled videos of a pornhub channel should not go into one package. However, if you want to have one package with all videos of a particular channel, here is how that will work: https://board.jdownloader.org/showthread.php?t=88215 -> See our Packagizer feature: https://support.jdownloader.org/know...paketverwalter
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download Last edited by pspzockerscene; 17.12.2024 at 11:55. Reason: Updated Packagizer help article hyperlink |
#4
|
|||
|
|||
Sir, sorry if I wasn't able to explain earlier, I have uncheck the create sub folder for each files option so current if I copy 2 pornhub channels it crawls and grabs/add links
from both the channels into one single "various folder package" many of the users wants is for the link grabber to automatically create 2 separate folder with channel name and put the videos where they belong. This way even if we copy 10 different pornhub profile the linkgrabber should put the videos into their own channel named folder. xhamster.com plugin does it by default, can't pornhub plugin also package the file like that. Thankyou |
#5
|
||||
|
||||
Please see
Quote:
__________________
JD-Dev & Server-Admin Last edited by pspzockerscene; 17.12.2024 at 11:55. Reason: Updated Packagizer help article hyperlink |
#6
|
|||
|
|||
sir, I did read all the pages that you mentioned and further searched the whole forum and YouTube videos too and still I couldn't understand anything it is too confusing to me as I am not good at technicals and all. A frustrated user I am now because I tried and still couldn't understand anything, if possible can you please upload the packagezier rules file here so I can import them in Packagizer tab in settings.
I only need jdownlaoder to put all videos automatically to its own model named package folder. Example : if I copy both model profile **External links are only visible to Support Staff****External links are only visible to Support Staff**, **External links are only visible to Support Staff****External links are only visible to Support Staff** I want the app to create two package folder named after the model and put the videos in it where they belong. Thankyou please help me with this, I have been trying to do this for months now and still I have not understood the process, really frustrated. |
#7
|
||||
|
||||
Here is the solution:
https://board.jdownloader.org/showthread.php?t=83664 Quoting that thread: Quote:
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#8
|
|||
|
|||
sir I still don't understand the process because when I click on package and add new package rules there are more then 20 different options pops up what do I enter in each.
please check the 2 photo **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** Last edited by pspzockerscene; 17.12.2024 at 19:35. Reason: Made hyperlinks visible (to moderators) |
#9
|
||||
|
||||
And?
Just re-read my last post.
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#10
|
|||
|
|||
thank you thank you for helping. So foolish of me to not get it. all I entered was
1. Download URL contains ( pornhub ) 2. set Package name ( <jd:prop:username>) just 2 lines and it worked. ALSO is there a way to re organise already downloaded videos from pornhub.com where multiple models videos are all downloaded in one various package folder instead of their own model name package. Last edited by jeonje; 17.12.2024 at 19:36. Reason: correction |
#11
|
||||
|
||||
Quote:
- How do you recognize "multiple models" items? - Please provide example links Generic response: Yes such an automation is possible using Packagizer rules, see: https://support.jdownloader.org/know...paketverwalter
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#12
|
|||
|
|||
this is only for pornhub.com
please check the image attached of the links of the pornhub videos which are on one single package and not organised in its own model profile package. **External links are only visible to Support Staff****External links are only visible to Support Staff** how to auto re organise videos in their own model name package where they belong. Last edited by pspzockerscene; 17.12.2024 at 20:13. Reason: Made image hyperlink visible to moderators |
#13
|
||||
|
||||
You can stop trying to embed ibb.co images here as that image host is not whitelisted by us.
Just post the hyperlinks (I've edited your post). Quote:
Quote:
Please rephrase.
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#14
|
||||
|
||||
Quote:
@jeonje: I would recommend to use a script for Eventscripter to move/merge those links into wished destination. Please check https://board.jdownloader.org/forumdisplay.php?f=52 and ask for help there. At the moment there is no way to re-apply those rules,
__________________
JD-Dev & Server-Admin |
#15
|
|||
|
|||
Please post the links as text as I'am not going to manually type them from your image...
= here I see no option to directly upload file or image only attach link url is there of the file, is there a proper way or site to upload the file like image and add in the conversation. Please post the links as text as I'am not going to manually type them from your image... = I have attached image link as text if I did something wrong can you please guide me how to do it from next time. thank you |
#16
|
||||
|
||||
Quote:
You can: 1. Just post the links as plain-text like "http...". Like this: Code:
https://board.jdownloader.org/showthread.php?t=96770 https://board.jdownloader.org/showthread.php?t=96770 https://board.jdownloader.org/showthread.php?t=96770 https://board.jdownloader.org/showthread.php?t=96770 2. Put them into a .txt file and attach it to your next post. Quote:
Post the links as text. Either way, it looks like Jiaz understood what you are trying to do so he already pointed out the right direction to do what you are trying to do in his reply #14.
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#17
|
|||
|
|||
thank you I will do that.
1. pornhub videos description sometimes contains all kinds of emoji, how to remove emoji during file grab automatically so user don't have to remove emoji from each file manually. |
#18
|
||||
|
||||
@jeonje: You can use recently new introduced new feature Settings->Advanced Settings->GeneralSettings.filenamereplacemap and then you can specify regex to replace chars.
for example: stackoverflow.com/questions/64509631/is-there-a-regex-to-match-all-unicode-emojis
__________________
JD-Dev & Server-Admin |
#19
|
|||
|
|||
editing advanced setting can mess up the app as I got a warning, isn't there a alternative way so it can be applied to only pornhub.com files. like package rules.
|
#20
|
||||
|
||||
Just create a backup before fiddling around in advanced settings.
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#21
|
||||
|
||||
@jeonje: Alternative you can create/use https://support.jdownloader.org/de/k...event-scripter and a script that does the replacement
check/ask here for help https://board.jdownloader.org/forumdisplay.php?f=52
__________________
JD-Dev & Server-Admin |
#22
|
|||
|
|||
You can use recently new introduced new feature Settings->Advanced Settings->GeneralSettings.filenamereplacemap and then you can specify regex to replace characters(all kinds of emojis)
= I replaced the whole value with many examples from below. Non of them worked it did nothing to the file names. example 1. { ":" : ";", "\\|" : "¦", "<" : "[", ">" : "]", "/" : "\u2044", "" : "∖", "\\*" : "#", "\\?" : "¿", """ : "'", "regex" : "([\\uD83C\\uD83D\\uD83E][\\uDC00-\\uDFFF]|[\\u2000-\\u3300]|[\\u00A9\\u00AE])", "replacewith" : "" } example 2 { ":" : ";", "\\|" : "¦", "<" : "[", ">" : "]", "/" : "\u2044", "\" : "∖", "\\*" : "#", "\\?" : "¿", """ : "'", "regex" : "(\\u00a9|\\u00ae|[\\u2000-\\u3300]|\\ud83c[\\ud000-\\udfff]|\\ud83d[\\ud000-\\udfff]|\\ud83e[\\ud000-\\udfff])", "replacewith" : "" } NOTE: or should I replace the whole thing with this : /(\u00a9|\u00ae|[\u2000-\u3300]|\ud83c[\ud000-\udfff]|\ud83d[\ud000-\udfff]|\ud83e[\ud000-\udfff])/g Last edited by jeonje; 21.12.2024 at 09:59. Reason: information update |
#23
|
||||
|
||||
@jeonje: Syntax is json and it's
{"regex":"replacement"} remove the "regex" and "replacewith" you can verify the syntax, for example with jsonformatter.org
__________________
JD-Dev & Server-Admin |
#24
|
|||
|
|||
Thankyou, please check 2 different menthol and please guide if am wrong.
method 1. using advanced setting.>Advanced Settings->GeneralSettings.filenamereplacemap { ":" : ";", "\\|" : "¦", "<" : "[", ">" : "]", "/" : "\u2044", "\\" : "∖", "\\*" : "#", "\\?" : "¿", """ : "'", "(?:[\uD83C-\uDBFF\uDC00-\uDFFF]|[\u2600-\u27BF])" : "" } 1. will this feature affect app performance like high cpu usage, more ram used, slow download process as for example it scans all 1000s files just to block 2 file containing emoji. (in such case is eventscripter better option) 2. what's the impact on 1000s of files that has no emoji on it will all these files get scanned too to find emoji. If yes then its unnecessary process. method 2. Settings > Extensions > EventScripter > install EventScripter > EventScripter > Create a New Script > Name your script > Trigger : A New Link has been added > copy paste the below script exactly as shown below in script page. // EventScripter Script to remove emojis from video file names function removeEmojisFromVideoFileNames() { // Regular expression to match emojis in filenames var emojiRegex = /[\uD83C-\uDBFF\uDC00-\uDFFF\u2600-\u26FF\u2700-\u27BF\u2000-\u2BFF]/g; // Define the video file extensions you want to check (including .webm) var videoExtensions = /\.(mp4|avi|mkv|mov|flv|wmv|webm|mpg)$/i; // Get the links from the LinkGrabber var links = linkgrabber.getLinks(); // Loop through all added links for (var i = 0; i < links.length; i++) { var link = links[i]; // Loop through each file in the link for (var j = 0; j < link.getDownloadLinks().length; j++) { var file = link.getDownloadLinks()[j]; // Get the filename var filename = file.getName(); // Only process video files (based on defined extensions) if (filename.match(videoExtensions)) { // Check if the filename contains emojis if (emojiRegex.test(filename)) { var newFilename = filename.replace(emojiRegex, ""); // Remove emojis file.setName(newFilename); // Set the new filename } } } } } // Trigger the script when links are added removeEmojisFromVideoFileNames(); dear team it took lot of time nd hardworking from my side. Please Check in detail and guide me if am wrong. Thanks Last edited by jeonje; 22.12.2024 at 08:55. |
#25
|
|||
|
|||
I tried many scripts like these :
// EventScripter Script to remove emojis from video file names function removeEmojisFromVideoFileNames() { // Regular expression to match emojis in filenames var emojiRegex = /[\uD83C-\uDBFF\uDC00-\uDFFF\u2600-\u26FF\u2700-\u27BF\u2000-\u2BFF]/g; // Define the video file extensions you want to check (including .webm) var videoExtensions = /\.(mp4|avi|mkv|mov|flv|wmv|webm|mpg)$/i; // Get the links from LinkGrabberController (using the appropriate API) var links = LinkGrabberController.getInstance().getLinkGrabber().getLinks(); // Loop through all added links for (var i = 0; i < links.length; i++) { var link = links[i]; // Loop through each file in the link for (var j = 0; j < link.getDownloadLinks().length; j++) { var file = link.getDownloadLinks()[j]; // Get the filename var filename = file.getName(); // Only process video files (based on defined extensions) if (filename.match(videoExtensions)) { // Check if the filename contains emojis if (emojiRegex.test(filename)) { var newFilename = filename.replace(emojiRegex, ""); // Remove emojis file.setName(newFilename); // Set the new filename } } } } } // Trigger the script when links are added removeEmojisFromVideoFileNames(); none worked when I tried to test by tapping on run script in script page it always gave errors. Please team can you please write a script that I can enter I have invested 2 days finding the solution. Please I am frustrated at this moment. I tried everything. |
#26
|
||||
|
||||
Quote:
2.) no impact! these rules are only applied during link crawling/adding. links in list will only be affected when renaming the file, depends on plugin if yes/no.
__________________
JD-Dev & Server-Admin |
#27
|
||||
|
||||
Where are those scripts from? they contains errors
Quote:
Quote:
__________________
JD-Dev & Server-Admin |
#28
|
|||
|
|||
yes chatgpt. So far all the patterns and scripts and codes I have generated using chatgpt has been all with error looks like chatgpt or any other is of no good as of today. Maybe in future it will be great but right now these ai tools are dumb and makes mistakes everywhere.
so you recommend using script so please share what script should use to remove all emoji from files. |
#29
|
|||
|
|||
You mean I should only use this Method 1.
method 1. using advanced setting.>Advanced Settings->GeneralSettings.filenamereplacemap { ":" : ";", "\\|" : "¦", "<" : "[", ">" : "]", "/" : "\u2044", "\" : "∖", "\\*" : "#", "\\?" : "¿", """ : "'", "(?:[\uD83C-\uDBFF\uDC00-\uDFFF]|[\u2600-\u27BF])" : "" } During all future links grabbed by the app if the files contains emoji it will remove it and the removed version of file will appear in Linkgrabberlist always ? is it correct ? |
#30
|
|||
|
|||
Yes.
|
#31
|
|||
|
|||
it worked thank you.
1. how do I block crawl link grabber from grabbing or crawling sites called erome.com. I want jdownlaoder to not grab/crawl any file or link from erome.com |
#32
|
|||
|
|||
Create a linkgrabber filter rule:
Code:
settings > linkgrabber filter > filter > add |
#33
|
|||
|
|||
I tried and didn't worked.
Linkgrabber Filter > added new rule >Rule Name=erome.com blocked linkgrabber Hoster URL contains erome.com and Source URL contains erome.com downloadurl contains erome.com sourceurl contains erome.com |
#34
|
|||
|
|||
Try with only one of them enabled. Preferably 'sourceurl'.
|
#35
|
||||
|
||||
@mgpai: Thanks for helping with correct/easy solution
__________________
JD-Dev & Server-Admin |
Thread Tools | |
Display Modes | |
|
|