JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 04.10.2021, 17:47
Thepledge Thepledge is offline
Modem User
 
Join Date: Nov 2016
Posts: 3
Default Help with mrdeepfakes.com crawler rule

I have written a linkcrawler rule for mrdeepfakes.com with the following format.

"enabled" : true,
"cookies" : null,
"updateCookies" : true,
"logging" : false,
"maxDecryptDepth" : 0,
"id" : 1502488963785,
"name" : null,
"pattern" : ".+mrdeepfakes.com/celebrities/[a-z]+.+",
"rule" : "DEEPDECRYPT",
"packageNamePattern" : null,
"passwordPattern" : null,
"formPattern" : null,
"deepPattern" : "(.+mrdeepfakes.com/video/[0-9]+.+",
"rewriteReplaceWith" : null

Unfortunately, regardless of how I set the maxdecryptdepth, it can only find the first 24 videos of the first page.

Can anyone help me to tweak the script to get all videos of the currently chosen celebrity?
Reply With Quote
  #2  
Old 04.10.2021, 17:59
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 74,972
Default

@ThePledge: The rule doesn't match on the *next pages* link and thus can only process the links on the html you enter
As the *next page* loading is done via javascript, I think the best would be to write a script for Eventscripter that does this for you. Listen on the job and then load the html, find the links and process to next page.
See https://board.jdownloader.org/showthread.php?t=70525
You can also maybe ask mgpai for help. He's the scriptmaster of the JD verse
__________________
JD-Dev & Server-Admin
Reply With Quote
  #3  
Old 05.10.2021, 02:09
Thepledge Thepledge is offline
Modem User
 
Join Date: Nov 2016
Posts: 3
Default

Thanks, thats a new one to me, but I'll see what I can learn
Reply With Quote
  #4  
Old 05.10.2021, 10:54
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 74,972
Default

@ThePledge: just a very basic *what to do* roadmap
A script for eventscripter that listens to your wished url, eg /celebrity/CY
the script then will load the website via browser instance and then find the videos AND next page
and repeats until last page is found. Sort of plugin just written for Eventscripter.
I'm sure mgpai already did similiar things and he can help you with it.
Please report back in case you're stuck
__________________
JD-Dev & Server-Admin
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 10:25.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2022, Jelsoft Enterprises Ltd.