#1
|
|||
|
|||
[LinkCrawler Rule] tits-guru.com website
plugin request for **External links are only visible to Support Staff****External links are only visible to Support Staff**
I was trying with linkcrawler rule { "packageNamePattern" : "<title>(.+?)</title>", "maxDecryptDepth" : 0, "rewriteReplaceWith" : null, "passwordPattern" : null, "updateCookies" : true, "formPattern" : null, "deepPattern" : null, "cookies" : [], "pattern" : "**External links are only visible to Support Staff**, "name" : null, "enabled" : true, "logging" : false, "rule" : "DEEPDECRYPT" } but it does not crawl all images... small thumbnails can be removed using linkfilter, but it does not get all images, most images are hidden because of infinite scroll and pagination... ?page=2 ?page=3 ?page=4 ... ... ... example links **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** |
#2
|
||||
|
||||
I'm sorry but websites with dynamically reloading elements/"infinite scroll" are not easily possible via LinkCrawler Rules.
You can manually collect/create the URLs containing "?page=..." and then add them to JD. You can also text editors like "Notepad++" and/or browser addons such as "Link Gopher" to help with that. -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#3
|
|||
|
|||
Quote:
you have any idea how to create full link list for every link with ?page=2 ?page=3 ?page=4 ... ?page=200 it more than 30'000 links with **External links are only visible to Support Staff****External links are only visible to Support Staff** bulk mode |
#4
|
||||
|
||||
Quote:
Use "Notepad++" or similar powerful text editors, work yourself into it and then you should be able to do generate those 2XX URLs easily. Such a thing does not exist for our LinkCrawler rules. -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
Thread Tools | |
Display Modes | |
|
|