#1
|
|||
|
|||
wikifeet.com how to DEEPCRAWL for profile links?
how to DEEPCRAWL for profile links?
example URL **External links are only visible to Support Staff****External links are only visible to Support Staff** profile links is all links at **External links are only visible to Support Staff****External links are only visible to Support Staff** 10 on each page (by the way: profile links like **External links are only visible to Support Staff****External links are only visible to Support Staff** do work perfect...) |
#2
|
||||
|
||||
Fixed existing crawler picking up "/celebs" URLs as profileURLs and thus failing.
--> Deepdecrypt of e.g. "/celebs?page=22" will work fine after the next update. If you want JD to auto DEEPDECRYPT such URLs, you can make a simple LinkCrawler Rule.
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#3
|
|||
|
|||
Quote:
creating a linkcrawler rule does ONLY work if there is NO existing plugin for that website? |
#4
|
||||
|
||||
Quote:
To be more precise: It works as long as there is no plugin that handles the URLs you want to crawl. In this case, our plugin accepts URLs of single profiles but ignores "/celebs..." URLs -> Yes you could create a LinkCrawler rule for those. -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#5
|
|||
|
|||
Quote:
you say "...will work fine after the next update" ? |
#6
|
||||
|
||||
The mentioned update has already been released yesterday.
Here is an example LinkCrawler Rule for "wikifeet.com/celebs?page=XXX": Code:
[ { "enabled" : true, "updateCookies" : true, "logging" : false, "maxDecryptDepth" : 1, "name" : "wikifeet.com/celebs example rule", "pattern" : "**External links are only visible to Support Staff**, "rule" : "DEEPDECRYPT", "deepPattern" : "class=boxcont><a href=\"(/[^\"]+)\"" } ] pastebin.com/tZ2BgVaD See this support-article on how to add LinkCrawler Rules to JD. Please keep in mind that LinkCrawler Rules are designed to be made by users. We'll give you some examples and help out but if you need more you'll have to learn how to create them yourself. -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
Thread Tools | |
Display Modes | |
|
|