#1
|
|||
|
|||
request - please do add mywikifeet.com/models
request - please do add mywikifeet.com/models
(looks a little bit different like wikifeet.com) |
#2
|
||||
|
||||
Hi,
please provide example URLs. Looks like a website that you could easily add via LinkCrawler Rules... Do you have an account for this website or are you only interested in the free content? -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#3
|
|||
|
|||
**External links are only visible to Support Staff****External links are only visible to Support Staff**
with FREE set **External links are only visible to Support Staff****External links are only visible to Support Staff** I think free content makes only sense, paid content is unique sets only... |
#4
|
||||
|
||||
Seems to be a sister-site of "wikifeet.com".
Added simple crawler for: mywikifeet.com/sets/123456 Bitte auf das nächste CORE-Update warten! Please wait for the next CORE-Update! Wartest du auf einen angekündigten Bugfix oder ein neues Feature? Updates werden nicht immer sofort bereitgestellt! Bitte lies unser Update FAQ! | Please read our Update FAQ! --- Are you waiting for recently announced changes to get released? Updates to not necessarily get released immediately! Bitte lies unser Update FAQ! | Please read our Update FAQ! -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#5
|
|||
|
|||
can you please ADD model name from SETS to package folder?
|
#6
|
||||
|
||||
Done.
Wartest du auf einen angekündigten Bugfix oder ein neues Feature? Updates werden nicht immer sofort bereitgestellt! Bitte lies unser Update FAQ! | Please read our Update FAQ! --- Are you waiting for recently announced changes to get released? Updates to not necessarily get released immediately! Bitte lies unser Update FAQ! | Please read our Update FAQ! -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#7
|
|||
|
|||
can you please add some "separator" between model name and set name?
maybe " -- " (SPACE--SPACE) |
#8
|
||||
|
||||
A separator was already present ("_" -> underscore).
I've replaced it with your desired separator. Wartest du auf einen angekündigten Bugfix oder ein neues Feature? Updates werden nicht immer sofort bereitgestellt! Bitte lies unser Update FAQ! | Please read our Update FAQ! --- Are you waiting for recently announced changes to get released? Updates to not necessarily get released immediately! Bitte lies unser Update FAQ! | Please read our Update FAQ! -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#9
|
|||
|
|||
Quote:
thx a lot! any chance to add 'free' and 'paid' at package name? |
#10
|
||||
|
||||
Yes sure.
Please provide example links for both cases. -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#11
|
|||
|
|||
Quote:
here you are... PAID **External links are only visible to Support Staff****External links are only visible to Support Staff** FREE **External links are only visible to Support Staff****External links are only visible to Support Staff** (I dont know how to make out the difference for JD2 if it's FREE or PAID...) |
#12
|
||||
|
||||
Errorhandling für bezahlte Inhalte eingebaut.
In diesem Fall sollten gar keine (normalen) Ergebnisse erscheinen, da diese nur auf ein statisches Bild a la "bitta kaufen" verlinkt. Bitte auf das nächste CORE-Update warten! Please wait for the next CORE-Update! Wartest du auf einen angekündigten Bugfix oder ein neues Feature? Updates werden nicht immer sofort bereitgestellt! Bitte lies unser Update FAQ! | Please read our Update FAQ! --- Are you waiting for recently announced changes to get released? Updates to not necessarily get released immediately! Bitte lies unser Update FAQ! | Please read our Update FAQ! -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#13
|
|||
|
|||
perfect!
Quote:
|
#14
|
||||
|
||||
Oh sorry wrong language - seems like I've assumed that by your username.
May I ask what's the background of that? -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#15
|
|||
|
|||
Quote:
the background for having special separator? |
#16
|
||||
|
||||
No - the background of your german username.
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#17
|
|||
|
|||
Ich habe bzw. nutze einfach alles auf Englisch was Computer betrifft.
Und in einem Forum ist es meiner Meinung nach sinnvoller auf Englisch zu schreiben, dann hat 'jeder' was davon |
#18
|
||||
|
||||
:)
Da stimme ich zu. Grüße, psp
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#19
|
|||
|
|||
wikifeet plugin with little bit strange results i.e. folder naming with numbers...
wikifeet plugin with little bit strange results i.e. folder naming with numbers...
just run example link **External links are only visible to Support Staff****External links are only visible to Support Staff** with deep decrypt and you can see what I am talking about... (I talk about "default user" settings...) kind regards |
#20
|
||||
|
||||
@verheiratet1952: Thanks for the report, we will look at it on monday
__________________
JD-Dev & Server-Admin |
#21
|
||||
|
||||
@verheiratet1952
I was unable to find any issues. The packages with numbers are all of the single gallery thumbnail images that you will probably not want to download(?) They're auto assigned to single packages and in this case, the packages are named by the name of the single file they contain. You might want JD to group them into one "Various" package instead so your issue might be related to this report. You coiuld either folter them or maybe create a LinkCrawler rule that listens to "wikifeet.com/celebs..." URLs and only finds profile-URLs. This way you wouldn't have to filter anything in your linkgrabber afterwards.
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#22
|
||||
|
||||
Quote:
__________________
JD-Dev & Server-Admin |
#23
|
|||
|
|||
Quote:
thank you @jiaz and @pspzockerscene for getting back to this thread within just a few hours... please see https://board.jdownloader.org/showpo...75&postcount=2 (for crawling results there was nothing of all those thumbnails before) just for my understanding: -if there is a plugin, I was thinking that there does not have to be any additional linkcrawler or other fixes necessary? I just installed new jd folder for only testing plugin with results for better understanding with first 25 links ending **External links are only visible to Support Staff****External links are only visible to Support Staff** every page has 20 profiles, what should bring 500 folders with naming of female celeb when crawling without previous crwaling results - no updating... but it has pretty much folder with thumbnail numbering, what is absolutely useless, and it takes extremely long to get same results as before... I can send linkcollector.ZIP if you want... |
#24
|
|||
|
|||
I think I found some important thing
when running with old 46316 core it does not crawl 'those thumbnails' ... |
#25
|
||||
|
||||
Quote:
Quote:
That's what pspzocker explains here, https://board.jdownloader.org/showpo...75&postcount=2 The plugin no longer reacts on celeb links and you will have to create/use linkcrawler rules if you want to parse those links. Without linkcrawler rules, JDownloader will simply deepdecrypt the link and find/return everything it can find.
__________________
JD-Dev & Server-Admin Last edited by Jiaz; 05.09.2022 at 12:24. |
#26
|
||||
|
||||
Because the old plugin did not blacklist thumbs and just resulted in plugin errors and thus you can add those thumbs properly.
__________________
JD-Dev & Server-Admin |
#27
|
|||
|
|||
Quote:
pspzockerscene was writing at https://board.jdownloader.org/showpo...75&postcount=2 "--> Deepdecrypt of e.g. "/celebs?page=22" will work fine after the next update." what is the intention/reason not to react on celeb links anymore? and what is the idea to have those thumbs as default crawling results? I dont think that anyone needs those thumbs as default results... as you are writing a plugin collects an album or an entire gallery, so thumbs are not welcome I think !? edit just an example, when crawling for updating content, it collects at about 10k of new folders with at about 100k new images... but it also has another 320k new folders with more than 300k of new images related on those thumbnails... even if I will create some linkcrawler rule JD has to perform all those crawling work, what makes it taking much longer than necessary, and having much more resources for nearly no benefit... Last edited by verheiratet1952; 05.09.2022 at 17:37. |
#28
|
||||
|
||||
Quote:
I'll try to explain this again: - There was never a crawler for "/celebs" - Before the update, such "celebs" links unintentionally also went into our existing crawler which then lead to a failure as our crawler is only made to crawl gallery images and no other URLs - Now you got the option to let deepDecrypt do the job and that will work fine (single pages) Quote:
It is not a bug or anything. Then as explained, create a LinkCrawler rule that only returns the results you want...
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#29
|
|||
|
|||
Quote:
even if I will create some linkcrawler rule JD has to perform all those crawling work, what makes it taking much longer than necessary, and having much more resources for nearly no benefit... by the way: I can simply delete all those thumbnail folders, but I dont see the reason for having them, not only for me, for anyone that want to crawl that website to get its images... |
#30
|
||||
|
||||
Quote:
Of course the single galleries still have to be crawled one by one but you can simply ignore/pre-filter all the stuff you don't want and make JD only find galleries when adding "/celebs" links. Quote:
Here is a LinkCrawler Rule for those "/celebs..." links: Code:
[ { "enabled": true, "updateCookies": true, "logging": false, "maxDecryptDepth": 1, "name": "example rule for wikifeet.com/celebs...", "pattern": "**External links are only visible to Support Staff**, "rule": "DEEPDECRYPT", "packageNamePattern": null, "deepPattern": "class=boxcont><a href=\"(/[^\"]+)\"" } ] pastebin.com/raw/wz3L5JwJ
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#31
|
||||
|
||||
Quote:
__________________
JD-Dev & Server-Admin |
#32
|
||||
|
||||
Plugins do support specific tasks. In this case the plugin ONLY supports albums and also was reporting support for thumb/direct images as well. This was a mistake and fixed. Plugins should not report more URLs supported than they actual do. So this has been fixed and now thumbs can be picked up again by generic http plugin which is fine and correct way. Your /celeb URL is NOT supported by any plugin and thus nothing will happen if you just copy it into clipboard. When you copy a link to clipboard and JDownloader does not react, then no plugin does support this kind of link. When you single add via dialog/drag&drop/paste, then you tell JDownloader it is okay to deepDecrypt the link and it will look for everything that can be downloaded/supported by JDownloader. That way JDownloader will find the thumbnails and the album links and other stuff like js/css/images...files. With help of a linkcrawler rule you now teach/tell JDownloader that you want to support /celeb links BUT only should parse those links that you are intersted in.
__________________
JD-Dev & Server-Admin Last edited by Jiaz; 05.09.2022 at 17:55. |
#33
|
||||
|
||||
Quote:
There is no plugin/no support for this url so generic deepDecrypt will load/examine this website. Just search/return everything that can be found in that html. Filtering/Limiting is up to you via Linkcrawler Rules/Linkgrabber Filters.
__________________
JD-Dev & Server-Admin |
Thread Tools | |
Display Modes | |
|
|