Site blocking jdownloader user agent
This site **External links are only visible to Support Staff****External links are only visible to Support Staff** seems to block jdownloader with wpbettersecurity plugin
I've made a few tests and it seems that they don't block Googlebot. I've crawled the URLs but I still need jdownloader to go over the list of URLs such as these **External links are only visible to Support Staff****External links are only visible to Support Staff** in order to get the package/page title
Any way I can make jdownloader bypass this block?
Thank you
|