|
#1
|
|||
|
|||
Site blocking jdownloader user agent
This site **External links are only visible to Support Staff****External links are only visible to Support Staff** seems to block jdownloader with wpbettersecurity plugin
I've made a few tests and it seems that they don't block Googlebot. I've crawled the URLs but I still need jdownloader to go over the list of URLs such as these **External links are only visible to Support Staff****External links are only visible to Support Staff** in order to get the package/page title Any way I can make jdownloader bypass this block? Thank you |
#2
|
||||
|
||||
Currently there is no way to change crawlers default user-agent within the program. some people change it via wrapping requests via proxy and the proxy is what changes it.
In in the mean time maybe better solution for you is to not send requests in a manner which trigger there script. Alternatively if you create a decrypter plugin you can set a customised user-agent string raztoki
__________________
raztoki @ jDownloader reporter/developer http://svn.jdownloader.org/users/170 Don't fight the system, use it to your advantage. :] |
#3
|
||||
|
||||
It may be possible in the future through link crawler rules cookies as cookie Strings can then contain a User-Agent too but there is no ETA for this feature.
-psp- EDIT By the way your site is working fine here with our default User-Agent!
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#4
|
||||
|
||||
His ip/cookie session will be more likely blocked over the user agent.
__________________
raztoki @ jDownloader reporter/developer http://svn.jdownloader.org/users/170 Don't fight the system, use it to your advantage. :] |
#5
|
|||
|
|||
Yes did more tests changing IP and still blocked, that's right
|
#6
|
||||
|
||||
Not here.
How many URLs can you add before you get blocked? It could also be a general limit which has nothing to do with the user-agent. This is more likely the case if you ask me. Anyways ... this is not really any kind of JDownloader bug ... -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#7
|
||||
|
||||
Yeah did not test with many URLs ...
-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
Thread Tools | |
Display Modes | |
|
|