JDownloader Community - Appwork GmbH
 

Notices

Reply
 
Thread Tools Display Modes
  #1  
Old 02.04.2020, 01:16
TimWill TimWill is offline
Vacuum Cleaner
 
Join Date: Apr 2016
Posts: 15
Default Site blocking jdownloader user agent

This site **External links are only visible to Support Staff****External links are only visible to Support Staff** seems to block jdownloader with wpbettersecurity plugin

I've made a few tests and it seems that they don't block Googlebot. I've crawled the URLs but I still need jdownloader to go over the list of URLs such as these **External links are only visible to Support Staff****External links are only visible to Support Staff** in order to get the package/page title

Any way I can make jdownloader bypass this block?

Thank you
Reply With Quote
  #2  
Old 02.04.2020, 04:43
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,611
Default

Currently there is no way to change crawlers default user-agent within the program. some people change it via wrapping requests via proxy and the proxy is what changes it.

In in the mean time maybe better solution for you is to not send requests in a manner which trigger there script.

Alternatively if you create a decrypter plugin you can set a customised user-agent string

raztoki
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #3  
Old 02.04.2020, 11:36
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

It may be possible in the future through link crawler rules cookies as cookie Strings can then contain a User-Agent too but there is no ETA for this feature.

-psp-
EDIT

By the way your site is working fine here with our default User-Agent!
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #4  
Old 02.04.2020, 12:00
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,611
Default

His ip/cookie session will be more likely blocked over the user agent.
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #5  
Old 02.04.2020, 19:20
TimWill TimWill is offline
Vacuum Cleaner
 
Join Date: Apr 2016
Posts: 15
Default

Quote:
Originally Posted by raztoki View Post
His ip/cookie session will be more likely blocked over the user agent.
Yes did more tests changing IP and still blocked, that's right
Reply With Quote
  #6  
Old 02.04.2020, 19:29
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Quote:
Originally Posted by TimWill View Post
Yes did more tests changing IP and still blocked, that's right
Not here.

How many URLs can you add before you get blocked?

It could also be a general limit which has nothing to do with the user-agent.
This is more likely the case if you ask me.

Anyways ... this is not really any kind of JDownloader bug ...

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #7  
Old 02.04.2020, 12:09
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Yeah did not test with many URLs ...

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 10:34.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.