JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 16.09.2020, 18:13
gollum007 gollum007 is offline
Modem User
 
Join Date: Sep 2020
Posts: 2
Default ImageFap.com: Rate Limiting

ImageFap have introduced a request rate limiter. At present I believe the limits to be the following:
Quote:
100 requests per 1 min
200 requests per 5 min
1000 requests per 1 hour
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Is there any chance of the plugin being updated to try and respect these better?

At the minute, if you trigger a download on anything above ~50 images it'll lock you out for an hour.
Reply With Quote
  #2  
Old 16.09.2020, 18:20
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 54,918
Default

Hi,

please post example URLs and a log.
Yes we can try to obey these limits but ultimately JD will reach the limit and then have to wait until it's over (well or you have to do a reconnect to get a new IP).

Please post your log-ID here | bitte poste deine Log-ID hier.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #3  
Old 16.09.2020, 18:36
gollum007 gollum007 is offline
Modem User
 
Join Date: Sep 2020
Posts: 2
Default

I can't actually trigger it at the minute (headbash....)

I *believe* this session from this morning has it in the logs:
Code:
16.09.20 10.28.30 <--> 16.09.20 10.28.30 jdlog://8186225302851/
I suspect they're probably still messing with it, will post again if I get a decent trigger / log.
Reply With Quote
  #4  
Old 16.09.2020, 23:20
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 54,918
Default

Hm I was unable to trigger it.

Next time please post a debug log.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #5  
Old 19.09.2020, 19:06
aaferque aaferque is offline
Vacuum Cleaner
 
Join Date: Jul 2017
Posts: 19
Default Problem with Imagefap galleries

Greetings! I can't download galleries from imagefap. This problem exists for a week. JD tries to pick gallery up, but instead of it adds line for example "gallery php gid=8910305&view=2" in the board!
Please help me out. Best regards!
Spoiler:
Attached Images
File Type: png 20200919-190721.png (90.6 KB, 1 views)

Last edited by aaferque; 19.09.2020 at 19:15.
Reply With Quote
  #6  
Old 20.09.2020, 14:35
hullabaloo hullabaloo is offline
Junior Loader
 
Join Date: Dec 2016
Posts: 13
Default

I can confirm the issue.

Sample gallery:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Debuglog
20.09.20 13.27.26 <--> 20.09.20 13.32.30 jdlog://3787225302851/

thanks for fixing
Reply With Quote
  #7  
Old 21.09.2020, 16:38
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 54,918
Default

Merged imagefap threads.

@hullabaloo
I've tried to add support for "rate limit reached".
JD will wait 5 minutes in this case.
Alternatively you could do a reconnect to continue right away with a new IP.

@aaferque
I was unable to reproduce your issue.
Please post example URLs and a log.

Please post your log-ID here | bitte poste deine Log-ID hier.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #8  
Old 21.09.2020, 23:53
aaferque aaferque is offline
Vacuum Cleaner
 
Join Date: Jul 2017
Posts: 19
Default

Quote:
Originally Posted by pspzockerscene
Please post example URLs and a log.
For example:

Spoiler:
**External links are only visible to Support Staff****External links are only visible to Support Staff**


Gallery:
**External links are only visible to Support Staff****External links are only visible to Support Staff**


21.09.20 23.45.21 <--> 21.09.20 23.51.17 jdlog://0928225302851/

https://drive.google.com/file/d/1-dV...ew?usp=sharing

Last edited by aaferque; 22.09.2020 at 00:06.
Reply With Quote
  #9  
Old 22.09.2020, 14:54
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 54,918
Default

I've improved the rate limit handling with the next update.

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #10  
Old 24.09.2020, 02:56
aaferque aaferque is offline
Vacuum Cleaner
 
Join Date: Jul 2017
Posts: 19
Default

Still there's an error: Error 429 rate limit reached (imagefap.com)
Other hosts work well.
Reply With Quote
  #11  
Old 24.09.2020, 12:59
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 54,918
Default

Quote:
Originally Posted by aaferque View Post
Still there's an error: Error 429 rate limit reached (imagefap.com)
... and it will happen again because of this:
imagefaq.cc/forum/viewtopic.php?f=4&t=17675&sid=0ed66fda947338862f2cb3d32622e030

It might also happen in your browser (for imagefap) once that limit has been reached depending on how they're handling this.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist

Last edited by pspzockerscene; 24.09.2020 at 13:14.
Reply With Quote
  #12  
Old 24.09.2020, 15:50
aaferque aaferque is offline
Vacuum Cleaner
 
Join Date: Jul 2017
Posts: 19
Default

Quote:
... and it will happen again because of this:
imagefaq.cc/forum/viewtopic.php?f=4&t=17675&sid=0ed66fda947338862f2cb3d32622e030

It might also happen in your browser (for imagefap) once that limit has been reached depending on how they're handling this.
Thanks for answering. In other words, the problem is on their side, not JD, as I see....
Reply With Quote
  #13  
Old 24.09.2020, 16:48
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 54,918
Default

Quote:
Originally Posted by aaferque View Post
...In other words, the problem is on their side, not JD, as I see....
You're expressing yourself very simple here.

This is neither a "bug" on their side nor on ours.

They've simply added limits to prevent users from doing too many http requests in a short time.
Probably to prevent high server loads

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #14  
Old 24.09.2020, 19:27
aaferque aaferque is offline
Vacuum Cleaner
 
Join Date: Jul 2017
Posts: 19
Default

pspzockerscene I see, thanks for explanation!
Reply With Quote
  #15  
Old 24.09.2020, 21:44
hullabaloo hullabaloo is offline
Junior Loader
 
Join Date: Dec 2016
Posts: 13
Default

Quote:
Originally Posted by pspzockerscene View Post
You're expressing yourself very simple here.

This is neither a "bug" on their side nor on ours.

They've simply added limits to prevent users from doing too many http requests in a short time.
Probably to prevent high server loads

-psp-
You should trigger a reconnect when error 429 is received. That would solve the issue.
Reply With Quote
  #16  
Old 25.09.2020, 15:48
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 54,918
Default

Quote:
Originally Posted by hullabaloo View Post
You should trigger a reconnect when error 429 is received. That would solve the issue.
I'm already doing that.

Error 429 will trigger a reconnect-waittime of either 30 minutes or the waittime given in their response header "Retry-After".

Please wait for the next CORE-update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #17  
Old 27.09.2020, 14:55
jeanminator jeanminator is offline
Modem User
 
Join Date: Sep 2020
Posts: 2
Default

have a look to this it might give an answer
**External links are only visible to Support Staff****External links are only visible to Support Staff**
they say this
Hi everyone!

Today I will address concerns and issues about the site that have cropped up over the last week or so. Sorry its a bit lengthy, but to avoid questions in the forum and via email I will explain everything.

Too Many Requests. Retry in 1 hour : This error happens for a few reasons. And it is being worked on if not fixed already by the time you read this. You see, some users, as many as 1000 a day, will simply be using the site to download entire galleries. This massive downloading is going to stop or be limited. After evaluating all of our options we going to stop the beta site from downloading galleries. As I mentioned in other sections of the forum, a beta site is not a finished product. This past week we spent some time on the beta site making improvements and things on the 'back end' that you won't notice. The people downloading massive amounts of galleries was slowing the site down for the casual users. The downloading was nice for some users. But it has seen its day. A little bit of justification would be is that if you like a gallery, you don't need to download it. Just bookmark the gallery or save it to your favorites.Some messages to me include "You will lose customers" or "I wont use this site again!". Right. If you were using the site mostly to download, then honestly you won't be missed. There is nothing to add besides what I mentioned. Messages or emails complaining about this new policy will be ignored. Our decision is final.

Too Many Requests - Part 2 : This is for the users in the United Kingdom using the ISP of BT.com or any other ISP owned by BT. This is a bit of a nerdy technical explanation. So I will keep it short and not bore you. The BT ISP is a weird one. Every once in a while they try to reinvent the wheel and fool around with their users. The ISP has (as of this moment) to dump your guys into a type of security protocol. Maybe you agreed to it, maybe not. The BT users are all sharing a block of IP's. The block is bady configured. There are way too many users on BT having their IP switch many times an hour. So what does that mean to you while on Imagefap? We rely heavily on you using both cookies and the same IP for the duration of your session. BT is not letting that happen. When your IP changes, then your session will turn into a mess and you will get errors telling you to try back in 1 hour. BT will not fix this. even if you call them and ask WTF they are doing, it will take you forever to talk to a level 3 tech. So, while we don't like to cater to an ISP, we do value the users of our site. Today or tomorrow all users of this BT Proxy / ISP mess will be treated differently by us. We will configure this bad block of Ip's assigned to you so you won't get any errors. Nerd stuff - if you know how to check your IP you will see that proxy-pool.uk-lof.gia.bt.net will be listed. Also your IP will begin in most cases with 212.127.x.x . There might be other variations. But this block we will start with and see how things progress.

Too Many Requests - Part 3 : We will attempt to add a captcha when you see this error. This will validate your session one time. Look for it soon.

Wrong Category messages from Admin : Also mentioned in our forums as an announcement, this needs to be talked about again. Users who upload and are choosing the wrong category fall into three categories. 1, being lazy. There is a lot of that. 2, Intentionally choosing wrong categories just so they can get more gallery views. 3. Knowing very little about porn terms. We realize this is a site used by the entire world. And not everyone understands English. We really need to fix this. And we are slowly. Again, when you upload choose the correct categories. If you aren't sure, don't add it. Now the bad part. When we started to check categories, we said that you would have one week to fix any gallery of yours flagged by a site moderator. Sadly, most users didn't decide to do anything at all. Starting today, if you receive a message from Admin "Wrong Category" you will have no grace period. The gallery will be deleted right away. Again, this is the final decision. Messages to site moderators and emails will be ignored.

Beta site : Some users said they can't log in. We found this is only happening to a limited amount of users. Rest assure that this is being worked on or is fixed by now. Also, some users say the can't tell if they are actually logged in or not. This is a result of the beta (not finished) site feature not there. Some day it will show up. But its not on the front burner at the moment. If the beta site seems to be too much trouble, you can always exit and go to the PC site. Every browser has the option for you to get out of the mobile site. Check for an icon on the top right of your browser and look around in your settings. It shouldn't be too hard to find as it is a popular setting many people use.

Message from Admin, Deleted pictures : I will only reference 3 of the 25 reasons we will delete a picture or gallery. Appears too young reason. Just know that we have an excellent admin and moderator team. Some paid, mostly volunteers. Then we have over 1 million active users on the site who can / will report questionable content on our site. Even without site users helping us, our team consists of adults. All over the age of 30. We all know what under 18 looks like. We all had kids, or have been in a school locker room at one time. So the classic line from a user with a deleted pictures saying "Hey, she is 18!" falls on deaf ears. Another common response might be "Hey, I found the picture on imagefap!". That's nice. The problem is you agree to upload only pictures of people 18 or older. It doesn't matter where you originally found the pictures. If indeed you did find the pictures on our site, we will find them eventually. Or if you want to be a good sport, tell us where you found the picture(s). The next, while not the most popular reason I mentioned in the forum a few months ago. Child abuse report by organization. This means a national or international agency has formally complained to us about pictures you uploaded. These agencies know what they are talking about. This is their specialty. So if you complain saying "This is BS!" then you have a serious issue going on. Typically your account will be put under review until I can establish the seriousness of your offense. The odds of you keeping your account are very slim. Next, Copyright Complaint deletion. Due to the nature of our site and most porn sites, this is a fairly popular reason we are asked to deleted content from the site. The copyright holders of the pictures know what they are looking at. Its 'their stuff'. I will add though, just because there isn't a logo or a watermark on the pictures doesn't mean you are free to upload it. Copyright owners of the pictures as well as professional website know 'their stuff' and can easily detect cropped / chopped off logos or watermarks. Once again there will be no disputing Copyright Complaint messages you might receive.

Message from Admin Part 2 : Does not belong in imagefap. As it turns out on any social media site people will upload 'stuff' or do as they please and basically not act civil. We get it. This is how the world is. The site in not intended for users to come and basically start acting like an ass. There are other sites where you can do that. Users coming to the site to spew hate, racism or start with the slurs of people they don't like isn't needed here. We let of the nonsense go by as long as it's not severe. We know this is a touchy subject. But if you are going to make comments of upload galleries with niggers, jews, chinks or crap like that, you will fall into the deletion of Doesn't belong on imagefap. In the end, show a little bit of class. Put your nonsense on other sites.

In closing, our aim is to keep the site running as smooth as possible without any interruptions. Our up time is as good as any other site. Response times to load a page might be slower (but not annoying) during out peak hours. We still to this day average 300 - 500 new users a day. Not bad for a pictures only porn site. Uploaded pictures ranges a lot, but just this past Thursday I noted 150,000 uploaded pictures. Not too shabby!

Thanks for reading this. Sadly most people will skip it :cry:

UPDATE : Forgot to mention this. If we find the word rape anywhere on your profile page, gallery descriptions or captions on your pictures, you will probably be removed from the site with zero warning. That's how it is. No further discussion will be entertained.
Reply With Quote
  #18  
Old 28.09.2020, 16:02
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 54,918
Default

@jeanminator
Why did you just full-quote this in our forums?

Also we've already linked this here ...

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #19  
Old 29.09.2020, 08:57
jeanminator jeanminator is offline
Modem User
 
Join Date: Sep 2020
Posts: 2
Default

I just wanted to help because I've got the same problem to download.
Stop to be suspicious. Ididn't know it has been already linked
It's just boring.
have a nice day
Reply With Quote
  #20  
Old 11.10.2020, 15:27
Trenton Trenton is offline
Baby Loader
 
Join Date: Nov 2019
Posts: 8
Default imagefap Plugin needs an update

Hi.

I noticed that if you start a gallery download of 100 or more images my downloads will stop after around the 100th, and the wesbite prompts me with a captcha as too many connections are happening from my IP in too short time.

I don't know if it's because of my faster internet or if the website updated it's spam filter.

is there a way to manually add like a 1-2 second delay between each link to downaload globally in JD2 or this is a plugin-sided issue that must be updated into the plugin itself?
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 18:57.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.