JDownloader Community - Appwork GmbH
 

Notices

Reply
 
Thread Tools Display Modes
  #1  
Old 16.09.2020, 18:13
gollum007 gollum007 is offline
Modem User
 
Join Date: Sep 2020
Posts: 2
Default ImageFap.com: Rate Limiting

ImageFap have introduced a request rate limiter. At present I believe the limits to be the following:
Quote:
100 requests per 1 min
200 requests per 5 min
1000 requests per 1 hour
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Is there any chance of the plugin being updated to try and respect these better?

At the minute, if you trigger a download on anything above ~50 images it'll lock you out for an hour.
Reply With Quote
  #2  
Old 16.09.2020, 18:20
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Hi,

please post example URLs and a log.
Yes we can try to obey these limits but ultimately JD will reach the limit and then have to wait until it's over (well or you have to do a reconnect to get a new IP).

Please post your log-ID here | bitte poste deine Log-ID hier.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #3  
Old 16.09.2020, 18:36
gollum007 gollum007 is offline
Modem User
 
Join Date: Sep 2020
Posts: 2
Default

I can't actually trigger it at the minute (headbash....)

I *believe* this session from this morning has it in the logs:
Code:
16.09.20 10.28.30 <--> 16.09.20 10.28.30 jdlog://8186225302851/
I suspect they're probably still messing with it, will post again if I get a decent trigger / log.
Reply With Quote
  #4  
Old 16.09.2020, 23:20
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Hm I was unable to trigger it.

Next time please post a debug log.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #5  
Old 19.09.2020, 19:06
aaferque aaferque is offline
JD Alpha
 
Join Date: Jul 2017
Posts: 22
Default Problem with Imagefap galleries

Greetings! I can't download galleries from imagefap. This problem exists for a week. JD tries to pick gallery up, but instead of it adds line for example "gallery php gid=8910305&view=2" in the board!
Please help me out. Best regards!
Spoiler:
Attached Images
File Type: png 20200919-190721.png (90.6 KB, 1 views)

Last edited by aaferque; 19.09.2020 at 19:15.
Reply With Quote
  #6  
Old 20.09.2020, 14:35
hullabaloo hullabaloo is offline
JD Alpha
 
Join Date: Dec 2016
Posts: 20
Default

I can confirm the issue.

Sample gallery:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Debuglog
20.09.20 13.27.26 <--> 20.09.20 13.32.30 jdlog://3787225302851/

thanks for fixing
Reply With Quote
  #7  
Old 21.09.2020, 16:38
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Merged imagefap threads.

@hullabaloo
I've tried to add support for "rate limit reached".
JD will wait 5 minutes in this case.
Alternatively you could do a reconnect to continue right away with a new IP.

@aaferque
I was unable to reproduce your issue.
Please post example URLs and a log.

Please post your log-ID here | bitte poste deine Log-ID hier.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #8  
Old 21.09.2020, 23:53
aaferque aaferque is offline
JD Alpha
 
Join Date: Jul 2017
Posts: 22
Default

Quote:
Originally Posted by pspzockerscene
Please post example URLs and a log.
For example:

Spoiler:
**External links are only visible to Support Staff****External links are only visible to Support Staff**


Gallery:
**External links are only visible to Support Staff****External links are only visible to Support Staff**


21.09.20 23.45.21 <--> 21.09.20 23.51.17 jdlog://0928225302851/

**External links are only visible to Support Staff****External links are only visible to Support Staff**

Last edited by aaferque; 22.09.2020 at 00:06.
Reply With Quote
  #9  
Old 22.09.2020, 14:54
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

I've improved the rate limit handling with the next update.

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #10  
Old 24.09.2020, 02:56
aaferque aaferque is offline
JD Alpha
 
Join Date: Jul 2017
Posts: 22
Default

Still there's an error: Error 429 rate limit reached (imagefap.com)
Other hosts work well.
Reply With Quote
  #11  
Old 24.09.2020, 12:59
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Quote:
Originally Posted by aaferque View Post
Still there's an error: Error 429 rate limit reached (imagefap.com)
... and it will happen again because of this:
imagefaq.cc/forum/viewtopic.php?f=4&t=17675&sid=0ed66fda947338862f2cb3d32622e030

It might also happen in your browser (for imagefap) once that limit has been reached depending on how they're handling this.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 24.09.2020 at 13:14.
Reply With Quote
  #12  
Old 24.09.2020, 15:50
aaferque aaferque is offline
JD Alpha
 
Join Date: Jul 2017
Posts: 22
Default

Quote:
... and it will happen again because of this:
imagefaq.cc/forum/viewtopic.php?f=4&t=17675&sid=0ed66fda947338862f2cb3d32622e030

It might also happen in your browser (for imagefap) once that limit has been reached depending on how they're handling this.
Thanks for answering. In other words, the problem is on their side, not JD, as I see....
Reply With Quote
  #13  
Old 24.09.2020, 16:48
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Quote:
Originally Posted by aaferque View Post
...In other words, the problem is on their side, not JD, as I see....
You're expressing yourself very simple here.

This is neither a "bug" on their side nor on ours.

They've simply added limits to prevent users from doing too many http requests in a short time.
Probably to prevent high server loads

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #14  
Old 24.09.2020, 19:27
aaferque aaferque is offline
JD Alpha
 
Join Date: Jul 2017
Posts: 22
Default

pspzockerscene I see, thanks for explanation!
Reply With Quote
  #15  
Old 24.09.2020, 21:44
hullabaloo hullabaloo is offline
JD Alpha
 
Join Date: Dec 2016
Posts: 20
Default

Quote:
Originally Posted by pspzockerscene View Post
You're expressing yourself very simple here.

This is neither a "bug" on their side nor on ours.

They've simply added limits to prevent users from doing too many http requests in a short time.
Probably to prevent high server loads

-psp-
You should trigger a reconnect when error 429 is received. That would solve the issue.
Reply With Quote
  #16  
Old 25.09.2020, 15:48
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Quote:
Originally Posted by hullabaloo View Post
You should trigger a reconnect when error 429 is received. That would solve the issue.
I'm already doing that.

Error 429 will trigger a reconnect-waittime of either 30 minutes or the waittime given in their response header "Retry-After".

Please wait for the next CORE-update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #17  
Old 27.09.2020, 14:55
jeanminator jeanminator is offline
Modem User
 
Join Date: Sep 2020
Posts: 2
Default

have a look to this it might give an answer
**External links are only visible to Support Staff****External links are only visible to Support Staff**
they say this
Hi everyone!

Today I will address concerns and issues about the site that have cropped up over the last week or so. Sorry its a bit lengthy, but to avoid questions in the forum and via email I will explain everything.

Too Many Requests. Retry in 1 hour : This error happens for a few reasons. And it is being worked on if not fixed already by the time you read this. You see, some users, as many as 1000 a day, will simply be using the site to download entire galleries. This massive downloading is going to stop or be limited. After evaluating all of our options we going to stop the beta site from downloading galleries. As I mentioned in other sections of the forum, a beta site is not a finished product. This past week we spent some time on the beta site making improvements and things on the 'back end' that you won't notice. The people downloading massive amounts of galleries was slowing the site down for the casual users. The downloading was nice for some users. But it has seen its day. A little bit of justification would be is that if you like a gallery, you don't need to download it. Just bookmark the gallery or save it to your favorites.Some messages to me include "You will lose customers" or "I wont use this site again!". Right. If you were using the site mostly to download, then honestly you won't be missed. There is nothing to add besides what I mentioned. Messages or emails complaining about this new policy will be ignored. Our decision is final.

Too Many Requests - Part 2 : This is for the users in the United Kingdom using the ISP of BT.com or any other ISP owned by BT. This is a bit of a nerdy technical explanation. So I will keep it short and not bore you. The BT ISP is a weird one. Every once in a while they try to reinvent the wheel and fool around with their users. The ISP has (as of this moment) to dump your guys into a type of security protocol. Maybe you agreed to it, maybe not. The BT users are all sharing a block of IP's. The block is bady configured. There are way too many users on BT having their IP switch many times an hour. So what does that mean to you while on Imagefap? We rely heavily on you using both cookies and the same IP for the duration of your session. BT is not letting that happen. When your IP changes, then your session will turn into a mess and you will get errors telling you to try back in 1 hour. BT will not fix this. even if you call them and ask WTF they are doing, it will take you forever to talk to a level 3 tech. So, while we don't like to cater to an ISP, we do value the users of our site. Today or tomorrow all users of this BT Proxy / ISP mess will be treated differently by us. We will configure this bad block of Ip's assigned to you so you won't get any errors. Nerd stuff - if you know how to check your IP you will see that proxy-pool.uk-lof.gia.bt.net will be listed. Also your IP will begin in most cases with 212.127.x.x . There might be other variations. But this block we will start with and see how things progress.

Too Many Requests - Part 3 : We will attempt to add a captcha when you see this error. This will validate your session one time. Look for it soon.

Wrong Category messages from Admin : Also mentioned in our forums as an announcement, this needs to be talked about again. Users who upload and are choosing the wrong category fall into three categories. 1, being lazy. There is a lot of that. 2, Intentionally choosing wrong categories just so they can get more gallery views. 3. Knowing very little about porn terms. We realize this is a site used by the entire world. And not everyone understands English. We really need to fix this. And we are slowly. Again, when you upload choose the correct categories. If you aren't sure, don't add it. Now the bad part. When we started to check categories, we said that you would have one week to fix any gallery of yours flagged by a site moderator. Sadly, most users didn't decide to do anything at all. Starting today, if you receive a message from Admin "Wrong Category" you will have no grace period. The gallery will be deleted right away. Again, this is the final decision. Messages to site moderators and emails will be ignored.

Beta site : Some users said they can't log in. We found this is only happening to a limited amount of users. Rest assure that this is being worked on or is fixed by now. Also, some users say the can't tell if they are actually logged in or not. This is a result of the beta (not finished) site feature not there. Some day it will show up. But its not on the front burner at the moment. If the beta site seems to be too much trouble, you can always exit and go to the PC site. Every browser has the option for you to get out of the mobile site. Check for an icon on the top right of your browser and look around in your settings. It shouldn't be too hard to find as it is a popular setting many people use.

Message from Admin, Deleted pictures : I will only reference 3 of the 25 reasons we will delete a picture or gallery. Appears too young reason. Just know that we have an excellent admin and moderator team. Some paid, mostly volunteers. Then we have over 1 million active users on the site who can / will report questionable content on our site. Even without site users helping us, our team consists of adults. All over the age of 30. We all know what under 18 looks like. We all had kids, or have been in a school locker room at one time. So the classic line from a user with a deleted pictures saying "Hey, she is 18!" falls on deaf ears. Another common response might be "Hey, I found the picture on imagefap!". That's nice. The problem is you agree to upload only pictures of people 18 or older. It doesn't matter where you originally found the pictures. If indeed you did find the pictures on our site, we will find them eventually. Or if you want to be a good sport, tell us where you found the picture(s). The next, while not the most popular reason I mentioned in the forum a few months ago. Child abuse report by organization. This means a national or international agency has formally complained to us about pictures you uploaded. These agencies know what they are talking about. This is their specialty. So if you complain saying "This is BS!" then you have a serious issue going on. Typically your account will be put under review until I can establish the seriousness of your offense. The odds of you keeping your account are very slim. Next, Copyright Complaint deletion. Due to the nature of our site and most porn sites, this is a fairly popular reason we are asked to deleted content from the site. The copyright holders of the pictures know what they are looking at. Its 'their stuff'. I will add though, just because there isn't a logo or a watermark on the pictures doesn't mean you are free to upload it. Copyright owners of the pictures as well as professional website know 'their stuff' and can easily detect cropped / chopped off logos or watermarks. Once again there will be no disputing Copyright Complaint messages you might receive.

Message from Admin Part 2 : Does not belong in imagefap. As it turns out on any social media site people will upload 'stuff' or do as they please and basically not act civil. We get it. This is how the world is. The site in not intended for users to come and basically start acting like an ass. There are other sites where you can do that. Users coming to the site to spew hate, racism or start with the slurs of people they don't like isn't needed here. We let of the nonsense go by as long as it's not severe. We know this is a touchy subject. But if you are going to make comments of upload galleries with niggers, jews, chinks or crap like that, you will fall into the deletion of Doesn't belong on imagefap. In the end, show a little bit of class. Put your nonsense on other sites.

In closing, our aim is to keep the site running as smooth as possible without any interruptions. Our up time is as good as any other site. Response times to load a page might be slower (but not annoying) during out peak hours. We still to this day average 300 - 500 new users a day. Not bad for a pictures only porn site. Uploaded pictures ranges a lot, but just this past Thursday I noted 150,000 uploaded pictures. Not too shabby!

Thanks for reading this. Sadly most people will skip it :cry:

UPDATE : Forgot to mention this. If we find the word rape anywhere on your profile page, gallery descriptions or captions on your pictures, you will probably be removed from the site with zero warning. That's how it is. No further discussion will be entertained.
Reply With Quote
  #18  
Old 28.09.2020, 16:02
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

@jeanminator
Why did you just full-quote this in our forums?

Also we've already linked this here ...

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #19  
Old 29.09.2020, 08:57
jeanminator jeanminator is offline
Modem User
 
Join Date: Sep 2020
Posts: 2
Default

I just wanted to help because I've got the same problem to download.
Stop to be suspicious. Ididn't know it has been already linked
It's just boring.
have a nice day
Reply With Quote
  #20  
Old 11.10.2020, 15:27
Trenton Trenton is offline
Baby Loader
 
Join Date: Nov 2019
Posts: 9
Default imagefap Plugin needs an update

Hi.

I noticed that if you start a gallery download of 100 or more images my downloads will stop after around the 100th, and the wesbite prompts me with a captcha as too many connections are happening from my IP in too short time.

I don't know if it's because of my faster internet or if the website updated it's spam filter.

is there a way to manually add like a 1-2 second delay between each link to downaload globally in JD2 or this is a plugin-sided issue that must be updated into the plugin itself?
Reply With Quote
  #21  
Old 11.10.2020, 22:06
daffdaemon daffdaemon is offline
Mega Loader
 
Join Date: Jan 2011
Posts: 65
Default Imagefap rate limits status?

I just tried some downloads today after updating. Here is what I noticed, hope it is helpful.

Previously loaded & failed links still failed with message:
"Try restarting this link (plug-in outdated)"

Re-grabbed links successfully downloaded 50 files then failed with same message. JD did not pause at 100 either: was at 108 50 good, 58 failed when I disabled the links.

Linkgrabber was attempting to get some links and stopped working at about same time file downloads stopped working with message:
"Plugin Defect!7045892"

Log ID
11.10.20 14.15.21 <--> 11.10.20 14.03.52 jdlog://9404325302851/
Reply With Quote
  #22  
Old 12.10.2020, 16:04
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Hi,

please post a lot of example URLs and another log.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #23  
Old 13.10.2020, 20:41
daffdaemon daffdaemon is offline
Mega Loader
 
Join Date: Jan 2011
Posts: 65
Default Imagefap rate limits status?

Here are a bunch of links:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Here is new log file:
13.10.20 12.36.55 <--> 13.10.20 13.22.16 jdlog://4454325302851/

8018292 29 files successfully downloaded
7045892 Previously failed links failed
7319035 46 files successfully downloaded
7045892 58 files regrabbed & successfully downloaded
6890859 54 files successfully downloaded then continuous fail

Total files downloaded 187
Total MB downloaded 171.93
JD kept trying to download without pausing
I kept it running till it had tried over 100 files from 890859 put it just kept trying to download so I shut it down.
Reply With Quote
  #24  
Old 14.10.2020, 15:04
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

@daffdaemon
Thanks for your report!

I've explored- and partly implemented new rate limit handling along with that captcha.
For users who do not want to solve captchas at all, I've also implemented a plugin setting which will disable the captchas and wait/reconnect instead.
See Settings -> Plugins -> imagefap.com

Screenshot:


-psp-

EDIT

Current imagefap ticket & status:



Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 14.10.2020 at 16:47.
Reply With Quote
  #25  
Old 14.10.2020, 17:32
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Updates have been released - we're waiting for feedback ...

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #26  
Old 15.10.2020, 01:39
Trenton Trenton is offline
Baby Loader
 
Join Date: Nov 2019
Posts: 9
Default

Quote:
Originally Posted by pspzockerscene View Post
Updates have been released - we're waiting for feedback ...

-psp-
you're awesome!

I tried and I notice the first time I try to donwload a gallery I get 5% of the links "file not found" and if I do a "check online status" on the whole folder it returns the same results, if I do it on the single links it finds them and then force-download them all with no issues.

I am not able to replicate the issue because the latest 2 galleries I've downloaded have been removed from direct link but the original images still stands. also it seems they are doing stuff on the beta site and galleries overall so it might be that.

I'm not sure if I will be able to generate a debug before this weekend.

I do not mind leaving my pc online at night to slowly download like 1 image every 10 seconds to reduce the load on their side (I see their point) so an option to schedule and space out single links in the plugin would be nice IMO
Reply With Quote
  #27  
Old 15.10.2020, 13:50
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Please post a log if you're able to reproduce the issue.

Also keep in mind that our crawler (= the module that grabs complete galleries first) does not yet have proper "rate limit" handling implemented - we're still working on it ...

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #28  
Old 15.10.2020, 17:29
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

Wait for next plugin update. I did some more changes and even further reduced number of requests
__________________
JD-Dev & Server-Admin
Reply With Quote
  #29  
Old 15.10.2020, 17:35
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

In case you encounter issues, please provide more logs
__________________
JD-Dev & Server-Admin
Reply With Quote
  #30  
Old 15.10.2020, 19:07
denylx denylx is offline
JD Beta
 
Join Date: Aug 2019
Posts: 59
Default

Today I tried downloading a gallery with 210 images and while most of the images downloaded just fine, 51 images were downloaded as just "file" with no extension.
I have attached the log below.

15.10.20 21.13.46 <--> 15.10.20 21.31.39 jdlog://2205325302851/
Reply With Quote
  #31  
Old 15.10.2020, 19:38
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

When you rightclick reset those and try again, still downloaded as file?
Filename changed to file on download or when you were crawling/adding the galleries?
__________________
JD-Dev & Server-Admin
Reply With Quote
  #32  
Old 15.10.2020, 20:02
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

New update with changes, please check. I was not able to reproduce the file issue
__________________
JD-Dev & Server-Admin
Reply With Quote
  #33  
Old 16.10.2020, 15:35
denylx denylx is offline
JD Beta
 
Join Date: Aug 2019
Posts: 59
Default

Quote:
Originally Posted by Jiaz View Post
When you rightclick reset those and try again, still downloaded as file?
Filename changed to file on download or when you were crawling/adding the galleries?
Yes, even after resetting they still got downloaded as file. I later tried a gallery with a 73 images and it got downloaded correctly. And yes the filename changed to file on crawling/adding the galleries.

I think this problem arises when a gallery contains 100+ images but I'm not sure.

Last edited by denylx; 16.10.2020 at 15:38.
Reply With Quote
  #34  
Old 16.10.2020, 16:03
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

I was not able to reproduce the issue with your provided example links. Please let debug mode enabled in JDownloader and once you encounter/can reproduce the "file" issue again, create log and post here
__________________
JD-Dev & Server-Admin
Reply With Quote
  #35  
Old 16.10.2020, 20:56
daffdaemon daffdaemon is offline
Mega Loader
 
Join Date: Jan 2011
Posts: 65
Default Imagefap rate limits status?

I updated this AM and downloaded both the two largest galleries from the bunch of links previously submitted. No real problems noticed. Nice job!

I noticed it moves through the file list a little slower than before.
I got a handful of "Problems with server" which resolved on reset.
At one point I started getting captchas... 4 of them in succession then JD proceeded with no more interruptions.

Total files downloaded: about 1,100.
Here is log of session:
16.10.20 13.10.22 <--> 16.10.20 13.10.23 jdlog://4145325302851/

Thank you.

PS I am curious...how did you get it to download without pausing.
Reply With Quote
  #36  
Old 17.10.2020, 12:21
denylx denylx is offline
JD Beta
 
Join Date: Aug 2019
Posts: 59
Default

Quote:
Originally Posted by Jiaz View Post
I was not able to reproduce the issue with your provided example links. Please let debug mode enabled in JDownloader and once you encounter/can reproduce the "file" issue again, create log and post here
So today I tried with bunch of galleries with images in them ranging from 50 to 100 plus. This time while certain images were crawled as "file", they changed to appropriated jpg/png format while downloading which was not the case last time (I don't know what has changed in between). A few files started to show host problems but resetting them fixed it.

During the download a particular gallery started asking for captcha for every other file but an IP change along with file reset fixed this.

Overall I set 627 images for download and everything was downloaded correctly although speed was a bit on the slower side.

I have enabled debug mode and have attached the log file from the session:

17.10.20 14.15.32 <--> 17.10.20 14.46.53 jdlog://8955325302851/
Reply With Quote
  #37  
Old 18.10.2020, 10:49
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

@denylx:
So the name "file" happened while crawling the file, right? Not on actual download? It was already "file" in linkgrabber, right?
File extension was fixed with last update, some were missing correct one.
The host issues were server problems, 500 Internal Server Error
__________________
JD-Dev & Server-Admin
Reply With Quote
  #38  
Old 18.10.2020, 10:51
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

We've set request limit to 1 request every 750ms, that's why the whole process is slower but should less often hit the limits
__________________
JD-Dev & Server-Admin
Reply With Quote
  #39  
Old 19.10.2020, 14:43
denylx denylx is offline
JD Beta
 
Join Date: Aug 2019
Posts: 59
Default

Quote:
Originally Posted by Jiaz View Post
We've set request limit to 1 request every 750ms, that's why the whole process is slower but should less often hit the limits
Everything is working okay now
Reply With Quote
  #40  
Old 19.10.2020, 15:19
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

Thanks for the feedback! Still need to find/reproduce/fix the "file" naming issue.
__________________
JD-Dev & Server-Admin
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 22:38.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.