[pspzockerscene]

Our ehentai can't really automatically use that alternative/fallback image at this moment though that shouldn't matter as it at least shouldn't ever download corrupt/dummy images.

Regarding the "image too small" problem:
The changes we did haven't been released yet.

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!
---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

-psp-

[HydroLogic]

Has there been any progress on this ghost limit issue?

[pspzockerscene]

No.
EDIT

I've changed the thread title back to "See Bugtracker" as no one is actively working on this.
We're open source so anyone is free to investigate this further, see:
https://support.jdownloader.org/Know...up-ide-eclipse

[pspzockerscene]

If someone is willing to provide an account for testing, I'm willing to give this one more shot.
Send logins to: psp@jdownloader.org

[serveral]

I've just sent the account details, however, there have been some changes to their site since this issue was originally posted that may impact some of the tests. I'm going to quote some of relevant details from **External links are only visible to Support Staff**this post in the site's forum.

First off, they introduced a "peak hours" system that completely ignores the "image limits" system during those specified hours, instead using one of their in-site currencies called "GP" during those hours to download the original images from a gallery (which, in my experience, is the fastest way to reach the image limit quota).

2022-08-07

- Adjusted the "peak hours" used by original image downloading to better match the actual measured peak periods. It is now between 14:00 and 20:00 UTC Monday-Saturday, and between 05:00 and 20:00 UTC on Sundays.

Now this wouldn't because the downloader would just stop working during those hours, however due to this following change...

2023-07-11
- The archiver and full image downloads now both auto-convert Credits to GP using the "High" rate from the last 24 hours in the exchange if you have a Credit balance but insufficient GP. (In other words, you can still usually eke out a 1-2% better rate by converting manually, but doing so is no longer essential.)

To avoid extending myself explaining the website's weird economy: credits are sort of time consuming to obtain so most people would rather not spend them.

To summarize: whoever is going to do the testing, just keep in mind not do it during the peak hours periods. And to also only use newer galleries for the tests, since galleries that are more than 1 year old only use that GP download system as well.

[pspzockerscene]

Not sure how I could test it now as your account only has the default/5000 limit now.

[serveral]

That's odd. My account settings show that I have a 50k limit

[pspzockerscene]

I see.
I got that old "bug" in browser where it is 5000 until you visit "/hathperks.php" once.

[serveral]

I don't know how helpful this might be but this **External links are only visible to Support Staff**script and gallery-dl's exhentai **External links are only visible to Support Staff**extractor have workarounds to guess an user's account actual image limits.

I'm aware they're both written in different languages to JDownloader's, and that they may also include libraries or dependencies that aren't available in JD's code base, but still thought they may provide some insight in solving this issue.

[pspzockerscene]

I've now used more than 10 000 GP and I can still download via JD.
I'm stopping now so I'm not wasting all of your credits.
Could it be that this issue fixed itself?

Also I've implemented some measurements to try to avoid wasting GP when downloading original images though it's probably something which only people with a bad internet connection will notice (re-use directurls on resume).

[serveral]

I'll try downloading some galleries and get back to you in a bit.

[serveral]

Can confirm that the issue is no longer present. Gone past the 5k image limit mark and downloads are not being stopped.

Edit: Nevermind, I seem to have hit the limit at 10k now, here's the log 14.08.23 15.56.26 <--> 14.08.23 17.40.31 jdlog://7907311370661/

[pspzockerscene]

Your log looks good:

[jd.plugins.hoster.EHentaiOrg(getNormalmageDownloadurl)] -> Failed to get around limit - limit is definitely reached!
--ID:2750TS:1692048559736-8/14/23 5:29:19 PM -  [] -> Exception thrown at jd.controlling.downloadcontroller.SingleDownloadController.download(SingleDownloadController.java:441):
jd.plugins.AccountUnavailableException: Downloadlimit reached->ERROR_PREMIUM|Value:0

After that, your e-hentai account will get a yellow status in JD for 5 minutes.
Once that time is over, JD will check it again.
If 0 GP is available, the account will stay active but with 0 bytes of traffic-left.
--> Accounts with zero traffic won't be used for downloading.
If more than 0 GP is available again, the account will be used again until one download is running into that limit-message again.

While the account can't be used, JD will continue in free mode which will allow the download of non-original images.
If you wish to avoid this completely, you might want to create an account usage rule for e-hentai.org and disable free mode there so whenever account downloads for original images are not possible, all items will get a wait status until the account can be used again.
EDIT

I've updated the plugin so all GP related limit error-messages will temporary deactivate your account (yellow status). I think this is the way to go.

EDIT2
If you can't reproduce the "Ghost limit bug", I will close all related tickets.

[serveral]

The peak hours period is in place as of right now so I'll get back to you in some hours after it's lifted. I'll update this post to inform you whether I can still replicate the ghost limit or not.

Edit: Seems like an IP ban (white page) was triggered a couple of minutes after I began my test. Log: 15.08.23 16.22.52 <--> 15.08.23 16.44.40 jdlog://2117311370661/ my guess is that their system noticed some sort of bot-like behavior coming from newly implemented GP/credit checks.

[pspzockerscene]

White page where?
Single image pages, account overview or even main page of e-hentai?
Also, what am I supposed to do then?

Originally Posted by serveral

my guess is that their system noticed some sort of bot-like behavior coming from newly implemented GP/credit checks.

If you mean the JD plugin:
No:
1. No additional checks have been implemented.
2. Upon refactoring the plugin, I even removed some unnecessary checks so the plugin is doing less http requests.
EDIT

So if you want me to somehow detect this block - yes I could try to do this.
Your log contains a lot of download activity, also of other filehosts.
Please provide a fresh log - in the ideal case it is only from one session and contains only e-hentai activity.
Keep in mind that if a website really wants to block public tools like JDownloader, they can do this at any point of time.

[simon_7617118]

Originally Posted by pspzockerscene

After that, your e-hentai account will get a yellow status in JD for 5 minutes.
Once that time is over, JD will check it again.
If 0 GP is available, the account will stay active but with 0 bytes of traffic-left.

I don't quite understand what's going on here, I'm sorry if I missed some changes on EH's end. But I'd much prefer the old plugin where downloading original images counts towards the 5000 daily image points, rather than GP. This is forcing people to actually play their game to earn GP. This is far more tedious compared to just using the daily points system which, if one manages it correctly, ends up being about 500mb of downloads per day.
This attempt to circumvent their bandwidth usage limit is making things way worse. Please don't mess with GP conversions.

[pspzockerscene]

@simon_7617118
To make this absolutely clear:

• The way how JD downloads original images (if preferred by the user) was never changed
• JD does not convert / auto "buy" GP at any time
• The account handling I described has been this way before - I didn't change any behavior here either. Wherever I wrote "GP" I ment the points that are displayed on their website as "You are currently at 0 towards a limit of 50000."

Maybe I've unknowingly mixed up the wording for "GP" and "image points" here - I can only repeat: I'm not using e-hentai myself.

Originally Posted by simon_7617118

This attempt to circumvent their bandwidth usage limit is making things way worse. Please don't mess with GP conversions.

There is not any attempt to circumvent their bandwidth usage implemented into our plugin.
If you mean the log-quote I posted in post #33:
That was a badly worded log output in a function which simply checked if the limit was really reached after the first time it looked like itwas reached.
You can verify that information by looking into our source code:
Code reference:
github.com/mirror/jdownloader/blob/5f50ef81a535c64d31713ed043587eac7a3da057/src/jd/plugins/hoster/EHentaiOrg.java#L493C14-L493C14

In the meanwhile the wording of that log-output was changed as well.

[simon_7617118]

So is this change coming from EH itself? Because right now I can't download any image at original resolution, even though my image points usage is at 0. It's counting towards GP, and I've run out quickly because I don't play that game.
Sorry if that's the case. I'm not a coder, I can't review anything. Is there any chance that a recent change in the plugin may have triggered this behavior? It has never used GP before, and I can't imagine how EH is able to discern traffic from JD. Previously, the only way they could detect it was if the simultaneous download was set too high.

[serveral]

Originally Posted by pspzockerscene

White page where?
Single image pages, account overview or even main page of e-hentai?
Also, what am I supposed to do then?

Anywhere. Got it after downloading for some minutes with JD (with the original quality option checked, only one picture at a time, and after the peak hours period had passed) when I noticed downloads had stopped with the "account missing" error. When I went to check on the browser, exhentai just gave me a blank/white page (IP ban behavior which I could confirm by using a VPN), didn't try accessing e-hentai though I'm guessing it would've also shown me a white page. It could've been a one off thing since I didn't try to replicate the behavior again See Edits

Originally Posted by pspzockerscene

So if you want me to somehow detect this block - yes I could try to do this.
Your log contains a lot of download activity, also of other filehosts.
Please provide a fresh log - in the ideal case it is only from one session and contains only e-hentai activity.
Keep in mind that if a website really wants to block public tools like JDownloader, they can do this at any point of time.

Will do. I'm going to try downloading a bunch of galleries without the "original quality" setting on to see if I can trigger then ban as well.

Originally Posted by simon_7617118

So is this change coming from EH itself? Because right now I can't download any image at original resolution, even though my image points usage is at 0. It's counting towards GP, and I've run out quickly because I don't play that game.

Yes, they introduced a "peak hours" system about a year ago where from Monday to Saturday around 14:00 to 20:00 UTC (during Sundays, it's almost the whole day), GP would be used instead of image limits if you're downloading original images, and galleries older than a year will also only use GP as of july if you try downloading their original images too regardless of whether it's peak hours or not. Their "News & Updates" section of their forum has more info.

Edit
No bans triggered so far when downloading resized pictures (original quality setting unchecked) but I seem to have hit the image limit near 5k. Kinda odd given the last time I ran into the limit was at 10k instead (the one I reported in one of the posts above), but that was with the original quality settings ticked. Here's the log 16.08.23 12.24.44 <--> 16.08.23 14.40.02 jdlog://9217311370661/
There are probably some errors/download failures scattered across the whole log but those are most likely local network issues, the important stuff should be near the end of the log session.

Edit 2
Seems like the white page/ban thing was a one time only thing, maybe something I did on my end but so far I haven't managed to replicate it. However I did try once more to download some more galleries, this time with the original image quality setting ticked on to see if the image limit bug was still there, and this time I got to around 8k before JD started saying that I had reached the limit. Log of this session: 16.08.23 20.31.43 <--> 16.08.23 20.42.52 jdlog://4317311370661/ . This last log is not as clean as the previous one because my system crashed, (unrelated to JD) but prior to the crash I had already passed the 5k image limit mark and downloads kept going (until the crash of course). After the crash, I was able to download about a dozen more pictures before it finally stopped at about a little over 8k.

[simon_7617118]

Originally Posted by serveral

galleries older than a year will also only use GP as of july if you try downloading their original images too regardless of whether it's peak hours or not.

Okay, that must be it, although I've only started running into this problem this week. Thanks for the explanation.