[Doom]

That issue actually been around for a long time but I never thought of reporting about it,

In some situations where one copy a Exhentai's/E-hentai's gallery link to Jdownloader, if some files got the same names few more times, it will auto exclude them as mirrored links and won't download them,

It for some reason also show them in the previews as if they got the same file size when they don't, and as result think they're a mirrors of the same file and just skip them rather than ask me if to download and rename them


EDIT:
Umm seems like changing the settings to always auto rename files solve it (???)
But it still doesn't explained why it originally detected the files in the wrong size as well as why it didn't asked the user what to do despite being set to ask by default ...

[pspzockerscene]

Hi,
keep in mind that "File with same name exists" and "JD treats a file as mirror of another file" are two separate conditions.

In this case you either need to provide some example links for me so I can make sure that this won't happen anymore for this specific plugin and/or you need to change the JDownloader settings so that such files will not be treated as mirrors anymore:
Settings -> Advanced Settings -> GeneralSettings.mirrordetectiondecision -> FILENAME_FILESIZE
-> That might help you but we do not recommend changing this setting!

About the same/wrong filesize: This is just the result of the wrongly detected mirror so I do not consider this as a bug.
Detecting a mirror as mirror if it isn't a mirror, that however should not happen.

[Doom]

Sorry for the huge delay and about promting this post again (a lot happened in my life in recent time),

I will give a try to these settings

-> That might help you but we do not recommend changing this setting!

Since it happens a lot with with exhentai, even if the sizes doesn't match,

Why do you not recommand to change it though?
I rather Jdownloader always download the same file twice (with a name change like adding (1)) than skip file due to it being stupid not being able to tell when a file is a mirrored or not.

[pspzockerscene]

Originally Posted by Doom

Since it happens a lot with with exhentai, even if the sizes doesn't match,

You misunderstood what it will do, in fact it looks like you haven't even tried it. Explanation:
When enabled, files need to have a matching filesize and name to be detected as a mirror.
In the end, your files with the same filenames which are not mirrors will be detected as "files with the same name but not mirror" and thus the auto rename (if configured) will do its job.

Originally Posted by Doom

[...]than skip file due to it being stupid not being able to tell when a file is a mirrored or not.

There are reasons for why JDownloaders internals work in the way they do.
I'am open for discussions and improvement suggestions but simply calling the existing behavior stupid won't help anyone to improve it.

[Doom]

You misunderstood what it will do, in fact it looks like you haven't even tried it. Explanation:
When enabled, files need to have a matching filesize and name to be detected as a mirror.
In the end, your files with the same filenames which are not mirrors will be detected as "files with the same name but not mirror" and thus the auto rename (if configured) will do its job.

I've actually tried it few secs after posting the old comment and it solved my issue (at least with the link I've tested it on), the auto rename failed me so many times even if I've set it right so I rather try this option,
When I tell JD to download something like an entire gallery, I want it to download everything, and I rather let it make duplications of the same files which I can later remove manually, than see JD just mistake it for a mirror and auto skip it,

There are reasons for why JDownloaders internals work in the way they do.
I'am open for discussions and improvement suggestions but simply calling the existing behavior stupid won't help anyone to improve it.

Surely even if I don't understand or appriciate the technical depth behind the settings as the creator does, it still not means I shouldn't use it if at the end of the day it (may) solve my issue,

I'm not experinced enough to know how it work to give suggestions about it, but as I've said above I rather let JD to download the same file twice if I can, over letting it mistake the file as mirror and skip it,

If what you showed here

Settings -> Advanced Settings -> GeneralSettings.mirrordetectiondecision -> FILENAME_FILESIZE

Will do that then I'm more than fine with it, as long as there aren't any other possible issues I should be aware of,

Also don't take the "stupid" part too serious, it was mostly meant to be a sarcastic joke in a manner of relief rather than being part of a sentence some mad kiddo who doesn't appriciate the app or the support they got for it will say ahah xD,

So you can ignore it.

[pspzockerscene]

Originally Posted by Doom

the auto rename failed me so many times even if I've set it right so I rather try this option

The auto rename didn't fail, it wasn't even attempted.
I'll try one last time but you do not need to understand my answer; it's more important that it will work in the end which it seems like it does now:
In your case, those files were detected as a mirror but it was not(!) a mirror.
If JDownloader detects e.g. 4 files as a mirror and one gets downloaded, the other ones will be skipped.
TRhe auto rename will only happen if JD thinks sees "ohh two different files with the same filename".
The "fix" in this case is to make JD not detect those files as mirror.

Originally Posted by Doom

When I tell JD to download something like an entire gallery, I want it to download everything, and I rather let it make duplications of the same files which I can later remove manually, than see JD just mistake it for a mirror and auto skip it,

I understand your use case.

Originally Posted by Doom

Surely even if I don't understand or appriciate the technical depth behind the settings as the creator does, it still not means I shouldn't use it if at the end of the day it (may) solve my issue,

Sure and that is not what I wanted to say - in fact you should use the setting I told you about but you shouldn't need to use it.
Please post some links to ehentai galleries which contain multiple items with the same default filenames so I can look into this to make it work fine with default settings.

Originally Posted by Doom

Also don't take the "stupid" part too serious, it was mostly meant to be a sarcastic joke in a manner of relief rather than being part of a sentence some mad kiddo who doesn't appriciate the app or the support they got for it will say ahah xD,

No worries

[Doom]

Alright and thx,
I will try look for one,

But it's usually happens most of the times if you're trying to download galleries that got many files in them in general.

[Jiaz]

Originally Posted by Doom

I will try look for one,
But it's usually happens most of the times if you're trying to download galleries that got many files in them in general.

We need to be able to reproduce the issue, so best is to provide example links where this issue happens for you, then we can look into it

[Doom]

Sorry for the long delay, had to finish something with Jdownloader before change the settings back and test things,

So far after changing the settings to FILENAME_FILESIZE for a month now I didn't got a single issue,


But it seems like you updated the exhentai plugin recently?
Cause today I didn't managed to find a single mirrored link after changing the settings back, and there's also a new issue that appeared now:
Jdownloader no longer separate the archive rar files (Which cost site points) and the images (which don't cost points),

So now you can download by mistake something that can potentially ban your account unless you will separate it again.


As for the mirror issue, I need to keep testing till I've bump into it cause while it was easy to do before, I think some recent change might've fixed it (?)


One more additonal issue I actually want to bring up that been there for years is a situation where Jdownloader can't find an image in exhentai and will enter a loop where it's saying that the file is temporarily unavaliable,
And if you look on said links that it claim to be unavaliable, you sometimes will find out the image there is indeed dead or still working,
However exhentai got a "Reload broken image" in cases like this to reload the image, so will it be possible to make it so if Jdownloader can't find the pic from the link, it will look for the pic that is in the Reload broken image url instead?

[pspzockerscene]

Originally Posted by Doom

Cause today I didn't managed to find a single mirrored link after changing the settings back

I haven't really changed anything regarding this on purpose but I did change the way, the imagepositions are generated so maybe that somehow avoided the problem.
Before:

[FANBOX] Zerodo⁄Degree123 (2023.3.7~2024.4.26)_2906046-0001.jpg

(Fixed 4-digit number padding)
Now:

[FANBOX] Zerodo⁄Degree123 (2023.3.7~2024.4.26)_2906046-001.jpg

(Padding now depends on max number of images in gallery [as long as that can be determined] e.g. up to 999 images, padding is 3 digits.)
URL used for testing:

e-hentai.org/g/2906046/5de8ba6bef/

Originally Posted by Doom

Jdownloader no longer separate the archive rar files (Which cost site points) and the images (which don't cost points),

You mean that archive- and loose images now go intop one package?
Indeed I did change this since the fact that .zip archives went into a separate package was just a mistake by me.
As before, I'am open for suggestions but before doing further changes to the plugin you may want to tell me why you are adding the .zip archives if you do not plan on downloading them?
You can just turn that off under Settings -> e-hentai.org -> Gallery crawl mode -> Do not crawl zip archive

Originally Posted by Doom

One more additonal issue I actually want to bring up that been there for years is a situation where Jdownloader can't find an image in exhentai and will enter a loop where it's saying that the file is temporarily unavaliable,
And if you look on said links that it claim to be unavaliable, you sometimes will find out the image there is indeed dead or still working,
However exhentai got a "Reload broken image" in cases like this to reload the image, so will it be possible to make it so if Jdownloader can't find the pic from the link, it will look for the pic that is in the Reload broken image url instead?

Please provide a log and example URLs:

Please post your log-ID here
If your report is about a specific website which JD supports via plugin, please also provide example URLs which can be used to reproduce the issue you are having.
If your report is related to a login specific problem with a plugin supported website, enable debug mode before creating logs, see previously linked instructions.

Bitte poste deine Log-ID hier.
Falls dein Problem ein Problem mit einer Webseite ist, die per Plugin unterstützt wird, stelle bitte zusätzlich Testlinks zur Verfügung, mit denen sich dein Problem nachstellen lässt.
Geht es um einen nicht funktionierenden Account-Login, aktiviere vor dem Erstellen deines Logs den debug Modus (siehe zuvor verlinkte Anleitung).

-psp-

[Doom]

I haven't really changed anything regarding this on purpose but I did change the way, the imagepositions are generated so maybe that somehow avoided the problem.

Umm it may did the trick, though I will need to test it more to tell.

You mean that archive- and loose images now go intop one package?
Indeed I did change this since the fact that .zip archives went into a separate package was just a mistake by me.
As before, I'am open for suggestions but before doing further changes to the plugin you may want to tell me why you are adding the .zip archives if you do not plan on downloading them?
You can just turn that off under Settings -> e-hentai.org -> Gallery crawl mode -> Do not crawl zip archive

I think it should be separate by default even if it was a mistake by you,
The rars from the archives don't contain the same files, they contains the original full size ver of the images, which cost site points,
I downloaded a rar by mistake after the last changes you did and stopped it midway cause I knew it could get me into troubles,
Usually download the archive cost you points so I was surprised it download for me at all, but stopped it just in case cause I was afarid I may get banned if the site will detect I somehow bypass their point system,

I recommand separate it like before so that people could easily decide which one (full size or compressed ver) they want, and even if they want to download both, if they're already separated things will be better orginized between folders from the git-go.

Please provide a log and example URLs:

Please post your log-ID here
If your report is about a specific website which JD supports via plugin, please also provide example URLs which can be used to reproduce the issue you are having.
If your report is related to a login specific problem with a plugin supported website, enable debug mode before creating logs, see previously linked instructions.

That issue tend to happend to me often when I'm download from a gallery that got many GCs, but sometimes can happend on random galleries too,
The issue seem to rise from a load issue image on the site server end I think, but the site got a button to reload the image from the backup server if the user need to,

So rather than send a log, I was wondering if you can try to download these two links (which I recall to trigger the issue for me) first to see if it's triggerred on your end,

If you won't be able to trigger it yourself I will collect the logs,
The main reason I'm asking if you can spare me from the logs is that it's take time to download stuff from this gallery and the issue been triggerred for me many times on at least each one of the [Escu:de] Re;Lord galleries when I was testing things, so I think you should be able to trigger it fast enough by try to download from one or two of them and could see things firsthand.

**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

[pspzockerscene]

Originally Posted by Doom

I think it should be separate by default even if it was a mistake by you,

Okay I've reverted that change so the .zip and loose images will go into separate packages again.
Said change will go live with the release of our next set of plugin updates.

Originally Posted by Doom

The rars from the archives don't contain the same files, they contains the original full size ver of the images, which cost site points,

That depends on the settings you are using.
If you configure JD to download the original images, the downloaded single images will be the same (original) files as inside the .zip file.

Originally Posted by Doom

So rather than send a log, I was wondering if you can try to download these two links (which I recall to trigger the issue for me) first to see if it's triggerred on your end,

Checking a log is much faster and easier for me.
Your links lead to galleries with over 2000 images in total.
I've test-downloaded 500 of them and I wasn't able to reproduce the problem.
Please provide a log.

I'll be on vacation and tomorrow is the last day I'm online before said vacation so sorry if my next answer will be late.

[Doom]

Okay I've reverted that change so the .zip and loose images will go into separate packages again.
Said change will go live with the release of our next set of plugin updates.

Thx.

That depends on the settings you are using.
If you configure JD to download the original images, the downloaded single images will be the same (original) files as inside the .zip file.

I was referring to how the rars that JD will catch always be the one that got the original size no matter the settings (there are also rars for low size images too), and either way all rars cost points so it's better to download low size images instead.

Checking a log is much faster and easier for me.
Your links lead to galleries with over 2000 images in total.
I've test-downloaded 500 of them and I wasn't able to reproduce the problem.
Please provide a log.

Will post soon, but I know this URL give me the issue currently so you can also try download form it while I wait for some of my stuff to finish download and then posting the log
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Also if I'm already on that, Jdownloader got the option to show download url when you right click on the file,
In exhentai even if you copy the file url from there it will always load the gallery page instead of the image page, that could've spare me a lot of time if it could really open the exact image url and lead me straight to the image that don't want to load when I've got the issue I've mentioed above.

I'll be on vacation and tomorrow is the last day I'm online before said vacation so sorry if my next answer will be late.

It's alright, have fun o/

[Doom]

Alright here the log

08.05.24 06.14.40 <--> 08.05.24 06.27.49 jdlog://1372411370661/

[Doom]

Bumped this thread in case it was forgotten

[pspzockerscene]

Originally Posted by Doom

I was referring to how the rars that JD will catch always be the one that got the original size no matter the settings (there are also rars for low size images too), and either way all rars cost points so it's better to download low size images instead.

Okay understood.
Again: I'am not using e-hentai myself.
If selected, the plugin is always only downloading the original archive.
Should I update the text inside the settings to make this clear?

Originally Posted by Doom

Also if I'm already on that, Jdownloader got the option to show download url when you right click on the file,
In exhentai even if you copy the file url from there it will always load the gallery page instead of the image page, that could've spare me a lot of time if it could really open the exact image url and lead me straight to the image that don't want to load when I've got the issue I've mentioed above.

There is a setting for this behavior, see:
https://support.jdownloader.org/de/k...iew-added-urls

Originally Posted by Doom

Bumped this thread in case it was forgotten

Looks like that is what happened.

I will reply to your log in a separate post in a moment.

[pspzockerscene]

For the next update:
- Updated settings texts to clarify that .zip download will always download the .zip file containing the original images regardless of the other setting and also updated wording of the other "prefer original quality" setting
- Added "Reload broken image" functionality

More detailed explanation of "Reload broken image":
Whenever a download of a single non-original image fails due to a timeout or a similar error, a a flag will be set and a retry wait of 30 seconds with error "Wait for retry on possibly broken image" will be put on that item.
Starting from that point, every new attempt will make use of the websites' "Reload broken image" button.
The special "broken image flag" will be reset/ignored on the following conditions:
- User resets downloadlink or package containing it
- Download of previously "broken" image is successful
- More than 15 minutes have passed since initial fail (new fail = flag can be set again)

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!
---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

-psp-

[Doom]

Okay understood.
Again: I'am not using e-hentai myself.
If selected, the plugin is always only downloading the original archive.
Should I update the text inside the settings to make this clear?

For the next update:
- Updated settings texts to clarify that .zip download will always download the .zip file containing the original images regardless of the other setting and also updated wording of the other "prefer original quality" setting
- Added "Reload broken image" functionality

Thx

There is a setting for this behavior, see:
https://support.jdownloader.org/de/k...iew-added-urls

Thx will give it a try.

More detailed explanation of "Reload broken image":
Whenever a download of a single non-original image fails due to a timeout or a similar error, a a flag will be set and a retry wait of 30 seconds with error "Wait for retry on possibly broken image" will be put on that item.
Starting from that point, every new attempt will make use of the websites' "Reload broken image" button.
The special "broken image flag" will be reset/ignored on the following conditions:
- User resets downloadlink or package containing it
- Download of previously "broken" image is successful
- More than 15 minutes have passed since initial fail (new fail = flag can be set again)

Thx a lot, will see if it fix it (Though I think it did so far, but I better test it on some random link just to be sure).

[Doom]

I think the issue still happening with the broken image links?
02.07.24 20.32.37 <--> 03.07.24 11.29.56 jdlog://6873411370661/

[pspzockerscene]

Please re-read the thread prefix and the Update-FAQ I linked.
Thanks.

[pspzockerscene]

CORE-Updates have been released!
All announced bugfixes and features are live!
Please update your JDownloader and report any issues you find asap.
If this thread gets marked as "[Solved]" by our forum staff you can still post in it and we will read- and reply to it!

CORE-Updates wurden released!
Alle angekündigten Bugfixes/Features sind nun verfügbar!
Bitte JDownloader updaten und eventuelle Bugs schnellstmöglich an uns melden.
Falls dieser Thread vom Team als "[Erledigt]" markiert wird, kannst du weiterhin darin antworten und wir lesen/beantworten auch solche Threads!

-psp-

[Doom]

Sorry for the trouble, so far it didn't happened again (guess the fixed were included till half week ago or so)

Will report if I ever get the issue again,
Thx for the help o/

[pspzockerscene]

Yap the changes were included in said CORE-update which was released 2024-07-04 which I did announce in my last reply #21.

[Doom]

Seems like Jdownloader still skips mirror files,
It happened to me before since then but I've forgot to report

15.09.24 20.55.37 <--> 15.09.24 23.54.27 jdlog://1555411370661/

Will it be possible to tell it by any mean to NEVER skip mirror files even if it see a file with the same name and file size?
I never wanted it to skip mirrors in the first place yet it automatically does that, I don't mind if it will download the same file and put (1) and onward in the name, I just want it to stop skip things even if ended up putting FileName_(1000) xD.


Edit:
Seems like there's an option to disable it?
The question is how bad it will be to change that?
(I've included a pic).

[pspzockerscene]

@Doom
I really don't mean to be offending but you still did not understand my past post so here is my last attempt to explain why this happens and how to prevent it:

There are two different cases:
1. Files with the same name aka "File already exists". Essentially this case happens when JDownloader sees a file that already exists and wants to download another file with the same name and JDownloader knows that that 2nd same named file is not a mirror but a different file.
2. Files that are detected as mirrors and thus auto skipped since it doesn not make sense to download the _same_file twice.

In you case, the 2nd case is happening but you know that those items are not mirrors so you want to configure JDownloader in a way that it does not detect them as mirrors, leading to case 1 ("file already exists") which allows the upper system to auto rename such items.

Now there are multiple ways to make JDownloader not detect those items as mirrors:
1. Rename them in a way so that each item has a unique filename.
or:
2. Change the setting GeneralSettings.mirrordetectiondecision in a way s othat those items are not detected as a mirror anymore.
We are going to take way #2 here.

I'am not going all the way into details but the following information is mainly used to detect mirrors:
- File name
- File size
- File Hash (md5/sha1 and so on)

The default mirrordetectiondecision setting is "AUTO" which is a bit...let's say not ideal by default.
In the case of e-hentai.com there is very very little information available:
- Filename
- No file size
- No file hash

Based on this information, JDownloader assumes that those same named files must be mirrors.
I can see that I recommended using "FILENAME_FILESIZE" iny my previous reply but that may just be the same as AUTO in this case since no file size is given (if that is the case, I'm sorry).
So, try one of these: SAFE or DISABLED.


If this doesn't help, I'am not willing to provide any more text based support at this stage so if you want to have this "fixed once for all", be prepared to do a Teamviewer live session with me.

Originally Posted by Doom

The question is how bad it will be to change that?

In the worst possible case, you are adding some mirrors and JDownloader will display the "file already exists, what do you want to do?" dialog instead of skipping the mirrors.

Please provide some example links to e-hentai items which will lead to different content but same filenames.

[Doom]

Thx for the info, so far I've set it to disable since my last post and it download stuff just fine and didn't asked me for renames for each file it see twice (could be due to other settings I've changed before, but not sure, it can also be that I've just been lucky),

I really don't care if it will download mirrors even if they have the same hash and I can get rid of them manually, all I've wanted was from JD to stop skip things on its own when it come to mirrors but you told me it wasn't good idea to disable/change the settings regardless iirc,
But as long as it auto rename all files (without popping a window that asks me to do it) and just download everything I've told it to download without doing some mirror checks, I'm good.


I can do some screensharing if it will be needed but the cases are so random with sites like e-hentai that Idk if we hit the jackpot despite that,

For now setting it to disabled seem to do the trick I will report if it will happened again and will be willing do some live seasons if needed to.

[pspzockerscene]

I was just re-asking because I was unable to even trigger this problem since all files in my added e-hentai galleries always had different filenames.

If you find multiple galleries that result with same named items, please post them.

Apart from this:
I'm glad it's working as it should for you now.

[pspzockerscene]

@Doom
Because you look to be very familiar with e-hentai:
When trying to download archives, the following error message may appear:

You do not have enough funds to download this archive. Obtain some Credits or GP and try again.

Is there any way to know in beforehand if it is possible to download archives or a specific archive?
I'm curious because at this moment this is not the case so if a user adds 100 archive items, all of them will be tried which is a waste of time and http requests.