JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 29.04.2020, 18:58
snuffleupagus snuffleupagus is offline
Ultra Loader
 
Join Date: Feb 2020
Posts: 48
Default [EventScripter] Disable/ByPass Mirror Detection to allow multiple downloads

Prior to the current release I was able to do the following:

Previous:
Copy a bunch of links from different hosts with same filename add download all of them. (Basically to see which download was the fastest and disable the slowest ones.)

Now:
You are able to do the same until you try to download all of them. Then a message on the status comes up that says Mirror *hostname* is loading.

Request:
how do i get back to the previous functionality where i can allow the other downloads from different hosts start also.
Reply With Quote
  #2  
Old 29.04.2020, 19:18
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 72,936
Default

Simplest solution would be to rename the files.
If the files have same filename, it depends on your Settings->Advanced Settings->GeneralSettings.mirrordetectiondecision. Change to use more than Filename only
There have been no changes here
__________________
JD-Dev & Server-Admin

Last edited by Jiaz; 29.04.2020 at 19:24.
Reply With Quote
  #3  
Old 29.04.2020, 19:30
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,389
Default

hmm Im a little confused with what you stated...

bunch of links from different host but the same file would require 'if file exist rule = rename' to allow multiple downloads of the same file AND what change of what jiaz stated?.

How did you start these? force start?

did you happen reinstall fresh? because default settings never have allowed this.
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #4  
Old 29.04.2020, 19:48
snuffleupagus snuffleupagus is offline
Ultra Loader
 
Join Date: Feb 2020
Posts: 48
Default

Quote:
Originally Posted by Jiaz View Post
Simplest solution would be to rename the files.
If the files have same filename, it depends on your Settings->Advanced Settings->GeneralSettings.mirrordetectiondecision. Change to use more than Filename only
There have been no changes here
Did this an the behavior is the same as described originally.
Reply With Quote
  #5  
Old 29.04.2020, 19:55
snuffleupagus snuffleupagus is offline
Ultra Loader
 
Join Date: Feb 2020
Posts: 48
Default

Quote:
Originally Posted by raztoki View Post
hmm Im a little confused with what you stated...

bunch of links from different host but the same file would require 'if file exist rule = rename' to allow multiple downloads of the same file AND what change of what jiaz stated?.

How did you start these? force start?

did you happen reinstall fresh? because default settings never have allowed this.
thanks for the response.

How did you start these? force start?

- I allow LinkGrabber to grab the links from the clipboard
- select all the links that i want to start downloading and select "Start Downloads"


did you happen reinstall fresh? because default settings never have allowed this.

No fresh reinstall. it just forced updated the jdownloader upon start. Also, I can assure this before was true prior to this list update as I have another computer that also could replicate the previous functionality.


what do you suggest?
Reply With Quote
  #6  
Old 29.04.2020, 20:00
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,389
Default

Strange.
updates do no change your settings typically, so it shouldn't influence this. Only time it would if a setting gets removed/renamed (for new default for instance).

Im not sure what to recommend, see what Jiaz has to say
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #7  
Old 29.04.2020, 20:01
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 59,687
Default

What did you change?
As said, our updates did not change this behavior.
Please go to Settings --> Advanced Settings:
mirrordetectiondecision --> FILENAME_FILESIZE
cleanupafterdownloadaction --> NEVER (= default setting)

Then also change Settings --> General --> If the file already exists --> Auto rename

This way your mirrors should not get recognized as mirrors anymore and you should be able to just download all at the same time.
EDIT
... if this is what you wanted and if I understoof your first post correctly ...

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #8  
Old 29.04.2020, 20:33
snuffleupagus snuffleupagus is offline
Ultra Loader
 
Join Date: Feb 2020
Posts: 48
Default

thank you for the reponse! Yes you did understand the first post correctly.

I reinstalled and set the settings as stated but the results is the same.

**External links are only visible to Support Staff**...
mirror setting

**External links are only visible to Support Staff**...
renaming setting

**External links are only visible to Support Staff**...
hosts

**External links are only visible to Support Staff**...
downloading
Reply With Quote
  #9  
Old 29.04.2020, 21:13
snuffleupagus snuffleupagus is offline
Ultra Loader
 
Join Date: Feb 2020
Posts: 48
Default

I have also created a video of the steps and also the suggestions from the thread but the issue is still the same.

**External links are only visible to Support Staff**View THE VIDEO OF THIS ISSUE

let me know if this helps to illustrate the issue.

Last edited by snuffleupagus; 29.04.2020 at 21:17.
Reply With Quote
  #10  
Old 30.04.2020, 11:42
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 59,687
Default

Hm your issue is still that JD will detect these files as the same files.
Also you did not show your "rename" setting.
Basically you want to do something that JD is not designed to do:
Ignore mirrors and download them anyways.
Things you could try:
  1. Try to set mirrordetectiondecision to "SAFE" and see if that helps.
    or
  2. Make sure all of these files are in different packages --> You will definitly NOT have the "Mirror" issue then.
    or
  3. Rename some of these files --> Then you can put them into the same package and will not have the mirror issue either.
    or
  4. Use en EventScripter script to randomly rename these files BEFORE the download --> This will solve your issue too.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist

Last edited by pspzockerscene; 30.04.2020 at 12:33.
Reply With Quote
  #11  
Old 30.04.2020, 12:32
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 72,936
Default

As pspzockerscene already explained, JDownloader is not designed to download the same file multiple time and there is no way to disable this, except suggested 2, 3 or 4. There is no way to disable MirrorHandling.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #12  
Old 30.04.2020, 20:34
snuffleupagus snuffleupagus is offline
Ultra Loader
 
Join Date: Feb 2020
Posts: 48
Default

Thanks for the suggestions 2,3 and 4 resolved the issue.
Reply With Quote
  #13  
Old 30.04.2020, 20:35
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 72,936
Default

You're welcome! May I ask why you want to download all 3 of them?
__________________
JD-Dev & Server-Admin
Reply With Quote
  #14  
Old 30.04.2020, 20:42
snuffleupagus snuffleupagus is offline
Ultra Loader
 
Join Date: Feb 2020
Posts: 48
Default

Quote:
Originally Posted by Jiaz View Post
You're welcome! May I ask why you want to download all 3 of them?
No problem, I can share. As I shared above. The idea is to download all of them and see which host is the fastest and stop downloading from the slower ones. So I can reduce the download time and maximize the download speed.
Reply With Quote
  #15  
Old 30.04.2020, 20:45
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 72,936
Default

that will only work if your connection speed is higher than the 3 download speeds combined else they will *fight* each other over bandwidth thanks for sharing the reason!
__________________
JD-Dev & Server-Admin
Reply With Quote
  #16  
Old 30.04.2020, 20:51
snuffleupagus snuffleupagus is offline
Ultra Loader
 
Join Date: Feb 2020
Posts: 48
Default

Yeah typically the connection is much higher than the download speed combined. Usually the bottle neck is a the host that I come across. There is always a clear winner when I do this which helps me to get the download faster.

You're welcome!
Reply With Quote
  #17  
Old 02.05.2020, 19:34
snuffleupagus snuffleupagus is offline
Ultra Loader
 
Join Date: Feb 2020
Posts: 48
Default

Sorry to kinda reopen this issue. Since I've been working with the suggested way. But still missing how Jdownloader worked prior to the update(s).

since workaround #2 - is not under my control. #3 is doable but it's an additional setup. #4 is something that requires a script to be managed which can essentially break whenever.

Desired:
- all mirror links downloads without user intervention without saying "Mirror *hostname* is loading."

Because I'm almost certain that it was behaving differently (as desired) before these updates.


questions if you don't mind me asking:
- other than manually renaming the mirrored downloads. Is there a way to automatically do this? So at least the desired behavior returns?

I was looking at the renaming option but nothing supported the original functionality.
**External links are only visible to Support Staff**
Reply With Quote
  #18  
Old 02.05.2020, 20:50
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,389
Default

updates have not caused this to our knowledge, as in no changes to the core have been made for mirror handling in a long time. So once again its not the caused by updating your client directly, maybe indirectly? Either you changed something in your settings, or maybe your Antivirus software removed cfg file(s) and another was created to replace it with default values. maybe config corruption ? though we have not experienced this ourselves or heard of users experiencing this in numbers. We get some reports though no proof of cause is identified within JD. Usually caused by external factors, like security software interference.

Core updates happen with JD not running, restart client required for them to finish install process and execute a new start of application to utilise. This process prevents prevents most issues with read/write locks. The only time it typically can't is when security software is playing big brother.

Do you have any backups? if so you can revert, or even compare cfg values to see what changed.

When adding new functions to application (and/or in addition to existing) we do not change default setting. The only time we do change a default setting is obviously contains the incorrect value. A introduction of a new function will just be an additional option which user can opt to use.

without changing of settings and desired behaviour I still do not understand how you could start downloading the same mirror multiple times without having different filenames. You physically can not save to the same filename within JD with many links. The only time you can is if they are all in different packages (can be the same name) with different save paths (unique path from the others)!


raztoki
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #19  
Old 02.05.2020, 22:26
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 72,936
Default

Most likely the mirros were not length identical. Default MirrorHandling only kicks in with same filename and length. So it can be different filename (eg spaces and _ and -, many hosters treat special chars differently) or small differences in length.
Your video shows that at first they have different unsafe length and therefore start to download. then on actual download, the final/safe length is known and then the others are marked as mirrors. there have been no changes to MirrorHandling/DownloadWatchDog stuff.
It's not possible to download to the same file at the same time. so filename must have been different for this to work, else auto rename would have kicked in.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #20  
Old 03.05.2020, 04:57
snuffleupagus snuffleupagus is offline
Ultra Loader
 
Join Date: Feb 2020
Posts: 48
Default

thank you for the response. it is greatly appreciate this community is pretty helpful and understanding.

So I'm 100% certain this worked previously not sure what has changed. I've checked with another person who also noted this change and recalled that it worked with all mirrors downloading concurrently.

Quote:
Originally Posted by raztoki View Post
Do you have any backups? if so you can revert, or even compare cfg values to see what changed.
We did revert back to the last backup where it worked but could not reproduce the desired feature. So nothing changed on the systems and antivirus is not the issue. Which leads me to believe that there is something external or something else.

Quote:
Originally Posted by raztoki View Post
I still do not understand how you could start downloading the same mirror multiple times without having different filenames.
On the macOS if you download the same files in the same directory it automatically adds -# to the file. ex <filename>-1.rar <filename>-2.rar etc. Perhaps that's why?

I'm unclear why you would not allow multiple downloads of the same file if they are collected in the same "packages". This should be at the discretion of the user I'd think. perhaps just my workflow. But I feel that my workflow leverages jdownloader more effectively. in my opinion.

Question
- is there a way to disable mirror detection? Since I'd prefer to manually control it if it returns the functionality I desire.
- is there some automated means to rename the same files so the mirrors can be downloaded concurrently?

Last edited by snuffleupagus; 03.05.2020 at 05:02.
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 19:27.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2021, Jelsoft Enterprises Ltd.