JDownloader Community - Appwork GmbH
 

Notices

Reply
 
Thread Tools Display Modes
  #41  
Old 30.06.2022, 18:16
sdi's Avatar
sdi sdi is offline
Wind Gust
 
Join Date: Nov 2010
Posts: 42
Default

I didn't contact upstore. Contacting companies to fix their services seldom leads to positive results, especially when you aren't a paying customer.

I'll do more tests and provide logs, but for this my other downloads need to be finished first :-) Same for the IPv4/v6 issue. Currently I'm running on a IPv6+Ipv4 system with "System" as setting, which should actually be identical to IPV6_IPV4, but I'll test all options.
Reply With Quote
  #42  
Old 30.06.2022, 18:33
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Quote:
Originally Posted by sdi View Post
I didn't contact upstore. Contacting companies to fix their services seldom leads to positive results, especially when you aren't a paying customer.
Yet you're contacting us

Kidding - I know what you mean but as you can see we were unable to make it work so far.
We can't fix serverside issues.
Sometimes workarounds are possible but in this case, so far, not.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #43  
Old 30.06.2022, 19:15
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

@sdi: Please provide some new example links and we can check if we find a pattern or something
__________________
JD-Dev & Server-Admin
Reply With Quote
  #44  
Old 30.06.2022, 19:17
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

Quote:
Originally Posted by sdi View Post
"System" as setting, which should actually be identical to IPV6_IPV4, but I'll test all options.
Currently SYSTEM still is IPV4_IPV6. I have not yet found time to probe OS for OS preference. If you want to make sure IPV6 is preferred then explicit switch to IPV6_IPV4. But for me IPv4 and IPv6 didn't matter at all. Randomly worked in browser/JDownloader, but more often just fails in both
__________________
JD-Dev & Server-Admin
Reply With Quote
  #45  
Old 01.07.2022, 10:04
sdi's Avatar
sdi sdi is offline
Wind Gust
 
Join Date: Nov 2010
Posts: 42
Default

I tried all 4 variants of IP preference with lots of tests each. Didn't make a difference. If system is still IPV4_IPV6 then it's better named "Java" and not "System", because my system preference is IPv6 :-)

I'll try to make proper logs and examples.

I found a short file on upstore itself which seems ideal for tests: **External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #46  
Old 01.07.2022, 13:02
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

@sdi: unfortunately this is a limitation by Java as it *messes/sorts* with the system order.
Java 9 and newer added support to use IP order as returned by system. With next core update this mode will be auto set for Java 11 and newer.
Quote:
java.net.preferIPv6Addresses (default: false)
When dealing with a host which has both IPv4 and IPv6 addresses, and if IPv6 is available on the operating system, the default behavior is to prefer using IPv4 addresses over IPv6 ones. This is to ensure backward compatibility, for example applications that depend on the representation of an IPv4 address (e.g. 192.168.1.1). This property can be set to true to change that preference and use IPv6 addresses over IPv4 ones where possible, or system to preserve the order of the addresses as returned by the operating system.
Due to compatibility reasons,older java default to IPv4 and you will have to add
Quote:
-Djava.net.preferIPv6Addresses=true
as jvm parameter, eg via .vmoptions file, see https://support.jdownloader.org/Know...vmoptions-file

Update: Please know that without next core update, setting preferIPv6Addresses=true will break ClickAndLoad and Browser captchas (Recaptcha,HCaptcha).
__________________
JD-Dev & Server-Admin

Last edited by Jiaz; 01.07.2022 at 16:52.
Reply With Quote
  #47  
Old 01.07.2022, 14:18
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

Quote:
Originally Posted by sdi View Post
I found a short file on upstore itself which seems ideal for tests: **External links are only visible to Support Staff****External links are only visible to Support Staff**
I tried several times but was unable to download, neither in Browser nor in JDownloader
__________________
JD-Dev & Server-Admin
Reply With Quote
  #48  
Old 04.07.2022, 16:59
sdi's Avatar
sdi sdi is offline
Wind Gust
 
Join Date: Nov 2010
Posts: 42
Default

I could download.

Multiple times now I had success with following approach in firefox
* Have a correct clock nearby.
* Start process and remember time.
* When the Captcha comes (to early) fill it, but don't do final send
* Send captcha after 70 seconds.

Would a .har file from firefox for a successful download help?
Reply With Quote
  #49  
Old 04.07.2022, 17:15
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

@sdi: tried several times, did not work a single time
1.) wait 60 secs, captcha, 70 secs, failed
2.) wait 60 secs, captcha, 10 secs failed
3.) wait 60 secs, captcha, 120 secs, failed
4.) wait 60 secs, captcha, failed
same in firefox and chrome

Quote:
Originally Posted by sdi View Post
Would a .har file from firefox for a successful download help?
No, because a har file doesn't help with making it work in by browser

Update: it DID work for me with waiting about 5 mins and more until solving the captcha and then clicking. but just once....
__________________
JD-Dev & Server-Admin

Last edited by Jiaz; 04.07.2022 at 17:33.
Reply With Quote
  #50  
Old 04.07.2022, 17:57
sdi's Avatar
sdi sdi is offline
Wind Gust
 
Join Date: Nov 2010
Posts: 42
Default

That's really a like-hoster :-(

Did you start from scratch? I start always with the original link and also the two checkboxes to fill.
Reply With Quote
  #51  
Old 04.07.2022, 18:17
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

Quote:
Originally Posted by sdi View Post
Did you start from scratch? I start always with the original link and also the two checkboxes to fill.
No I did not, but JDownloader always do. But I can try again by tomorrow
__________________
JD-Dev & Server-Admin
Reply With Quote
  #52  
Old 04.07.2022, 19:01
sdi's Avatar
sdi sdi is offline
Wind Gust
 
Join Date: Nov 2010
Posts: 42
Default

I sent them a message describing the problem.
Reply With Quote
  #53  
Old 05.07.2022, 11:32
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

@sdi: try again with next update.Now I was able to start(at least try to start) with 60 secs waiting captcha, captcha showing up, then solve it but wait 70 secs before clicking button
__________________
JD-Dev & Server-Admin
Reply With Quote
  #54  
Old 07.07.2022, 17:48
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

@Jiaz
Even with your latest changes, it keeps failing for me.
Situation has not changed since the beginning of this thread if you ask me...
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #55  
Old 09.07.2022, 12:35
sdi's Avatar
sdi sdi is offline
Wind Gust
 
Join Date: Nov 2010
Posts: 42
Default

When will the update be available? Didn't see anything until now or did I overlook. I don't see a difference, so I assume I didn't overlook an update.

I now found a way where browser download works for me in 90% of all cases.

Using firefox (counter too fast). Start download, press 2 checkboxes, submit and remember the current second. When captcha gets available (approx after 40 seconds) fill it until finished. Exactly after 71 seconds press the "Get Download Link" button.

I seldom cases when not working remember current time, fill captcha and again after 71 seconds press button. I hadn't a single try in the last days where the second time it did not work. Using Firefox 99 and 101 on two different machines.
Reply With Quote
  #56  
Old 10.07.2022, 15:35
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

Quote:
Originally Posted by sdi View Post
Using firefox (counter too fast).
Can't confirm. Tested on Windows,Mac and Linux with firefox and chrome. Both countdowns are working fine and not too fast/slow. difference was about +/-1 sec
__________________
JD-Dev & Server-Admin
Reply With Quote
  #57  
Old 10.07.2022, 15:36
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

Quote:
Originally Posted by sdi View Post
Using firefox (counter too fast). Start download, press 2 checkboxes, submit and remember the current second. When captcha gets available (approx after 40 seconds) fill it until finished. Exactly after 71 seconds press the "Get Download Link" button.
For me the captcha always shows after after 60 secs. Then I solve it. Should I now wait 71 more secs or just 11? I tried both, and both time not working for me.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #58  
Old 11.07.2022, 12:37
sdi's Avatar
sdi sdi is offline
Wind Gust
 
Join Date: Nov 2010
Posts: 42
Default

In this case 11 seconds including solving the captcha, which is very short I think.

Could you try simulating this in JDownloader?
* Start
* After 40 seconds get the captcha and present it to user to solve
* After 71 (or 40+31) seconds submit the captcha result to upstore.net?

I'll see if I can get the source to compile again. It's a long time since I last contributed.
Reply With Quote
  #59  
Old 11.07.2022, 12:43
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

I'm sorry but I don't get the reason why to try this:
The website will only show the captcha after 60 seconds so why try earlier if we already experimented with this?
Also, because this is an obvious website bug: Why put any more time into this?

You can get our source as described here.
You do not need deep Java knowledge to change the pre download waittime handling of this plugin.

I've changed the prefix of this thread again because even with Jiaz' latest changes I do not see this plugin working for anyone...
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #60  
Old 11.07.2022, 18:52
sdi's Avatar
sdi sdi is offline
Wind Gust
 
Join Date: Nov 2010
Posts: 42
Default

I tested today with source and found one big difference: In the browser there is a cloudflare check which then produces a cookie __cf_bm. In JDownloader that's missing. Seems antiDDoSForHost.java needs adaptions?
Reply With Quote
  #61  
Old 11.07.2022, 19:45
sdi's Avatar
sdi sdi is offline
Wind Gust
 
Join Date: Nov 2010
Posts: 42
Default

I got it reliable to work when I manually inject __cf_bm of my browser (adapting the headers and so on :-).

Needs some code changes to UpstoRe.java, but seems to work.

@Jiaz: Can you fix the Cloudflare stuff?
Reply With Quote
  #62  
Old 11.07.2022, 20:48
sdi's Avatar
sdi sdi is offline
Wind Gust
 
Join Date: Nov 2010
Posts: 42
Default

Ah. It seems cloudflare stuff is not really necessary. I did checkin a variant which works here. Essentially changing the initial page load timeouts and making the captcha handling early, but with late submission. Does this work for you as well?
Reply With Quote
  #63  
Old 12.07.2022, 11:36
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

Quote:
Originally Posted by sdi View Post
Ah. It seems cloudflare stuff is not really necessary.
Cloudflare cookies are not important and never were. I highly doubt that any hoster will make any use of them because they can neither check them for correctness nor read *anything* from them. Those are only valuable for cloudflare.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #64  
Old 12.07.2022, 11:42
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

Quote:
Originally Posted by sdi View Post
but with late submission. Does this work for you as well?
Thanks for your contribution.
First test worked for me. But we'll have to see if it works reliable/better for others too
__________________
JD-Dev & Server-Admin
Reply With Quote
  #65  
Old 12.07.2022, 13:58
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

I can confirm that this works for me but I have no explanation on why...
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #66  
Old 12.07.2022, 15:41
sdi's Avatar
sdi sdi is offline
Wind Gust
 
Join Date: Nov 2010
Posts: 42
Default

I assume that increasing the initial timeouts was the main fix. I increased both to 6 seconds, but probably it's only one of them. I noticed that for my successful tests "c" value was at least 6 seconds higher than the others, where for JDownloader it was only 3.

But there is still a bit to do. They support 2 downloads at the same time, but the second can be started earliest after 1 hour.
Reply With Quote
  #67  
Old 12.07.2022, 15:51
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Is 2 the absolute max for free users or do they allow an unlimited amount of downloads as long as 1 hour is between the download-attempts?
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #68  
Old 12.07.2022, 16:06
sdi's Avatar
sdi sdi is offline
Wind Gust
 
Join Date: Nov 2010
Posts: 42
Default

2 is max as far as I can see. Never got more than 2. When you try a second you get a notice for the waiting time required, but that costs a captcha. It's always 1 hour at least.

After some downloads they have a cooldown phase where no download is possible. That's already handled properly.
Reply With Quote
  #69  
Old 12.07.2022, 16:28
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

I've updated the plugin to allow max 2 free downloads but I won't invest the time to check this now.

To avoid unnecessary captchas, be sure to activate the following setting when testing:
Settings -> Plugins -> upstore.net -> Activate reconnect workaround

I'll commit my changes withing the next few minutes.
EDIT

I've moved this change into another setting (default = disabled) because multiple free downloads may now work for all users or cause other issues.
I was actually able to test it and it worked fine here.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 12.07.2022 at 16:40.
Reply With Quote
  #70  
Old 16.07.2022, 21:29
sdi's Avatar
sdi sdi is offline
Wind Gust
 
Join Date: Nov 2010
Posts: 42
Default

There is still something wrong. With Firefox I get a download rate of about 75KB/s, for JDownloader only 15KB/s.

I increased Firefox version to 102 in Request.java, but that didn't help. Don't know yet what the reason could be. Needs more debugging...
Reply With Quote
  #71  
Old 17.07.2022, 10:20
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

@sdi: always check real speed with taskmanager. My experience is that all browsers have problems with average speed calculation when it comes down to slow/burts speeds.
You can also verify speeds by copying the final link from firefox to JDownloader and check speeds there.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #72  
Old 17.07.2022, 11:22
sdi's Avatar
sdi sdi is offline
Wind Gust
 
Join Date: Nov 2010
Posts: 42
Default

I wasn't born yesterday and verified my assumption before writing. Downloads of JDownloader break after about 1 day whereas the same downloads from Browser are successful after a number of hours. Also checked the time it takes to download 0.5MB by stop watch.
Reply With Quote
  #73  
Old 17.07.2022, 12:01
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

@sdi: can you provide example links? I could not reproduce any speed difference with the dummy 1mb file, was about 75kb/s.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #74  
Old 17.07.2022, 13:58
sdi's Avatar
sdi sdi is offline
Wind Gust
 
Join Date: Nov 2010
Posts: 42
Default

Ill try tomorrow. Today is time for the ice cream shop :-)
Reply With Quote
  #75  
Old 17.07.2022, 14:25
sdi's Avatar
sdi sdi is offline
Wind Gust
 
Join Date: Nov 2010
Posts: 42
Default

One file I tried several times I can give without further testing: **External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #76  
Old 18.07.2022, 00:24
seriousgigi seriousgigi is offline
Junior Loader
 
Join Date: Feb 2020
Posts: 10
Default

i can not even download these from browser too. i believe upstore is kind of swindler site.
Reply With Quote
  #77  
Old 18.07.2022, 16:08
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

@sdi
Downloads with ~70KiB/s here (JD, server: d13.upstore.net).
I have btw. updated the upstore plugin again and optimized the waittime handling (some days ago).

@seriousgigi
Yes it is definitely buggy but it will work fine in JD again after the next update.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 18.07.2022 at 16:28.
Reply With Quote
  #78  
Old 18.07.2022, 16:27
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

@pspzockerscene: for me that file was at 10-15 kb/s
Maybe two different file servers for this link and one fast/the other slow....
__________________
JD-Dev & Server-Admin
Reply With Quote
  #79  
Old 19.07.2022, 15:02
sdi's Avatar
sdi sdi is offline
Wind Gust
 
Join Date: Nov 2010
Posts: 42
Default

Seems this has to do with the header lines. I made mine similar to Firefox and now have >70Kb/s. Now I need to reverse my changes step by step to find the exact reason.
Reply With Quote
  #80  
Old 19.07.2022, 15:28
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Quote:
Originally Posted by sdi View Post
Seems this has to do with the header lines.
Cannot confirm.

Did you check the used dataserver and was it the same?
These tests are only meaningful if tried at similar times with the same file.

Still: Good luck finding a fix for the eventually existing speed-limit.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 12:47.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.