JDownloader Community - Appwork GmbH
 

Notices

Reply
 
Thread Tools Display Modes
  #1  
Old 31.05.2019, 17:26
user135711 user135711 is offline
DSL Light User
 
Join Date: Jul 2018
Posts: 34
Default Feature Request: Limit number of downloads/hour

I am trying to download from pluralsight and the account gets blocked if you download more than x videos/hr. Is there any plugin setting that could set this?

something similar to the domain rules I found here:
Quote:
Originally Posted by raztoki View Post
You can already do this
'main menu > settings > max con per host' as a global setting
or you can set a specific connection limit in advanced settings, I've been using this for youtube for 1-2+ years
'settings > advanced settings > GeneralSettings: Domain Rules'
Code:
[ {
  "domainPattern" : ".*youtube\\.com",
  "filenamePattern" : null,
  "accountPattern" : null,
  "enabled" : true,
  "maxSimultanDownloads" : 1,
  "allowToExceedTheGlobalLimit" : false
} ]

Last edited by user135711; 31.05.2019 at 17:31.
Reply With Quote
  #2  
Old 03.06.2019, 12:14
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

The plugin already sets some requests limits but x videos/hour is not supported. I would suggest to make use of eventscripter and write a script that automatically checks for x downloads/hours and then disables waiting links and enable them after some timeout again, please check https://board.jdownloader.org/showthread.php?t=70525
Ask mgpai for help, he is our script master. I'm sure he will be able to provide a solution for this.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #3  
Old 04.06.2019, 07:39
user135711 user135711 is offline
DSL Light User
 
Join Date: Jul 2018
Posts: 34
Default thanks

If anyone wants to know, I've found the magic secret number that they refuse to disclose upon asking is around 160 unique downloads per hour when they block the account. I'll see how far I can get with a javascript limit.
Reply With Quote
  #4  
Old 04.06.2019, 11:47
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

downloads started/done? then I could add this to plugin
__________________
JD-Dev & Server-Admin
Reply With Quote
  #5  
Old 05.06.2019, 09:45
user135711 user135711 is offline
DSL Light User
 
Join Date: Jul 2018
Posts: 34
Default

Good question, it is actually downloads started. The number encompasses any unique videos viewed by any means regardless of how much of the video watched/accessed.
Reply With Quote
  #6  
Old 05.06.2019, 15:21
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

after next plugin update, jd will limit to 160 in 1 hour timeframe
__________________
JD-Dev & Server-Admin
Reply With Quote
  #7  
Old 06.06.2019, 00:33
user135711 user135711 is offline
DSL Light User
 
Join Date: Jul 2018
Posts: 34
Default

Make it around 150 to be safe. I didn't get the exact number because each trial guess takes a long time. I have to download the videos, wait for the account to be blocked. Wait for the customer support to ask to read the user agreement and agree to not do what I'm doing, agree, then wait for the unblock.
Reply With Quote
  #8  
Old 06.06.2019, 10:32
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

I've set limit to 150 and update is already live
__________________
JD-Dev & Server-Admin
Reply With Quote
  #9  
Old 07.06.2019, 07:12
user135711 user135711 is offline
DSL Light User
 
Join Date: Jul 2018
Posts: 34
Default Lower than 150

:outch: Either the limiter let videos through or I got the number wrong. Try lowering it to 125. It looks like the downloader continues to scan the movies while displaying the message "Account block protection." I'll have to create a new account to verify, because they permanently blocked the one I was using.

Reply With Quote
  #10  
Old 07.06.2019, 07:19
user135711 user135711 is offline
DSL Light User
 
Join Date: Jul 2018
Posts: 34
Default

Ah, I see. I think the plugin did work, but there is more than one limit. This time they measured over 4 hours instead of 1 hour, so maybe a second limit of less than 400 per 4 hours or just 100 per hour: Their logs show I had 428 total requests in 240 minutes. Before they were citing over 1 hour periods.

Last edited by user135711; 07.06.2019 at 08:12.
Reply With Quote
  #11  
Old 11.06.2019, 16:23
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

At the moment the plugin limits account uses to 150 per hour (moving time window) as I did understand your explanation that limit only happens to account itself?
How about 100/hour and 200/4 hours ?
__________________
JD-Dev & Server-Admin
Reply With Quote
  #12  
Old 14.06.2019, 09:40
user135711 user135711 is offline
DSL Light User
 
Join Date: Jul 2018
Posts: 34
Default

Quote:
Originally Posted by Jiaz View Post
How about 100/hour and 200/4 hours ?
Yes, try 100/hour and 200/4 hours and tell me after it's implemented so I can check for you. If you verify/register jdownloader.org to receive tips in brave I'll also send you a $5 tip in bat.

Another good question:I believe the limit only happens to the account, but their logs also include the ip address the request was made from.
Reply With Quote
  #13  
Old 14.06.2019, 18:14
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

Quote:
Originally Posted by user135711 View Post
If you verify/register jdownloader.org to receive tips in brave I'll also send you a $5 tip in bat.
See https://my.jdownloader.org/contribute
__________________
JD-Dev & Server-Admin
Reply With Quote
  #14  
Old 14.06.2019, 18:17
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

Will be added with next core update later this day
__________________
JD-Dev & Server-Admin
Reply With Quote
  #15  
Old 14.07.2019, 18:29
user135711 user135711 is offline
DSL Light User
 
Join Date: Jul 2018
Posts: 34
Default pause the download not just block it.

Currently the download continues to scan links after "Account block protection is activated". The message text then changes to "account is missing". It would be more informative for users that don't know what is going on "if account block protection" remained in the message and it would make more sense to pause all of the queued pluralsight downloads rather than continue to scan down them. (But the most important function works. My account was not blocked this time). Then after the elapsed wait, the downloads unpause.

Last edited by user135711; 14.07.2019 at 18:55.
Reply With Quote
  #16  
Old 15.07.2019, 20:29
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

The code only prevents downloads done with the account but it doesn't prevent new downloads to be added. the plugin doesn't know that the account that is required (account is missing) is currently only temp. blocked/disabled. also it's not possible at the moment to show custom error message over "account is missing" but after elapsed wait time, those links should start as well, right?
__________________
JD-Dev & Server-Admin
Reply With Quote
  #17  
Old 16.07.2019, 01:57
user135711 user135711 is offline
DSL Light User
 
Join Date: Jul 2018
Posts: 34
Default

Quote:
Originally Posted by Jiaz View Post
but after elapsed wait time, those links should start as well, right?
That's not what's happening on my end. It continues to scan down all the links that are already queued till they all end up in "Account is missing" status and then after the 4 hours they remain in the state "account is missing" until you press start again.
Reply With Quote
  #18  
Old 16.07.2019, 10:53
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

Can you provide a screenshot of the Account overview when this happens and maybe also a screenshot of the download list.
*scan down all the links* you mean JDownloader tries to download and marks the file with *Account is missing*?
__________________
JD-Dev & Server-Admin
Reply With Quote
  #19  
Old 16.07.2019, 19:38
user135711 user135711 is offline
DSL Light User
 
Join Date: Jul 2018
Posts: 34
Default

It's just the same as the screen shot above. The skipped account is missing gets filled on every line, but as far as I can tell at the end of four hours it doesn't restart the downloads. I'll leave it running again though just to make sure they don't start after four hours.
----
Update-The downloads did not restart after 4 hours. This is very important as the whole benefit of jdownloader is to not have to manually queue up downloads every four hours. When you have time consider implementing this.

Last edited by user135711; 17.07.2019 at 11:42.
Reply With Quote
  #20  
Old 17.07.2019, 12:11
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

Can you check Settings-Accounts if your account shows temp. error?
__________________
JD-Dev & Server-Admin
Reply With Quote
  #21  
Old 17.07.2019, 20:23
user135711 user135711 is offline
DSL Light User
 
Join Date: Jul 2018
Posts: 34
Default

It states:
Account is ok: Premium Account:Individual Microsoft.

The problem is it only scans the queue once, and when the account is blocked it will pass over all links and never return.
Reply With Quote
  #22  
Old 17.07.2019, 20:49
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,912
Default

What exactly do you mean by that?
I guess you mean that once "Account missing" is shown, an auto-retry will never happen?
In this case, simply add an account usage rule and block free(non-account) downloads then JD will auto-retry once the account is "ready" again.
Example:
https://support.jdownloader.org/inde...ticle/View/29/

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #23  
Old 18.07.2019, 01:08
user135711 user135711 is offline
DSL Light User
 
Join Date: Jul 2018
Posts: 34
Default

That appears to have worked however jdownloader is just spin waiting and takes up 15% of my cpu. I still think it would be better to truly pause.
Reply With Quote
  #24  
Old 18.07.2019, 13:43
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

Please wait for next update and check again
__________________
JD-Dev & Server-Admin
Reply With Quote
  #25  
Old 19.07.2019, 18:31
user135711 user135711 is offline
DSL Light User
 
Join Date: Jul 2018
Posts: 34
Default

That worked beautifully and finally I got all the wpf videos I wanted, however now it appears the limit has been reached again after about 8 hours because the the downloads are not spaced out. Is it possible to spread the 200 videos evenly over 4 hours rather than at the beginning of hour 1 and 2? Here's the official response:
"Thanks for reaching out. To clarify, we have blocked your account because our security systems have flagged your Pluralsight account for an unusual amount of activity. This means a high volume of requests have occurred every 10-30 seconds for a prolonged period of time. Please note that this high volume of activity is in violation of our terms of service [**External links are only visible to Support Staff****External links are only visible to Support Staff**. I cannot clarify how many videos are too many, only that accounts within Pluralsight should have an individual owner and only their devices linked to their account."
Reply With Quote
  #26  
Old 19.07.2019, 19:23
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

Thanks for the feedback!
I will change to 50/hour and 200/4 hours,okay?
__________________
JD-Dev & Server-Admin

Last edited by Jiaz; 19.07.2019 at 19:30.
Reply With Quote
  #27  
Old 19.07.2019, 21:34
user135711 user135711 is offline
DSL Light User
 
Join Date: Jul 2018
Posts: 34
Default thanks

yes, Let me try that.
Reply With Quote
  #28  
Old 20.07.2019, 18:32
user135711 user135711 is offline
DSL Light User
 
Join Date: Jul 2018
Posts: 34
Default

Ok, Things appear to be working great. Are there any plans to add a datacamp plugin?
Reply With Quote
  #29  
Old 22.07.2019, 12:59
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

Send example links and logins to support@jdownloader.org so we can check possible support
__________________
JD-Dev & Server-Admin
Reply With Quote
  #30  
Old 25.07.2019, 06:40
user135711 user135711 is offline
DSL Light User
 
Join Date: Jul 2018
Posts: 34
Default

Nagini has interesting news, wormtail. Aside from the muggle standing right outside the room, downloading videos through the pluralsight app, and then decrypting them with **External links are only visible to Support Staff**this does not trigger the download limit if you don't watch any of the videos through the app. Just run the CLI with the option to remove the file from the local pluralsight db and watch the decrypted output videos.
Reply With Quote
  #31  
Old 25.07.2019, 12:09
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

As this relies on the pluralsight app which (I guess) is closed source, I can't tell what this app does different and why it doesn't trigger the limit.
__________________
JD-Dev & Server-Admin
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 15:50.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.