JDownloader Community - Appwork GmbH
 

Notices

Reply
 
Thread Tools Display Modes
  #1  
Old 17.06.2019, 19:17
TomArrow TomArrow is offline
Super Loader
 
Join Date: Sep 2017
Posts: 27
Default Feature Request: Make Google Drive downloader use workaround for data transfer limit

When too many people download a file from Google Drive, a limit is reached and then you can't download a file from Google Drive. But you can actually save said file into your own Google Drive when you are logged in (there's a little button shown on the file's download page with a + symbol), make a copy, and then download that copy without problems.

It can be a bit annoying doing this for many files. Would be very cool if this could be automated in jD2 when you enter Google Drive account data.

Ideally it would work like this:
1. Check if file can be downloaded.
2. If not, check if there is space left in the saved Google Drive account's own drive to copy this file.
3. Make a copy of this file on the saved account.
4. Download or keep downloading from that source.
5. Once download is finished, automatically remove the file from the saved Google Drive account again. (this could be made optional, but I think it should remove them by default or else it will clog up the drive real quick and require user intervention to make it work again.

I don't know how much work it would be to implement, but it's pretty straightforward to do using the normal website interface.
Reply With Quote
  #2  
Old 18.06.2019, 10:33
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default


Problem is that currently google account login is broken/unstable and google announced that they will tighten up security for account login even more so it's unlikely that in near future this login issue will be solved. your idea depends on google account so it's blocked until we've found a solution to google login
__________________
JD-Dev & Server-Admin
Reply With Quote
  #3  
Old 25.06.2019, 02:48
SvicidalBug SvicidalBug is offline
I will play nice!
 
Join Date: Mar 2019
Posts: 4
Default

I believe it's possible to bypass a file's transfer limit by replacing file/d/ in the URL with uc?id= and removing /view?usp=sharing

So the URL **External links are only visible to Support Staff**
Reply With Quote
  #4  
Old 25.06.2019, 11:26
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

Did you verify this by yourself? Just my thoughts but I doubt that Google would make allow such a simple *workaround*.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #5  
Old 25.06.2019, 11:45
Cyberavater Cyberavater is offline
JD Legend
 
Join Date: Feb 2019
Posts: 732
Default

Not working for me,
Example Link:**External links are only visible to Support Staff****External links are only visible to Support Staff**
Alt:**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #6  
Old 25.06.2019, 12:10
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

Same for me, not working
__________________
JD-Dev & Server-Admin
Reply With Quote
  #7  
Old 25.06.2019, 12:37
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,611
Default

for memory this used to be possible like ~4+ years ago. since then they do header or meta redirects forcing/preventing work around
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #8  
Old 25.06.2019, 13:06
SvicidalBug SvicidalBug is offline
I will play nice!
 
Join Date: Mar 2019
Posts: 4
Default

My bad. You're right, it doesn't seem to work anymore. I feel like I had used this trick a few months back though.
Reply With Quote
  #9  
Old 25.06.2019, 13:20
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,611
Default

hard to say. maybe they reintroduced it by mistake, or maybe due to another circumstance which you/others haven't identified.
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #10  
Old 27.06.2019, 02:56
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

On the other side the "import into own account and then download" workaround should always work.
We've been using it for 1-2 other services e.g. pcloud and never had any issues ... but the handling can be complicated and can break down easily.

We should consider to use the official GDrive API for this stuff.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #11  
Old 27.06.2019, 10:29
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

Quote:
Originally Posted by pspzockerscene View Post
On the other side the "import into own account and then download" workaround should always work.
The problem is with google login because they tighten up security more and more and also started to block virtual/headless browser logins
__________________
JD-Dev & Server-Admin
Reply With Quote
  #12  
Old 29.10.2019, 15:18
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Status?
I still was unable to verify whether this workaround is possible for "quota reached" files or not ...

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #13  
Old 10.07.2020, 13:22
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Hi TomArrow,

with the recent updates, we've fixed Google Login so files with "quota exceeded" message that require an account to be downloaded can be downloaded via JD again.

Your proposed workaround would only be required for the 2nd type of "quota exceeded" files.
At this moment we do not have any example URLs for such files and I think they're a rare occurence.

However, if you got some new example URLs of these for us we can try to implement the workaround.

-psp-
EDIT

I'll set this thread to "Solved" for now as the main issue is solved.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #14  
Old 29.09.2021, 17:34
Cyberavater Cyberavater is offline
JD Legend
 
Join Date: Feb 2019
Posts: 732
Default

Hello, try this link;
**External links are only visible to Support Staff****External links are only visible to Support Staff**

It's 2nd type of "quota exceeded" file. For this we need to import this file to own account then download the file. Can you make JD2 automatically import the file to my drive and then download and delete after the file is downloaded? Thanks!
Reply With Quote
  #15  
Old 30.09.2021, 12:31
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Quote:
Originally Posted by Cyberavater View Post
It's 2nd type of "quota exceeded" file.
No it is not.
I'm able to download it even without being logged in a Google account.
It's either the first type of "Quota exceeded" or maybe they're doing these kind of blocks also GEO/IP based now.

Quote:
Originally Posted by Cyberavater View Post
For this we need to import this file to own account then download the file.
Also wrong.
AFAIK, this workaround is not possible anymore for over a year or so.
Try it yourself: You can import the file into your Google Drive account but you will not be able to download it.
... then again: Google may change their system at any time so the information I have might be outdated.

Quote:
Originally Posted by Cyberavater View Post
Can you make JD2 automatically import the file to my drive and then download and delete after the file is downloaded?
Regardless of my answers above, this is not planned.
The only way I know of to download content with the second type of "Quote exceeded" (the more aggressive one) is this:
youtu.be/watch?v=0TXze7XC7kY
Please keep in mind that this is not just importing the file into your account - there are more steps involved!
Last time I tested this some months ago it was still working.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #16  
Old 30.09.2021, 17:33
Cyberavater Cyberavater is offline
JD Legend
 
Join Date: Feb 2019
Posts: 732
Default

1. It was yesterday, today it's reset. (it resets in every 24hrs).

2. To try it now I'll need another one of this kind of link (since this one is already reset). I'll report again when I come across them. But Afaik, it works! Maybe we don't import the same way. Try this one (**External links are only visible to Support Staff****External links are only visible to Support Staff**)

>Regardless of my answers above, this is not planned.

3. Then nothing can be done, I guess. If you were interested, you could check rclone and implement it in JD. (it'd give full access to gdrive using oauth which is better than the cookie method in many ways).

Anyways, don't take any offense.
Reply With Quote
  #17  
Old 30.09.2021, 17:42
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

1. Okay.
Still I'd need a real example to test but as said, implementing that workaround is not planned.
We're open source so you're free to do this on your own (please do not take this as an offense either).
AfaIk this was done by using their API back in the days but according to some users they shut this down so now you#d have to use their website-API which is a mess.

2. I'm sorry but I will not connect my gdrive account with this 3rd party app.
I do not understand the need to if it does "the same" than you'd do when manually importing that file into GDrive.

3. Yes I know and yes, oauth login is much nicer but at this moment we do not even support auth with the Google Drive API so there would be tons of work to do.
Also the current mixed API/website handling works pretty well for most of all use cases.
There are some edge cases where you cannot use the API because you will run into limits so yeah the current way is fine if you ask me.
Again you're free to contribute code -> We're open source

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #18  
Old 30.09.2021, 18:15
Cyberavater Cyberavater is offline
JD Legend
 
Join Date: Feb 2019
Posts: 732
Default

2. This is to make the importing process easy. (I suspect that you don't import properly).
If not using the app (altho dummy account can be used for learning purpose), first star the file you want to import, then go to starred, right-click and then make a copy (only works for files, for the folder you'd need OAuth apps).
Simply adding a shortcut is not importing.

3. I'd love to contribute but currently I'm at a very basic stage, (not to mention I never tried java because of other modern languages). I also understand this is a very common response in OSS.

I acknowledge that I don't pay for this work (and JD doesn't provide paid services), and I appreciate what I'm getting for free, so thanks again.
Reply With Quote
  #19  
Old 30.09.2021, 18:38
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

kk

I will mark this as rejected for now.
My guess is also that Google will try to close all of those gaps in the future to prevent ppl from being able to circumvent those limits so after all, adding full Google API support only to add a functionality which they could break at any time might not be the best idea.

And yes I do know about the differences between importing and adding a shortcut to a file.
Al I'm saying is:
For "quota exceeded 2", I was only able to get around it by using the instructions described in that YT video...

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 03:08.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.