JDownloader Community - Appwork GmbH
 

Notices

Reply
 
Thread Tools Display Modes
  #1  
Old 19.12.2017, 06:09
gatorade gatorade is offline
JD Beta
 
Join Date: Dec 2017
Posts: 58
Default Cloud.mail.ru download zip

Now, i added the link to JD to let it download all zip files ((for some weird reason, browser doesn't see them)).... now, take a look in the size downloaded from zip files



it is downloading the file 5, 7 or even 10 time more than the file size really is....
Reply With Quote
  #2  
Old 19.12.2017, 12:55
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

Please provide example links so we can check it
__________________
JD-Dev & Server-Admin
Reply With Quote
  #3  
Old 19.12.2017, 12:56
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

__________________
JD-Dev & Server-Admin
Reply With Quote
  #4  
Old 20.12.2017, 16:59
gatorade gatorade is offline
JD Beta
 
Join Date: Dec 2017
Posts: 58
Default

hey Jiaz,

this is the link to test it...

**External links are only visible to Support Staff****External links are only visible to Support Staff**


Cheers =)
Reply With Quote
  #5  
Old 16.01.2018, 12:13
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

Thanks for the example link. The shown zip file size is wrong because JDownloader parses the folder size shown in browser, which does not show correct one.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #6  
Old 19.01.2018, 22:20
gatorade gatorade is offline
JD Beta
 
Join Date: Dec 2017
Posts: 58
Default

Yeah... i noticed that.... it seems the Mail.ru plugin should be rewritten from the scratch due so many modifications... i dunno... hope you guys find a small time in agenda to fix this part... i really would like to get everything on this link =)
Reply With Quote
  #7  
Old 22.01.2018, 16:25
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

I dont see any need for rewrite. Those are just modifications for a working plugin (besides the feature wishes and wrong shown information)
__________________
JD-Dev & Server-Admin
Reply With Quote
  #8  
Old 22.01.2018, 17:45
tony2long's Avatar
tony2long tony2long is offline
English Supporter
 
Join Date: Jun 2009
Posts: 6,507
Default

It seems that downloading .zip from this host is not a good idea.
When downloading the .zip, server never shows file size, so download method can't make correction.
I tried the small course: /9781784397654/ - 94 MB, stopped at 18 MB, corrupted file.
I tried with browser, similar thing, got corrupted smaller file.

The first file in reported picture - course: /9781787127074/ 3.13 GB, JD shows: 306 KB which is the size of index.html
Decrypter plugin can be changed to get that size, 3.13 GB.
__________________
FAQ: How to upload a Log
Reply With Quote
  #9  
Old 22.01.2018, 17:53
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

In case the zip download is buggy/unstable even in browser, we should either remove it or make it default disabled
__________________
JD-Dev & Server-Admin
Reply With Quote
  #10  
Old 22.01.2018, 23:56
gatorade gatorade is offline
JD Beta
 
Join Date: Dec 2017
Posts: 58
Default

Quote:
Originally Posted by Jiaz View Post
In case the zip download is buggy/unstable even in browser, we should either remove it or make it default disabled
I think, as long it is not working at all, it will be a nice idea to make it disabled by default, because someone could try to use JD to download something from there and if it didn't works, this person will leave JD behind and try another one =\

No?
Reply With Quote
  #11  
Old 24.01.2018, 18:06
tony2long's Avatar
tony2long tony2long is offline
English Supporter
 
Join Date: Jun 2009
Posts: 6,507
Default

So you don't want to try download small .zip file?
Maybe different region gets different result...
If you have example link with small size like 10 MB, I'd like to try.
__________________
FAQ: How to upload a Log
Reply With Quote
  #12  
Old 25.01.2018, 10:10
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

@tony2long: i would disable zip feature by defaultif it doesnt work reliable
__________________
JD-Dev & Server-Admin
Reply With Quote
  #13  
Old 25.01.2018, 10:48
tony2long's Avatar
tony2long tony2long is offline
English Supporter
 
Join Date: Jun 2009
Posts: 6,507
Default

@Jiaz
In setConfigElements, default is false.
Size limit is set to 4 GB, I guess it's not reliable since the beginning.
__________________
FAQ: How to upload a Log
Reply With Quote
  #14  
Old 25.01.2018, 19:57
gatorade gatorade is offline
JD Beta
 
Join Date: Dec 2017
Posts: 58
Default

Quote:
Originally Posted by tony2long View Post
So you don't want to try download small .zip file?
Maybe different region gets different result...
If you have example link with small size like 10 MB, I'd like to try.
If its possible, I want to download everything from this folder.... zip, txt, mp4... everything =)

Quote:
Originally Posted by tony2long View Post
@Jiaz
In setConfigElements, default is false.
Size limit is set to 4 GB, I guess it's not reliable since the beginning.
so it seems it will happens as I stated at the beginning.... rewrite from the scratch =(


Really hope you guys could find a spare time for this =D
Reply With Quote
  #15  
Old 25.01.2018, 19:58
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

Just disable zip support in plugin and JDownloader should download all files individually
__________________
JD-Dev & Server-Admin
Reply With Quote
  #16  
Old 27.01.2018, 16:50
gatorade gatorade is offline
JD Beta
 
Join Date: Dec 2017
Posts: 58
Default

Quote:
Originally Posted by Jiaz View Post
Just disable zip support in plugin and JDownloader should download all files individually
yeah, but there is no point as long it will download all files in one folder... and to sort out will be worse than wait =\
Reply With Quote
  #17  
Old 09.02.2018, 10:14
tony2long's Avatar
tony2long tony2long is offline
English Supporter
 
Join Date: Jun 2009
Posts: 6,507
Default

Decreased the limit down to 10 MB, above that .zip link won't be created, the download failing itself is not JD's fault, happens also with browser.
Size has been corrected as well.
__________________
FAQ: How to upload a Log
Reply With Quote
  #18  
Old 09.02.2018, 18:05
gatorade gatorade is offline
JD Beta
 
Join Date: Dec 2017
Posts: 58
Default

Quote:
Originally Posted by tony2long View Post
Decreased the limit down to 10 MB, above that .zip link won't be created, the download failing itself is not JD's fault, happens also with browser.
Size has been corrected as well.
superb then! So now, is it safe to download the zip files to complete what I already have here? =)



cheers =)


PS: any news about the other issue? the one I cant download directly form Mail.ru? =)
Reply With Quote
  #19  
Old 09.02.2018, 18:10
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

What other issue? You mean the folder structure or what?
__________________
JD-Dev & Server-Admin
Reply With Quote
  #20  
Old 10.02.2018, 16:16
tony2long's Avatar
tony2long tony2long is offline
English Supporter
 
Join Date: Jun 2009
Posts: 6,507
Default

@gatorade
No! The smallest folder that I can find from that courses is 94 MB, far above 10 MB, so if you want to try once again, go on, if still fails, report to their support or delete all of your zip links of that courses. The sizes of your zip links are wrong, we can't correct those. Next time if you re-add, you won't get any .zip from those courses because the limit is now up to 10 MB only.
__________________
FAQ: How to upload a Log
Reply With Quote
  #21  
Old 11.02.2018, 16:45
gatorade gatorade is offline
JD Beta
 
Join Date: Dec 2017
Posts: 58
Default

Quote:
Originally Posted by Jiaz View Post
What other issue? You mean the folder structure or what?
Yup! Exactly! The folder structure one from here

https://board.jdownloader.org/showthread.php?t=75960

its still happening =\


Quote:
Originally Posted by tony2long View Post
@gatorade
No! The smallest folder that I can find from that courses is 94 MB, far above 10 MB, so if you want to try once again, go on, if still fails, report to their support or delete all of your zip links of that courses. The sizes of your zip links are wrong, we can't correct those. Next time if you re-add, you won't get any .zip from those courses because the limit is now up to 10 MB only.
Ok then.... but, i don't know how you downloaded the zip files from the browser... they don't even shows to me.... any folder I downloaded got the zip files... is there any black magic behind it? =)

And the zip issue relays on the server side then? =\
Reply With Quote
  #22  
Old 11.02.2018, 18:36
tony2long's Avatar
tony2long tony2long is offline
English Supporter
 
Join Date: Jun 2009
Posts: 6,507
Default

Right click the folder then choose second choice "Скачать".
__________________
FAQ: How to upload a Log
Reply With Quote
  #23  
Old 14.02.2018, 19:37
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

@gatorade: Structure support will be available with next plugin update
__________________
JD-Dev & Server-Admin
Reply With Quote
  #24  
Old 20.02.2018, 21:15
gatorade gatorade is offline
JD Beta
 
Join Date: Dec 2017
Posts: 58
Default

Quote:
Originally Posted by tony2long View Post
Right click the folder then choose second choice "Скачать".
Chrome, firefox and Opera... any of these browsers were able to finish the download... all of them always stop at 22% or less.... I really don't know what black magic / sorcery you guys do to finish the download... I can get the smallest and the biggest folder... and it even gets to 22%.... most of time stops at 10% =(.... i might be dumb =\

Quote:
Originally Posted by Jiaz View Post
@gatorade: Structure support will be available with next plugin update
Guys... you nailed completely!!!! CONGRATULATIONS!!! Superb!!!

I knew I made the right choice waiting until you guys could sort it out this issue =)


quick question... i have downloaded a few folders already... if I ask to JD to download in the same root folder where these folders are, JD it will recognize the folders / videos and skip them?



Cheers =)


PS: this is weird.... JD now gets some zip files, but, the most important ones, not.... any idea?? =)
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Last edited by gatorade; 20.02.2018 at 21:28.
Reply With Quote
  #25  
Old 21.02.2018, 10:51
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

Please provide example links for the zip file question

JDownloader will ask/skip/overwrite according your settings in
Settings-General-File exists
__________________
JD-Dev & Server-Admin
Reply With Quote
  #26  
Old 21.02.2018, 17:01
gatorade gatorade is offline
JD Beta
 
Join Date: Dec 2017
Posts: 58
Default

Quote:
Originally Posted by Jiaz View Post
Please provide example links for the zip file question

JDownloader will ask/skip/overwrite according your settings in
Settings-General-File exists
Jiaz... is still the exactly same link... try it yourself with the provided link from the beginning of this thread and you will see....

is still this one

**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #27  
Old 21.02.2018, 17:28
tony2long's Avatar
tony2long tony2long is offline
English Supporter
 
Join Date: Jun 2009
Posts: 6,507
Default

The limit for zip is set down to 10 MB.

Quote:
Originally Posted by gatorade View Post
Chrome, firefox and Opera... any of these browsers were able to finish the download... all of them always stop at 22% or less.... I really don't know what black magic / sorcery you guys do to finish the download... I can get the smallest and the biggest folder... and it even gets to 22%.... most of time stops at 10% =(.... i might be dumb =\
That is confusing...
__________________
FAQ: How to upload a Log
Reply With Quote
  #28  
Old 21.02.2018, 17:46
gatorade gatorade is offline
JD Beta
 
Join Date: Dec 2017
Posts: 58
Default

Quote:
Originally Posted by tony2long View Post
The limit for zip is set down to 10 MB.
but i think there is any zip bigger than 10mb on lectures folders.... as far I remember, before you guys rewrote the Cloud plugin and accordingly from that image i've posted here, the zip files barely gets 3mb... and I will still see more than just these ones... no?

Quote:
That is confusing...
Even using IDM the download won't finish.... always stops.... Tried to download from a fresh installation of windows on a VM and still, always stop.... =\... this is completely weird behavior =\
Reply With Quote
  #29  
Old 21.02.2018, 17:51
tony2long's Avatar
tony2long tony2long is offline
English Supporter
 
Join Date: Jun 2009
Posts: 6,507
Default

The size was not correct, now it is.
If I set back to 4 GB, you will try to download with JD and report the error here while it's not JD's fault.
__________________
FAQ: How to upload a Log
Reply With Quote
  #30  
Old 21.02.2018, 19:54
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

@tony: those bigger than zip limit should be added as normal files?
__________________
JD-Dev & Server-Admin
Reply With Quote
  #31  
Old 22.02.2018, 03:07
gatorade gatorade is offline
JD Beta
 
Join Date: Dec 2017
Posts: 58
Default

Quote:
Originally Posted by tony2long View Post
The size was not correct, now it is.
If I set back to 4 GB, you will try to download with JD and report the error here while it's not JD's fault.
But, i don't get it... sorry... I might be dumb..... let's recap

- JD was downloading everything to one large folder (fixed) and the zip files were going way beyond their size limits (right?)

- Now zip files CAN be downloaded from Mail (i just downloaded one zip file and its ok... is opening and ok) but it doesn't shows the zip files from lectures folders.... only from other folders but the lecture ones....

is it right so far?

Why now JD can't see the zip files from lectures folders? I just still don't get this part...



Cheers =)
Reply With Quote
  #32  
Old 22.02.2018, 06:05
tony2long's Avatar
tony2long tony2long is offline
English Supporter
 
Join Date: Jun 2009
Posts: 6,507
Default

- JD was downloading everything to one large folder (fixed) and the zip files were going way beyond their size limits (right?)
+ What do you mean by "(fixed)"? It was failed.
+ The size was wrong. The usage of "limit" word here will confuse us (me and you).

- Now zip files CAN be downloaded from Mail (i just downloaded one zip file and its ok... is opening and ok) but it doesn't shows the zip files from lectures folders.... only from other folders but the lecture ones....
+ What is the size of those zip files? You wrote before: "all of them always stop at 22%".
+ I set the limit to 10 MB, so folder of courses (smallest is 94 MB) won't be shown anymore.

Quote:
Originally Posted by gatorade View Post
Guys... you nailed completely!!!! CONGRATULATIONS!!! Superb!!!

I knew I made the right choice waiting until you guys could sort it out this issue =)
If you're happy with that, why do you still insist to download the zip files while you know that large zip download always fails?
__________________
FAQ: How to upload a Log
Reply With Quote
  #33  
Old 22.02.2018, 13:48
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

Quote:
Originally Posted by Jiaz View Post
@tony: those bigger than zip limit should be added as normal files?
@tony: can you modify plugin in case folder size larger than limit to add the files without zip.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #34  
Old 22.02.2018, 14:00
tony2long's Avatar
tony2long tony2long is offline
English Supporter
 
Join Date: Jun 2009
Posts: 6,507
Default

@Jiaz
zip files are just additional, if enabled in plugin setting.
Files in each folder are always grabbed, so after your update, I get many "video" packages for example.
__________________
FAQ: How to upload a Log
Reply With Quote
  #35  
Old 22.02.2018, 14:01
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

Ah okay, thanks for the feedback!
__________________
JD-Dev & Server-Admin
Reply With Quote
  #36  
Old 22.02.2018, 16:25
gatorade gatorade is offline
JD Beta
 
Join Date: Dec 2017
Posts: 58
Default

Quote:
Originally Posted by tony2long View Post
- JD was downloading everything to one large folder (fixed) and the zip files were going way beyond their size limits (right?)
+ What do you mean by "(fixed)"? It was failed.
+ The size was wrong. The usage of "limit" word here will confuse us (me and you).

- Now zip files CAN be downloaded from Mail (i just downloaded one zip file and its ok... is opening and ok) but it doesn't shows the zip files from lectures folders.... only from other folders but the lecture ones....
@tony2long... jD now creates a package for each folder correctly and put all files on each folder correctly... ok... this is what meant by ""fixed""... it just doesn't download the zip files corresponding for each course folder.... for some reason, jD can't see the ZIP files inside the subfolders of Course folder.... please, follow these steps

- copy the link and let jD decrypts the link
- you will see lots and lots of folders (packages) .... right?
- now, filter for - *.zip -.... you will see only 7 zip files.... but, none of them belongs to the subfolders from Course folder.... they belongs to other folders... if you ask JD to download any of these zip files, it will be downloaded flawlessly... you will be able to open, extract the files and everything, but, the most important zip files, the ones on the subfolders of Course folder, for some reason, aren't being decrypted ((or read, i don't know)) by jD....

Hope this can help you guys to sort it out =)

Quote:
+ What is the size of those zip files? You wrote before: "all of them always stop at 22%".
Sorry about that... this was my reply to the post 24, where I was replying you about how to download the folders from the website... sorry for any mistake

Quote:
+ I set the limit to 10 MB, so folder of courses (smallest is 94 MB) won't be shown anymore.
I don't get this part....

Quote:
If you're happy with that, why do you still insist to download the zip files while you know that large zip download always fails?
I'm happy because you guys fixed the problem of packages being decrypted correctly =)... this was a big issue ((at least, for me)).... now, there's only the issue with the zip files inside lecture folders =)

Quote:
Originally Posted by tony2long View Post
@Jiaz
zip files are just additional, if enabled in plugin setting.
Files in each folder are always grabbed, so after your update, I get many "video" packages for example.
Yes, correctly. But, the zip files for these "video" packages aren't there =(



Sorry for any confusion in words, hope now everything can be cleared after this testimonial =)



cheers guys =)
Reply With Quote
  #37  
Old 22.02.2018, 17:16
tony2long's Avatar
tony2long tony2long is offline
English Supporter
 
Join Date: Jun 2009
Posts: 6,507
Default

How many times I should explain...
Folder bigger than 10 MB won't download correctly, so I make it disappear.
If you happy with folder structure, download that. Why do you still insist to download the zip? Those zips in your picture are less than 10 MB, so you could download without problem.

If you still insist to get big zip files, I'll make them appear, but any download problem of those, please don't report here. Agree? Do you still want to try? It will surely fails!
__________________
FAQ: How to upload a Log
Reply With Quote
  #38  
Old 22.02.2018, 21:13
gatorade gatorade is offline
JD Beta
 
Join Date: Dec 2017
Posts: 58
Default

Quote:
Originally Posted by tony2long View Post
How many times I should explain...
Folder bigger than 10 MB won't download correctly, so I make it disappear.
If you happy with folder structure, download that. Why do you still insist to download the zip? Those zips in your picture are less than 10 MB, so you could download without problem.

If you still insist to get big zip files, I'll make them appear, but any download problem of those, please don't report here. Agree? Do you still want to try? It will surely fails!
You mean by folder, is any folder? like these ones?
Spoiler:


Is just to understand and gives you no more headaches with me... sorry if some part was just a misunderstanding....

The zips files shown on jD now are not the ones I need... The important zip files I need are the one inside the lecture folders... these ones belongs to its parent folder...

Yes, I am happy with the folder structure... ok... perfect.... i just wanted the zip files because they are the exercise files and codes needed to be used during the lectures...

The zip files you talking about are the ones from lecture folders? If yes, it might be a good idea to show them, because at least I can right click on them and copy the download link and try to download thru my browser, once I can't see them when I enter in the folder using the website....

If you go to any lecture folder and open it, you will not see any zip files inside.

sorry for any misunderstanding....

Cheers =)

Last edited by tony2long; 23.02.2018 at 05:35. Reason: Spoiler
Reply With Quote
  #39  
Old 23.02.2018, 08:51
tony2long's Avatar
tony2long tony2long is offline
English Supporter
 
Join Date: Jun 2009
Posts: 6,507
Default

Quote:
Originally Posted by gatorade View Post
You mean by folder, is any folder? like these ones?
No, those are packages. I mean any folder from cloud.mail, with browser we can get the zip of it, but download always fails if the size is more than 10 MB, you said that yourself: "always stop at 22% or less" "most of time stops at 10%".

Quote:
Originally Posted by gatorade View Post
If you go to any lecture folder and open it, you will not see any zip files inside.
Quote:
Originally Posted by tony2long View Post
Right click the folder then choose second choice "Скачать".
Quote:
Originally Posted by gatorade View Post
... files and codes needed to be used during the lectures...
Those should also be grabbed, just not placed in one package together with the video files.

Anyhow, I have changed back the code that make zip of folders below 4GB appear.
__________________
FAQ: How to upload a Log
Reply With Quote
  #40  
Old 23.02.2018, 21:04
gatorade gatorade is offline
JD Beta
 
Join Date: Dec 2017
Posts: 58
Default

Quote:
Originally Posted by tony2long View Post
No, those are packages. I mean any folder from cloud.mail, with browser we can get the zip of it, but download always fails if the size is more than 10 MB, you said that yourself: "always stop at 22% or less" "most of time stops at 10%".
Tony.... this issue is when I try to download from the website, as you said in the post #22... is nothing related to jD... when I try to download as you said, all the times the download crashes, but is ONLY i'm using the website, not jD....

Sorry if there were some misunderstanding here...


Quote:
Those should also be grabbed, just not placed in one package together with the video files.
Ok... this might help for now =)


Quote:
Anyhow, I have changed back the code that make zip of folders below 4GB appear.
Superb then! thanks =)



Cheers =)
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 17:37.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.