JD Community
 

Reply
 
Thread Tools Display Modes
  #1  
Old 29.10.2011, 22:39
Arioch1 Arioch1 is offline
Linkgrabbing Monster
 
Join Date: Oct 2011
Posts: 86
Cool Better filehoster's mirrors support

  1. The three links below lead to the same file.
    However, DepositFile restricts filename charset and changes square brackets into underscores. That leads to JD not recognize files being mirrors.
    I think JD is to learn which filename restrictions are set by hosters and detect mirrors no matter those substitutions made.
    • depositfiles.com/files/bq79zjtvk
    • fileserve.com/file/QjCJdKw/[SaHa]_Kaworu_Watashiya_-_Kodomo_no_Jikan_Ch.77_(English).rar
    • filesonic.com/file/2756865315/[SaHa]_Kaworu_Watashiya_-_Kodomo_no_Jikan_Ch.77_(English).rar
  2. The stop button on toolbar stops all the list. That is quite unconventional, for most downloaders it only stops the currently selected download task. Wish "stop/pause/single current task" buttons be added. That also aids in disabling particular download. Currently i have to right-click and "De-activate" which is not intuitive. Sometimes it would be useful to enlist a bunch of URLs but then start them one by one manually. It seems to be not possible with JD, whihch would auto-start everything enlisted...
  3. Worse - that button stopped downloading from Filesonic. That means, when i realized what happened, i now had to wate half-an-hour to re-start downloading from scratch! After 80% were downloaded, start from 0 and 30 minutes lost. I think stop button should not just kill-em-all, but ask me again if i want to stop download that i would be that can NOT be resumed !
  4. Okay, i screwed Filesonic, but the fery same file is mirrored on Fileserve! Get it from there, rather than waiting half-an-hour! No way. That mirror is just blocked. But it should not be blocked by the mirror, which only would became active again after a loooong delay. In the end i had to delete screwed mirror, since even after De-activating it JD still refused to go on with another source!

Last edited by Arioch1; 29.10.2011 at 22:42.
Reply With Quote
  #2  
Old 30.10.2011, 09:34
Think3r's Avatar
Think3r Think3r is offline
(inactive) Too busy...
 
Join Date: Apr 2009
Posts: 3,707
Default

A better mirror support will come with the next major update and concerning your problem with the stop button: that's why we have the button "Stop after current downloads". You're probably right that it should be possible to simply stop some downloads without deactivating them but a lot of things will change with the next major update. So hang out there for a while.
Greetz
__________________
REGELN: Bugreports | RULES: Bugreports

Erste Schritte & Tutorials | Self Help Index | Read Me

JD 2 Beta - FAQ | JD2 Beta - Download

Support Chat

Bitte die Regeln lesen! | Please read the forum rules!

Keep smiling, it's simple!

Last edited by Think3r; 30.10.2011 at 13:56.
Reply With Quote
  #3  
Old 30.10.2011, 11:27
remi remi is offline
JD Legend
 
Join Date: Mar 2009
Location: Absurdistan
Posts: 16,373
Default

@Arioch1

1) The automatic file renaming methods of hosts aren't known as the hosts don't publish them. RS replaces some characters by underscores. You need to know all the details before anyone can implement an antidote. It's possible your final file name might read like ___________-________. That's why I've always insisted that customers should indicate the mirror files manually.

See also , which is one of the oldest outstanding requirements and

4) jD doesn't support resuming downloads from another link/host.
__________________
WikiLeaks is the Intelligence Agency of the People, defending People against the Hypocrisy and the Crimes of the Neo-Communist Power Elites. Governments are like a metastatic cancer.
Reply With Quote
  #4  
Old 30.10.2011, 13:22
Arioch1 Arioch1 is offline
Linkgrabbing Monster
 
Join Date: Oct 2011
Posts: 86
Default

Quote:
Originally Posted by remi View Post
1) The automatic file renaming methods of hosts aren't known as the hosts don't publish them.
True

Quote:
You need to know all the details before anyone can implement an antidote.
False.

Microsoft Office formats were not published, yet people managed to open 90% of documents.
You need some idea about name mangling, then you can made some implementation.
And later you can always learn more and do better.
I think many Hosters plugins are not based on published APIs but rather on HTML page parsing - and while they break sometimes, they work for most time. Though they do not possess complete API specification

Quote:
It's possible your final file name might read like ___________-________.
True.
But not always, yes ?
You can do Bayesian probability here, with underscores here just not counting neither pro nor against the match, only accounting for invariant letters.

There is also metadata, like file length, file timestamp, md5 - which may be or not be available for matcher algorithm, which always be based on probabilities rather than certain knowledge.

Quote:
That's why I've always insisted that customers should indicate the mirror files manually.
They should be able to override FP's and FN's, but that does not mean software is prohibited from making more or less informed guesses :-)

Quote:
4) jD doesn't support resuming downloads from another link/host.
and that is where it can be improved :-)
Reply With Quote
  #5  
Old 30.10.2011, 14:01
remi remi is offline
JD Legend
 
Join Date: Mar 2009
Location: Absurdistan
Posts: 16,373
Cool

Quote:
Originally Posted by Arioch1 View Post
Microsoft Office formats were not published, yet people managed to open 90% of documents.
You need some idea about name mangling, then you can made some implementation.
And later you can always learn more and do better.
I know a company that hired more people analysing these M$ formats than to develop their own product. I think most people have now seen the light and dropped M$ products.

There are two approaches to this replacement issue :-

1) Trial and error like you propose.

2) Systematic analysis: collect all possible replacement options and prepare a set of small files that contain all these possible characters. Upload them and see what happens with the file names. I think this approach is useful when you limit it to the most important hosts.
__________________
WikiLeaks is the Intelligence Agency of the People, defending People against the Hypocrisy and the Crimes of the Neo-Communist Power Elites. Governments are like a metastatic cancer.
Reply With Quote
  #6  
Old 30.10.2011, 14:47
Arioch1 Arioch1 is offline
Linkgrabbing Monster
 
Join Date: Oct 2011
Posts: 86
Default

> that hired more people analysing these M$ formats than to develop their own product
Yes, yes. Run after moving target. There qwwas an article, describing in details why Microsoft every 2 years dropped its own standards and proclaimed next Great Silver Bullet :-)
Don't remember the link and anyway offtopic here.

1st is not trial and error. It is between "iterative approach" of maths and "worse is better" of programming :-)
You just settle the interface, and allow hoster plugins to implement it if they choose to.
Let them jump the wagon at their own pace.

2nd approach, "the Right Thing", sound good if you can "hire more programmers, than..."
Obviously this is not the case. That would never end. New hosters would appear more often, and old hosters would change mangling more often, than that proposed standard would ever be finished. Not saying about "implemented"

And if that sounds disgusting, then consider 1st approach as a mere field experiment, as a way to collect data for later systematic analysis :-)

Last edited by Arioch1; 30.10.2011 at 14:51.
Reply With Quote
  #7  
Old 31.10.2011, 10:33
remi remi is offline
JD Legend
 
Join Date: Mar 2009
Location: Absurdistan
Posts: 16,373
Default

Wouldn't it be useful to know why hosts are renaming the files of their uploaders? Is it because these file names aren't supported by their own platform?

1) Is there any difference between Windoze, Linux and Mac OS file naming standards?

2) Is it because they can't store standard file names in their databases?

3) Is it because they haven't adopted a Universal Character Set or Unicode?
__________________
WikiLeaks is the Intelligence Agency of the People, defending People against the Hypocrisy and the Crimes of the Neo-Communist Power Elites. Governments are like a metastatic cancer.
Reply With Quote
  #8  
Old 31.10.2011, 13:41
Arioch1 Arioch1 is offline
Linkgrabbing Monster
 
Join Date: Oct 2011
Posts: 86
Default

Even on same Linux, depending on used charset (~ windows codepage) there must be different restrictions on national-specific letter.
Apart from files, there may be restrictions on HTTP URLs

I think frankly it would not be useful - hosters are just blackboxes to their users
Reply With Quote
  #9  
Old 31.10.2011, 13:51
remi remi is offline
JD Legend
 
Join Date: Mar 2009
Location: Absurdistan
Posts: 16,373
Default

Do you suggest these hosts should store the original file names in a database/file that can handle all types of characters in file names and then replace the modified file names again with the original file names when downloaded? Would this be technically possible?
__________________
WikiLeaks is the Intelligence Agency of the People, defending People against the Hypocrisy and the Crimes of the Neo-Communist Power Elites. Governments are like a metastatic cancer.
Reply With Quote
  #10  
Old 02.11.2011, 12:04
Arioch1 Arioch1 is offline
Linkgrabbing Monster
 
Join Date: Oct 2011
Posts: 86
Default

I would not suggest anything to filehosters.
One reason - this is useless, they only would hear for their marketing team, not technical stuff.
Another - those hosters are inevitable evil. Inevitable for now.
IMHO there are much better hosters like DropBox/LiveKive w/o all that hastle.
IMHO there are much more modern technologies, than HTTP/FTP, i mean p2p and RSYNC - at least integral hash codes and ability to re-load particular broken piece rather than whole file.


That is surely possible, if both client and server support UTF8-encoded filenames in HTTP 1.1 or FTP 3.0 or WebDAV protocols.
For example - this is exactly what happening on this and 95% other forums. There is no HTML file showthread.php - but rather a program that assembles HTML from pieces and give it like it was a real file.
http://en.wikipedia.org/wiki/Dynamic_web_page
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 01:04.
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.7
Copyright ©2000 - 2014, Jelsoft Enterprises Ltd.