|
#1
|
|||
|
|||
multiple proxy support / automatic rotating list
Hi guys,
I've read in the different threads that you're currently working on the topic. Could you please give use some status about an eventual release date ? In addition, I'd just like to share that: 1) you should not limit the size of the proxy list : why ? most of public proxies won't allow download features, those who does support this have poor performance, so only dedicated or non public proxy are worth using, and there is absolutely no issue of performance or whatever with it. Think about worldwide company proxies for instance. 2) it may be possible to use multiple proxies at the same time, with a configurable "concurrency" option for maximum occurences. 3) using proxies will never harm file hosters more than before ! some other soft downloaders support point1), or point 2). Would be good if JD could support both ! Thank you anyway for your great job ! nz |
#2
|
|||
|
|||
I completely agree with your post. I think it was not possible to implement it in the current download system. For its status, please look at Feature #688 : ProxyList support
Since this "rotating proxy list" feature is one of the most wanted features on this board I wouldn't understand it can't be included in the next version of the download engine. |
#3
|
|||
|
|||
thanks for the information,
and let's cross the fingers nz |
#4
|
|||
|
|||
In the mean time and if you've enough RAM memory, you can run multiple instances of jD with a different proxy server address. Just make copies of your jD folder and start the exe or jar files. Don't forget to split your link lists as well.
|
#5
|
||||
|
||||
@remi:
Have you looked at the Tor network (or Vidalia)? That might help, but it would have to be set up to not change proxies in the middle of a download. |
#6
|
|||
|
|||
If you use jD on the TOR network, be careful for bandwidth hogging if you transfer massive amounts of data. Tor enables Internet anonymity by thwarting network traffic analysis. It should be reserved for people suffering from extremely communist dictatorships.
|
#7
|
|||
|
|||
Multiple simultaneous HTTP proxies
Hi,
What'd you think of this idea: Have JDownloader take a list of HTTP or SOCKS proxies, and it will be able to do multiple downloads from hosts that restrict connections per IP. |
#8
|
|||
|
|||
.
Last edited by remi; 22.01.2010 at 11:03. Reason: redundant because of merge |
#9
|
||||
|
||||
Merged these 2 threads...
GreeZ pspzockerscene
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#10
|
|||
|
|||
Any news on this ?
I heard that someone wrote an updated proxy support which should just be included :-) |
#11
|
|||
|
|||
I Feature #688 I see that "Done" is equal to 0% and the priority is Low.
|
#12
|
|||
|
|||
That's definitely my most wanted feature too.
I have dedicated hosting I normally use as SOCKS proxy for browsing the net. Would love to have jD rotate between my direct internet connection and the proxy when download limits are reached. Also, I too am hoping there are no proxy limits... at least no less than 4 slots (including direct connection as an option). |
#13
|
||||
|
||||
I believe that the developers have the incorrect notion that proxies are not for downloading unless your ISP requires it.
They don't want people using Tor, etc. for downloading. There are proxy manager programs that you can use. You would set JD to use a proxy on Localhost:8080 and the proxy manager program would rotate your proxies from a list. You download a new list daily from Google. |
#14
|
||||
|
||||
Using tor to download something is indeed a VERY VERY bad idea because it's very slow (also because many people use it for downloading -.-) and well i's just not made for downloading...
GreeZ pspzockerscene
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#15
|
|||
|
|||
Quote:
I'm afraid an external proxy app won't be much help since it's not aware of when a new IP is required (in other words, is a fully manual process) otherwise I have a tool called Proxifier that can do that. Damn, that is really bad news. |
#16
|
|||
|
|||
When the event manager comes back an external proxy changer might be a solution.
|
#17
|
||||
|
||||
How about a batch script for Reconnection that tells Proxifier to change proxies?
I bet that would be very popular. |
#18
|
|||
|
|||
Wow, good idea. Can you write that?
|
#19
|
|||
|
|||
the Status of this has been changed two days ago
http://svn.jdownloader.org/issues/show/688 Botzi edited it and said "Already implemented in the ProxyRotation addon." Anyone know where you could get this addon? I cant find it in the Plugins section... |
#20
|
|||
|
|||
It must exist, because there is this recent thread in the Polish forum :- ProxyRotation
This is all I could find. It might be included in the Nightly though. |
#21
|
||||
|
||||
Yes, it is in Nightly (next release). You specify a list of ploxies as hxxp://user:password@ip:port . It also supports SOCKS proxies.
I don't have anymore information about it. I assume that the proxy will be changed each time a reconnect would take place. |
#22
|
|||
|
|||
has it been released yet?
Last edited by zzz; 16.02.2010 at 23:37. |
#23
|
||||
|
||||
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#24
|
|||
|
|||
Thanks sir!
I've downloaded nightly and added some proxy to proxy rotation addon, but it doesn't seem to be using this list (still waiting for new IP), do I need some reconnect script to make it work? |
#25
|
|||
|
|||
Can you find something in your log?
|
#26
|
|||
|
|||
Proxy list is finally supported?! I have not used JD for a long time just because of this feature. I would love to try it out!
Can anyone share me a documentation about how to use it? |
#27
|
||||
|
||||
Shawn,
It is in the test (Nightly version). This is only for experienced users, as there is no guarantee it will work from day to day. On the other hand, I have used Nightly for three months and had only one major problem. To install Nightly (on Windows), exit JDownloader, backup that directory, and set a system restore point (yes, I am being overly cautious). Then execute the windows_ALPHA.bat script. It takes a while, but it upgrades each of your JD files that need to change. Too change back, you use windows_STABLE.bat. Proxy rotation is one of the addons. You check the box next to it and then an item appears in the settings tree (under addons) for Proxy rotation. There is a page for you to list your proxies, one per line. You have to supply your own list of proxies. You can search for "google proxy list" in Google. One of the groups keeps a rotating list of proxy addresses, but it changes daily. The # in the examples are to make those lines comments, don't put a # in your own. Remember, you are testing this for the JDownloader team and users. If it doesn't work at first, please submit a description of the problem, a log, your list of proxies, and a list of URLs you were trying to download. I think it rotates proxies as if it were an Automatic Reconnection, but I do not know whether you have to set Automatic Reconnection to ON or OFF (You tell us here). Thank You and Good Luck
__________________
Please, in each Forum, Read the Rules!.
Spoiler:
General Discussion rules: Rules for all forums
Hoster Plugin rules: Problems with a single host Decrypter Plugin rules: Problems with a single decrypter (link translator) General Bugreport rules: Problems with all hosts or JD itself Suggestions and Wishes rules: Requests for new features or support for new hosts Getting Started with Reconnection: Changing your IP address
Spoiler:
|
#28
|
|||
|
|||
Thank you so much for your great help, drbits!
I will definitely give it a try, but I can not find "windows_ALPHA.bat". The only thing I found is windows_restore.bat and windows_createlog.bat, in jd folder. So, I re-download the zip jD from homepage, but still can not find the bat file. Last edited by shawn8888; 20.02.2010 at 06:22. |
#29
|
|||
|
|||
Quote:
it worked for me |
#30
|
|||
|
|||
Reading the posts on this forum, I wonder whether a sufficient number of people would ever become aware of the possibilities of proxy servers.
I wonder how hosts could ever detect that a particular downloader is using multiple proxy server addresses to download. I think well before the DoS attack would come, hosts will have assembled lists of these proxy server addresses and probably block them. |
#31
|
||||
|
||||
As I wrote above, Proxy Rotation will be part of the next major release of JDownloader. The release is behind the schedule I was given 2 months ago, but I have not heard a new estimate.
As far as I know, the support of multiple concurrent proxies will not be in this release or the next one. Redacted: Last edited by drbits; 24.05.2010 at 23:51. Reason: Redact a statement. |
#32
|
|||
|
|||
Quote:
The advantage is to download more in less time, using free download slots. Of course the software's architecture must be able to support this and as most "insiders" know, this isn't possible yet. |
#33
|
||||
|
||||
Messages 32-40 accidentally deleted in attempt to split thread.
I am sorry for the inconvenience. ------------------------------------------------------------ Multiple Concurrent Proxies has been added as a feature request in the bugtracker for a future version. It is expected that several major projects must be completed before JD is ready for this feature. The request was expanded to include support for multiple network cards (each with its own IP address). Last edited by drbits; 25.05.2010 at 01:10. |
#34
|
|||
|
|||
"multiple concurrent proxies" feature is SO useful and that's why I use another tool most of the time instead of jD.
PLEASE consider it in the next release! |
#35
|
||||
|
||||
It will not be in the next release. It probably won't be in the release after that. However, the proxy rotate addon and the rest of JDownloader are open source. Have at it!
Please consider that every free user that uses multiple concurrent proxies is taking the resources away form other free users. If you are using 10 proxies, then you are attempting to use 5-10 times the bandwidth normally allowed for a free user, thus reducing the slots and/or bandwidth available for everybody else. Add the burden on the proxy network, and you are making a mess. |
#36
|
|||
|
|||
@drbits
Please stop your altruism towards hosts. Are you working for jD or are you representing the file hosts? If I would have the means (mainly disk space) I would use a billion simultaneous proxy servers. @shawn8888 What's the tool you're using? |
#37
|
||||
|
||||
I am not altruistic toward Hosts and the companies that run them. I am just being realistic.
You have been provided with instructions about how to use the Nightly release of JD to do multiple proxies that rotate through separate lists (which is what is required). To implement multiple concurrent rotating proxies correctly, JD would have to keep a list of which proxies had been used with which hosts during the previous 28 (or so) hours. Then when a file is to be downloaded, JD would have to select a proxy at random, check the host list (and possibly repeat until there are no duplicates). This is not a massive job, but it means that each download has to be defined with its own proxy (and make the calls to change to the correct proxy before opening a port). This requires work on the download engine. The other considerations are to detect when there is no proxy available (for example, 20 proxies and 20 downloads from the host). Determining when a proxy has been used or has just made contact requires fixing the status monitoring. Finally, there is an easier way (and the way most of the tools probably do this), that is to just use the proxies in order for each download (starting at different places in the list). This is not as flexible, is easily detected, and does strange things to the proxy loads. The easiest way is to not worry about choosing the proxy, and just keep trying proxies until the host stops complaining that you are out of quota. This is probably unacceptable. |
#38
|
|||
|
|||
The reality I see is that file hosts are operating in a free market. Every week there are hosts that die and new ones are created. jD's business is to ease downloading from them. How they survive is their business. We should not give any advice to them nor warn jD's customers that too much downloading might harm them. As long as they allow downloads I don't see any problem with automating the process. Some people pay for several IP addresses or several proxy servers. They could take advantage of a parallel proxy feature in jD.
As to a technical solution, Bill's tabbed approach might work but I must admit that I do not fully understand it. I've looked at Videophile II, but it doesn't seem to have tabs (as I understand what they are) and it's not a downloading tool neither. FDM's tabs are used for something completely different. |
#39
|
||||
|
||||
I think Bill got a few things confused.
I never said I would try to block users from making the most of JDownloader. What I did say was to use common sense. I will send details via PM, ideas for blocking connections are not for public consumption. |
#40
|
|||
|
|||
What we're talking about are peanuts. You're talking about things only a few people know and fully understand.
Only few people on the Internet download from file hosts. Only few of those people use download tools other than their browser's (this is jD's current potential market). Only few of those people know about proxy servers. Only few of these people would pay for such services to download more. Be sure the smarter file host companies know about the technologies and the potential risks for their businesses. It will cost them always more money to fend off what they consider as "abuse". This means that only the strong companies will survive. The market will have "matured" and psp's maintenance headaches will be over. I think this evolution is unavoidable. It's jD's choice whether they want to stay in business or are overtaken by tools that offer particular features that jD doesn't. This is the real fight/competition. Nevertheless, it remains to be seen whether parallel proxy support is worth the effort, but I wouldn't bet on neglecting it. It might become more than peanuts. |
Thread Tools | |
Display Modes | |
|
|