JDownloader Community - Appwork GmbH
 

Notices

Reply
 
Thread Tools Display Modes
  #61  
Old 13.12.2012, 16:49
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,659
Default

done!

The links seem to be transferable from one domain to another. So ill just rename them all to ru
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #62  
Old 12.01.2013, 19:00
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,451
Default iMGSRC.RU - CrawlerPlugin out of date

JD2


[jd.plugins.PluginForDecrypt(decryptLink)] -> CrawlerPlugin out of date

http://jdownloader.org/pastebin/104453

**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #63  
Old 13.01.2013, 18:31
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,659
Default

Think I have fixed it...

they seem to have anti crawler within httpd. So I would advise against mass decrypting!
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #64  
Old 13.01.2013, 21:13
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,451
Default

Spoiler:
Quote:
Originally Posted by raztoki View Post

they seem to have anti crawler within httpd.


Could you write me exactly what that means, and if there are any ways to avoid this?

Well for many years he very massively files download from the side and I do not think that it could be something like this ....



Quote:
So I would advise against mass decrypting!
There are no such things impossible for me (screen).
Spoiler:





Spoiler:
można liczyć gwiazdy , niezliczone jeszcze
i słuchać jak za oknem pięknie grają świerszcze
i choć starań wiele pokładam w dążeniu
by można masowo pobierać z imgsrc.ru mój przyjacielu :D





Edit2:


If you try to parse shows Only a few pictures and stop parsing, error

http://jdownloader.org/pastebin/104531

Last edited by djmakinera; 14.01.2013 at 00:45.
Reply With Quote
  #65  
Old 14.01.2013, 03:06
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,659
Default

Well, the plugin now only processes decrypting one source link at a time.
Plugin is now greatly slowed down due to trying to not trigger imgsrc anticrawling socket timeout stuff. Took a long time to parse all pages and images with you referenced url, but it was the only way I could keep the plugin working.
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #66  
Old 14.01.2013, 03:32
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,451
Default

If parser simulates the user experience and thus can not detect that this program works.

If you do not perform rapid analysis of all links / pages, etc. only in moderation then it has to go.

Testing 1 big album works , jd showing all pics
Reply With Quote
  #67  
Old 14.01.2013, 03:38
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,659
Default

decrypters typically never simulates the user traditional browser.

Thanks for testing
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #68  
Old 14.01.2013, 13:53
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,451
Default

That's not good working properly for a very, very long time. Pasted some links analyze far too long time and slow increase in the number of files ( More than an hour 2000 files jpg {does not seem to be very much})
Unfortunately I had to stop the parsing - it goes really far too long.

I used another program - analyzes pages in minutes. Only throwing more links in the download manager(any not new updates) is already problem, much worse and the support for the full version of this getting worse - even no answer e-mail from support. Already, few people not care about the customers. You buy the program and answers to problems and questions - you do not get and if you get it just deceiving the people that work with them because they do not have time for such help.

Last edited by djmakinera; 14.01.2013 at 14:17.
Reply With Quote
  #69  
Old 14.01.2013, 14:14
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,659
Default

Polish version of English is hard to understand... but as I indicated previously it will be slow. I had to introduce waits to prevent their anti crawling from giving you constant socket errors. Each image within the gallery requires its own page grab, except for the first image on each gallery page. Each page grab has its own random wait time. Only one source link can be processed at a time.
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #70  
Old 14.01.2013, 14:20
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,451
Default

If I paste or auto-paste multiple links not may be in order - without analyzing all the links at one time?

Do I need to add only 1 link? When you analyze only the second link, and so on?
Reply With Quote
  #71  
Old 14.01.2013, 14:44
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,659
Default

JD will queue source links, if it matches the regular expressions. It will only process one source link at a time, until either finishing or errors. Then it processes next in the queue.
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #72  
Old 14.01.2013, 15:25
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,451
Default

JD is using browser firefox? For example, in firefox without ad-block there's no way view pictures to imgsrc.ru - is hidden malicious advertising, which is still in the cards open and sometimes it is so open (Alumu redirect the user to perform a few clicks you). I do not know whether it may also have an impact on decrypter?
Eg in IE9 does not show me these ads

Last edited by djmakinera; 14.01.2013 at 15:32.
Reply With Quote
  #73  
Old 14.01.2013, 15:39
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,659
Default

No JD has its own internal browser. It has absolutely no impact =]
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #74  
Old 15.01.2013, 17:48
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,451
Default

I did a test. Using the plugin for firefox browser "Open multiple addresses..." Pasted over 200 links (I set a few-second delay opening) - also at the same time I started to click on the links already opened pages (or even load times) and did not notice the "overload" of the page. It seems to be a stable server and there is no way to block IP and other blockades.
Reply With Quote
  #75  
Old 09.05.2013, 15:26
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,451
Default imgsrc.ru - very slow processing links

I know this is a Jdownloader but I tested in another program and processes/parse more than 20X faster (Not to be confused with time downloading!)


Too slow parses links
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Average results

Jdownloader
80(+/-) min = 2000 photos

Other program
3...4(+/-) min = 2000 photos

Does not seem that long? Maybe tweak the speed better?

Last edited by djmakinera; 09.05.2013 at 17:31.
Reply With Quote
  #76  
Old 09.05.2013, 18:52
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,659
Default

if I recall correctly, a pile of sleeps were introduced in steps to prevent their anti crawling.
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #77  
Old 09.05.2013, 21:05
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,451
Default

raztoki - Maybe another program uses different processing technique?
Interesting here is the processing technique used...
Always the good work. Never block the program and the high-speed processes links...


_____________________________________________________________________________
679 photos = only 1 minute
**External links are only visible to Support Staff****External links are only visible to Support Staff**

VIDEO TEST ---> **External links are only visible to Support Staff****External links are only visible to Support Staff**
_____________________________________________________________________________

Last edited by djmakinera; 09.05.2013 at 22:57.
Reply With Quote
  #78  
Old 09.05.2013, 23:04
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,143
Default

Anyways, I won't spend any time on that.
If you really want to download that stuff, speed doesn't really matter...

GreeZ psp
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #79  
Old 09.05.2013, 23:32
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,451
Default

in 2025 year this program will be more intelligent :D


Solved!

Last edited by djmakinera; 09.05.2013 at 23:35.
Reply With Quote
  #80  
Old 09.05.2013, 23:46
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,143
Default

Maybe
It's not about intelligence here, it's about NOT attacking other servers

GreeZ pspzockerscene
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 13:55.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.