JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1661  
Old 26.10.2015, 10:39
tony2long's Avatar
tony2long tony2long is offline
English Supporter
 
Join Date: Jun 2009
Posts: 6,235
Default

What do you want to prove? I asked the revision so I can compare.
Your log proves a lot, including that some of your statements are incorrect.
__________________
FAQ: How to upload a Log
Reply With Quote
  #1662  
Old 26.10.2015, 10:43
djmakinera djmakinera is offline
JD Legend
 
Join Date: May 2010
Location: Poland
Posts: 8,353
Default

Quote:
I asked the revision so I can compare.
Hoster:
@HostPlugin(revision="$Revision: 31716 $"


Decrypter:

@DecrypterPlugin(revision="$Revision: 31706 $"

Probably, I'm not sure, but this change?


Code:
 if (this.br.containsHTML("class=\"photos_no_content\"")) {
      throw new DecrypterException("EXCEPTION_LINKOFFLINE");
    }

Last edited by djmakinera; 26.10.2015 at 12:03.
Reply With Quote
  #1663  
Old 26.10.2015, 13:49
tony2long's Avatar
tony2long tony2long is offline
English Supporter
 
Join Date: Jun 2009
Posts: 6,235
Default

That is a correct error handling, doesn't make it faster or slower.
Revision number is inside \jd\plugins\decrypter\VKontakteRu.class.
__________________
FAQ: How to upload a Log
Reply With Quote
  #1664  
Old 26.10.2015, 14:06
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 16,272
Default

get yourself a SVN client if you don't have eclipse setup with JDownloader workspace, and pull history for the vk classes. After you have history you can them pull the different revisions.

raztoki
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #1665  
Old 26.10.2015, 14:11
djmakinera djmakinera is offline
JD Legend
 
Join Date: May 2010
Location: Poland
Posts: 8,353
Default

Not decrypts all links or incomplete albums. All the time block access VK.
Eg. The album online, but it shows the Out Of Date (blocks access to the site)

Many erorrs:
Quote:
Too fast!: You tried to load the same page more than once in one second. Please go back and try again.
Note: Please remember that when you try to open multiple pages at the same time always will result of error, so it's not about that same page only generally about the main page VK!

Installing a new version JD2 http://installer.jdownloader.org/JDownloader.jar and update - does not solve the problem.
Only a change to a previous version of the plug - solves my problem.

In the previous version of the code - there is not found
In the new one it is.
Quote:
if (this.br.containsHTML("class="photos_no_content"")) {
throw new DecrypterException("EXCEPTION_LINKOFFLINE");
}


Developer VKONTAKTE:
Quote:
Possibly they added this error, when you are requesting too many files in one time.

Last edited by djmakinera; 26.10.2015 at 14:39.
Reply With Quote
  #1666  
Old 26.10.2015, 17:15
tony2long's Avatar
tony2long tony2long is offline
English Supporter
 
Join Date: Jun 2009
Posts: 6,235
Default

Quote:
Originally Posted by tony2long View Post
Maybe you open more than 1 JD and decrypt the same album, because you got that message even at the first request on 15-10-24 22:01:30.
Seems we are in a circle...

Handling for that message is available, plugin sleeps 2 seconds and retry. Maybe need to sleep 2 minutes instead, and add logger.info to make it clear. Don't complain it's too slow then. How long you should wait when you get that message in browser?
__________________
FAQ: How to upload a Log
Reply With Quote
  #1667  
Old 26.10.2015, 17:26
djmakinera djmakinera is offline
JD Legend
 
Join Date: May 2010
Location: Poland
Posts: 8,353
Default

I will not explain 100 times, if you do not understand this message error
I am waiting for an answer Jiaz or pspzockerscene.

Last edited by djmakinera; 26.10.2015 at 18:26.
Reply With Quote
  #1668  
Old 27.10.2015, 04:11
tony2long's Avatar
tony2long tony2long is offline
English Supporter
 
Join Date: Jun 2009
Posts: 6,235
Default

No need to wait, I can predict psp's answer:
Quote:
Originally Posted by pspzockerscene View Post
Does not happen here at all.
:biggrin:
__________________
FAQ: How to upload a Log
Reply With Quote
  #1669  
Old 27.10.2015, 07:14
djmakinera djmakinera is offline
JD Legend
 
Join Date: May 2010
Location: Poland
Posts: 8,353
Default

tony2long & Jiaz & pspzockerscene -


Because it depends on the type of links!

Example test:
===========================================================
If I add vk.com/albums-XXXX

It did not show errors

============================================================
If are adding vk.com/albumXXXX_0

Shows errors:
You tried to load the same page more than once in one second. Please go back and try again
----

Add all links with "_0" and check the logs.

**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Last edited by djmakinera; 27.10.2015 at 07:50.
Reply With Quote
  #1670  
Old 27.10.2015, 07:47
tony2long's Avatar
tony2long tony2long is offline
English Supporter
 
Join Date: Jun 2009
Posts: 6,235
Default

Again...
Quote:
Originally Posted by tony2long View Post
... you got that message even at the first request on 15-10-24 22:01:30.
First request = first link. What does it mean?
__________________
FAQ: How to upload a Log
Reply With Quote
  #1671  
Old 27.10.2015, 07:52
djmakinera djmakinera is offline
JD Legend
 
Join Date: May 2010
Location: Poland
Posts: 8,353
Default

tony2long - post #1671


Do this and show me your log.
I'll find bugs!
Have you checked every link and every request very, very precisely???


MANY REQUEST. PLEASE TEST MORE, MORE, MORE LINKS !!!!
Request:
8:57:00 AM - [jd.controlling.linkcrawler.LinkCrawler(crawl)] -> Crawling:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
Request:
8:57:00 AM - [jd.controlling.linkcrawler.LinkCrawler(crawl)] -> Crawling: **External links are only visible to Support Staff****External links are only visible to Support Staff**
Request:
8:57:00 AM - [jd.controlling.linkcrawler.LinkCrawler(crawl)] -> Crawling:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
8:57:00 AM - [jd.controlling.linkcrawler.LinkCrawler(crawl)] -> Crawling: **External links are only visible to Support Staff****External links are only visible to Support Staff**

4 links at the same time = BLOCK
Should:
Crawl URL [1]
wait 1 ... 2 second
Crawl URL [2]
wait 1 ... 2 second
Crawl URL [3]
wait 1 ... 2 second
http://jdownloader.org/pastebin/134499
==================================

Bug1:
[jd.controlling.linkcrawler.LinkCrawler(processHostPlugin)] -> Processing: directxxp://hxxp://vk.com/albumXXXX_0

Edit:
Workaround:
Always add HTTPS (some HTTP links do not work corectly)

Bug2:

18641<!>photos.js,photos.css<!>3<!>3524<!>8<!>You tried to load the same page more than once in one second.<br>Please go back and try again.<br><!><!>34058456

SYSTEM VK detects too many requests if I add more links??? ...
Workaround:

1. Always add HTTPS

2. Request Information

How to change these values?
Connection-Timeout: 120000ms -> 180000ms
Read-Timeout: 60000ms -> 180000ms



3. I have a dynamic IP
Maybe add a function: Auto Terminate All Sessions
Quote:
All sessions except for the current one have been terminated
Error: "You tried to download more than one page of the same type in a second. Go back and try again." It arises from the fact that have initiated multiple sessions connecting to Vkontakte and Security Site.
At the same time, according to the observations of users, the intervals between retries open a site were more than one second.

**External links are only visible to Support Staff****External links are only visible to Support Staff**

Last edited by djmakinera; 28.10.2015 at 01:46.
Reply With Quote
  #1672  
Old 30.10.2015, 07:26
tony2long's Avatar
tony2long tony2long is offline
English Supporter
 
Join Date: Jun 2009
Posts: 6,235
Default

I thought someone else will reply to you, 3 days without any replies...

My system is slow, I never get that message.

"Crawling:" is not a request, this is:
--ID:98TS:1445716890549-15-10-24 22:01:30
----------------Request-------------------------
GET /album297325397_0 HTTP/1.1

Passing info to directHTTP is not a bug, works as designed.

Back to insist for https again? Proof it with log.

Anyway, I changed the decrypter a little, to try variable wait time when you get that message. Update plugin and upload a log to see how it goes.
__________________
FAQ: How to upload a Log
Reply With Quote
  #1673  
Old 30.10.2015, 08:20
djmakinera djmakinera is offline
JD Legend
 
Join Date: May 2010
Location: Poland
Posts: 8,353
Default

So why previous plugin does not generate the error "Too Fast"?
He compared the plug? What has changed?
I gave you the revision numbers in previous posts, so it can check?

Where Is Your log?
How many and what kind of links you tested?

I will not use the new plug-ins. I repeat again. New plugins do not work properly and generate only Block, and block, and block that cause the plug OUT OF date.
If I want to download something that I'm using the previous plug-in, to make sure that I can get everything without ERROR. :D


You tried to load the same page = example: 4 page loading PER SECOND = ALWAYS BLOCK

4 page? but not the same !!!!!!!!!! (This inf: error is misleading!!!) , only different, please understand it very well

vk.com/id1 <=> vk.com/id2 <=> vk.com/id100000000 It is not the same page!


1 page = 0% ERROR
2 or more = ALWAYS ERROR

Please open multiple pages in a browser at the same time = the same block generates JD2

Last edited by djmakinera; 30.10.2015 at 08:43.
Reply With Quote
  #1674  
Old 30.10.2015, 09:14
tony2long's Avatar
tony2long tony2long is offline
English Supporter
 
Join Date: Jun 2009
Posts: 6,235
Default

I have compared them, no changes that make it faster, and I have replied about that.
I don't get problem, no log is needed.

Seems you need to complain to vk, not JD.

If you don't want to use new plugin, please no more complain.
__________________
FAQ: How to upload a Log
Reply With Quote
  #1675  
Old 30.10.2015, 09:25
djmakinera djmakinera is offline
JD Legend
 
Join Date: May 2010
Location: Poland
Posts: 8,353
Default

tony2long - Tell me what is the meaning to send you the log and the log again and again and again log and then say: "do not see any errors"?
Open log in a text editor and search error :D

log.0
log.1
log.2
log.3
log.4

more...


I sent you the previous MY logs
1. Yes?
2. No?

Is the my logs were ERROR
3. Yes?
4. No?

Quote:
Originally Posted by tony2long View Post
I have compared them, no changes that make it faster.
I do not say that the faster only something totally different - you do not read my posts carefully

Many users have a similar problem - look for Russian forum, VK TOPIC etc. (do not know if you understand Russian language) - is this a lot - and you will understand what it is and how to solve this problem

Last edited by djmakinera; 30.10.2015 at 09:54.
Reply With Quote
  #1676  
Old 30.10.2015, 10:50
tony2long's Avatar
tony2long tony2long is offline
English Supporter
 
Join Date: Jun 2009
Posts: 6,235
Default

When did I say that? Post #? My log or your log? I don't get problem, my log is not needed.
1.Yes.
1.Yes, did you read my replies (over and over again)?
That's good, have you join them complain to vk? I don't speak Russian, sorry.
__________________
FAQ: How to upload a Log

Last edited by tony2long; 30.10.2015 at 10:57.
Reply With Quote
  #1677  
Old 30.10.2015, 11:14
djmakinera djmakinera is offline
JD Legend
 
Join Date: May 2010
Location: Poland
Posts: 8,353
Default

tony2long - Vk anti-ddos system detect similar actions, detect not-a-human actions, and TEMP. block

Jiaz - Fix it again?

Old Plugin VERSION (October 2015) works PERFECTLY








[SIZE="1"]VK Developer from Russia view my logs and said:
Quote:
...you are requesting too many page in one time.

NOTE !!!Tested Duration: 22 minutes = reproduce bug
sleep = You tried to load the same page more than once in one second
}
</script>
</body>

</html>

--ID:111TS:1446198012312-10/30/15 10:40:12 AM - [jd.plugins.decrypter.VKontakteRu(getPage)] -> You tried to load the same page more than once in one second, sleep 9 seconds
--ID:111TS:1446198021440-10/30/15 10:40:21 AM - [jd.http.Browser(openRequestConnection)] ->

You tried to load the same page more than once in one second.<br>Please go back and try again.<br>
Spoiler:
--ID:108TS:1446197653266-10/30/15 10:34:13 AM - [jd.plugins.decrypter.VKontakteRu(getPage)] -> You tried to load the same page more than once in one second, sleep 6 seconds
You tried to load the same page more than once in one second.<br>Please go back and try again.<br>
--ID:108TS:1446197659372-10/30/15 10:34:19 AM - [jd.plugins.decrypter.VKontakteRu(getPage)] -> You tried to load the same page more than once in one second, sleep 9 seconds
You tried to load the same page more than once in one second.<br>Please go back and try again.<br>
--ID:112TS:1446197681470-10/30/15 10:34:41 AM - [jd.plugins.decrypter.VKontakteRu(getPage)] -> You tried to load the same page more than once in one second, sleep 6 seconds
You tried to load the same page more than once in one second.<br>Please go back and try again.<br>
--ID:112TS:1446197687587-10/30/15 10:34:47 AM - [jd.plugins.decrypter.VKontakteRu(getPage)] -> You tried to load the same page more than once in one second, sleep 9 seconds
You tried to load the same page more than once in one second.<br>Please go back and try again.<br>
--ID:111TS:1446197705615-10/30/15 10:35:05 AM - [jd.plugins.decrypter.VKontakteRu(getPage)] -> You tried to load the same page more than once in one second, sleep 6 seconds
You tried to load the same page more than once in one second.<br>Please go back and try again.<br>
--ID:111TS:1446197711824-10/30/15 10:35:11 AM - [jd.plugins.decrypter.VKontakteRu(getPage)] -> You tried to load the same page more than once in one second, sleep 9 seconds
You tried to load the same page more than once in one second.<br>Please go back and try again.<br>
--ID:111TS:1446197725330-10/30/15 10:35:25 AM - [jd.plugins.decrypter.VKontakteRu(getPage)] -> You tried to load the same page more than once in one second, sleep 6 seconds
18676<!>photos.js,photos.css<!>3<!>3525<!>8<!>You tried to load the same page more than once in one second.<br>Please go back and try again.<br><!><!>34554673
You tried to load the same page more than once in one second.<br>Please go back and try again.<br>
--ID:112TS:1446197753690-10/30/15 10:35:53 AM - [jd.plugins.decrypter.VKontakteRu(getPage)] -> You tried to load the same page more than once in one second, sleep 6 seconds
You tried to load the same page more than once in one second.<br>Please go back and try again.<br>
--ID:112TS:1446197759794-10/30/15 10:35:59 AM - [jd.plugins.decrypter.VKontakteRu(getPage)] -> You tried to load the same page more than once in one second, sleep 9 seconds
You tried to load the same page more than once in one second.<br>Please go back and try again.<br>
--ID:112TS:1446197775463-10/30/15 10:36:15 AM - [jd.plugins.decrypter.VKontakteRu(getPage)] -> You tried to load the same page more than once in one second, sleep 6 seconds
You tried to load the same page more than once in one second.<br>Please go back and try again.<br>
--ID:112TS:1446197781563-10/30/15 10:36:21 AM - [jd.plugins.decrypter.VKontakteRu(getPage)] -> You tried to load the same page more than once in one second, sleep 9 seconds
You tried to load the same page more than once in one second.<br>Please go back and try again.<br>
--ID:112TS:1446197790664-10/30/15 10:36:30 AM - [jd.plugins.decrypter.VKontakteRu(getPage)] -> You tried to load the same page more than once in one second, sleep 15 seconds
You tried to load the same page more than once in one second.<br>Please go back and try again.<br>
--ID:112TS:1446197513190-10/30/15 10:31:53 AM - [jd.plugins.decrypter.VKontakteRu(getPage)] -> You tried to load the same page more than once in one second, sleep 6 seconds
You tried to load the same page more than once in one second.<br>Please go back and try again.<br>
--ID:112TS:1446197519304-10/30/15 10:31:59 AM - [jd.plugins.decrypter.VKontakteRu(getPage)] -> You tried to load the same page more than once in one second, sleep 9 seconds
You tried to load the same page more than once in one second.<br>Please go back and try again.<br>
--ID:115TS:1446197537855-10/30/15 10:32:17 AM - [jd.plugins.decrypter.VKontakteRu(getPage)] -> You tried to load the same page more than once in one second, sleep 6 seconds
You tried to load the same page more than once in one second.<br>Please go back and try again.<br>
--ID:115TS:1446197543956-10/30/15 10:32:23 AM - [jd.plugins.decrypter.VKontakteRu(getPage)] -> You tried to load the same page more than once in one second, sleep 9 seconds
18676<!>photos.js,photos.css<!>3<!>3525<!>8<!>You tried to load the same page more than once in one second.<br>Please go back and try again.<br><!><!>34554673
18676<!>photos.js,photos.css<!>3<!>3525<!>8<!>You tried to load the same page more than once in one second.<br>Please go back and try again.<br><!><!>34554673
You tried to load the same page more than once in one second.<br>Please go back and try again.<br>
--ID:108TS:1446197590513-10/30/15 10:33:10 AM - [jd.plugins.decrypter.VKontakteRu(getPage)] -> You tried to load the same page more than once in one second, sleep 6 seconds
You tried to load the same page more than once in one second.<br>Please go back and try again.<br>
--ID:110TS:1446197599581-10/30/15 10:33:19 AM - [jd.plugins.decrypter.VKontakteRu(getPage)] -> You tried to load the same page more than once in one second, sleep 6 seconds

Last edited by djmakinera; 30.10.2015 at 12:26.
Reply With Quote
  #1678  
Old 30.10.2015, 12:26
tony2long's Avatar
tony2long tony2long is offline
English Supporter
 
Join Date: Jun 2009
Posts: 6,235
Default

Maybe your old plugin is older then revision 31706.

To go back to old plugin with queue thing (if that's true) , you can ask psp.

I just modified current plugin to handle wait time if you get that message, not to avoid it, and it seems work, you got 6 and 9 seconds wait, so the time needed to wait when you get that message is between 6 and 9 seconds, not more, not less.
__________________
FAQ: How to upload a Log

Last edited by tony2long; 30.10.2015 at 12:33.
Reply With Quote
  #1679  
Old 30.10.2015, 12:31
djmakinera djmakinera is offline
JD Legend
 
Join Date: May 2010
Location: Poland
Posts: 8,353
Default

So what, you can set 6... 9... 100 seconds - it will not change anything:

1. still errors
2. even slower

2 October 2015 = Revision Plugin ?
Hm..

VK Decrypter - BUG|DEFECT
\jd\plugins\decrypter\VKontakteRu.class

---------------------------------

VK Hoster - OK
\jd\plugins\hoster\VKontakteRuHoster.class



Last edited by djmakinera; 30.10.2015 at 12:41.
Reply With Quote
  #1680  
Old 30.10.2015, 12:50
tony2long's Avatar
tony2long tony2long is offline
English Supporter
 
Join Date: Jun 2009
Posts: 6,235
Default

1. That error message is not by JD, plugin error has "Decrypter broken" or "CrawlerPlugin out of date" message.
2. Slower is good, you can not complain "too fast" anymore.
3. What list is it? What for?
__________________
FAQ: How to upload a Log

Last edited by tony2long; 30.10.2015 at 12:58.
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 02:15.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2019, Jelsoft Enterprises Ltd.