[Solved] Vk.com Vkontakte.ru - Page 111 - JDownloader Community

djmakinera · #**2201** 12.09.2016, 16:53

I wrote to the developers VK Community and said that the code in the plug is incorrect.

http://116.imagebam.com/download/I-H...D%3D%3D%3D.jpg

djmakinera · #**2202** 12.09.2016, 16:59

Quote:

look, you can't achieve what you're trying todo. It's already controlled within the VK plugin.

VKHoster ? = DOWNLOAD (control not work)
VKDecrypter ? = PARSE (control work)

djmakinera · #**2203** 12.09.2016, 18:32

I know what causes the problem !!!
"My profile(MY HOME PAGE)" JD2 bug (errors)
"Pictures & Audio & Video" User - work

REPRODUCE & test:
Try to many times refresh short time own vk.com/yourprofile(your HOME PAGE).
So, my question is how to avoid loading my profile (my account) in a very short time

http://116.imagebam.com/download/3Qs...M%3D%3D%3D.jpg

raztoki · #**2204** 13.09.2016, 07:14

Quote:

Originally Posted by djmakinera

I wrote to the developers VK Community and said that the code in the plug is incorrect.

http://116.imagebam.com/download/I-H...D%3D%3D%3D.jpg

wrong, you wrote to _**External links are only visible to Support Staff**

Quote:

Originally Posted by djmakinera

VKHoster ? = DOWNLOAD (control not work)
VKDecrypter ? = PARSE (control work)

sigh....
decrypter needs internal retry, since it can't retry.
hoster plugin uses exception handling which allows for retry/temp unavailable, thus you don't need internal plugin handling, you use core function how its intended to work.
Once again you're commenting on something you know little or nothing about. Post after post in the last days you're trying to fix this vk issue within advanced settings or other non related components.

Loading of pages is a GLOBAL restriction on vk.com, its based on loads to page(html) request that you create. It has nothing todo with the same page been loaded 'more than once within a second' that message from vk.com is a lie/misdirection. Before you bring up restriction on api, we hardly use api and the message shown/returned isn't for API its for standard page(html) requests.

Quote:

Originally Posted by djmakinera

I know what causes the problem !!!
"My profile(MY HOME PAGE)" JD2 bug (errors)
"Pictures & Audio & Video" User - work

REPRODUCE & test:
Try to many times refresh short time own vk.com/yourprofile(your HOME PAGE).
So, my question is how to avoid loading my profile (my account) in a very short time

http://116.imagebam.com/download/3Qs...M%3D%3D%3D.jpg

we don't load my profile page specifically, though they might redirect you to that page.

raztoki

djmakinera · #**2205** 13.09.2016, 08:44

raztoki -
I gave only a sample page in English, but like they say on the forum in the Russian (Vk.com/page-XXXXX) language, what I summarize similar answer? Hm? You may not believe me! I do not care. I will not summarize the posts in Russian, unless you know the Russian language, because most developers are Russians. Do you speak Russian?

The old plugin works great, really cool [0% Error "TOO MANY REQUEST.."] but after the update again, is wrong ...
How to restore the old plug-in, which works perfectly. I do not have a backup! :(
You do not want to help me it is not. I will not ask for anything more.
because it does not work for me and I can show on a video, in 5-10 seconds downloading and block and block and block and block and block and block and block and block.
The End.

Ps. 10000% identical error in IMGSRC.RU (TOO MANY REQUEST IN SHORT TIME) you fixed after several updates, I wonder why you can not fix itself in the plug VK?

djmakinera · #**2206** 13.09.2016, 08:54

It is not true that only I have this problem ! :(

Many users of the application has a similar problem and how to solve them. If you do not understand Russian you can translate.
It is not true that only I have this problem.
Many users of the application has a similar problem and how to solve them. If you do not understand Russian you can translate.

Ps. 2
How fast you have internet and PING?
The distance between Australia and servers in Russia.
How fast you download files from VK.
Unless you are using the simultaneous download.
Do you get this error you? So no, can you prove it?

raztoki · #**2207** 13.09.2016, 08:57

Yes I can read Russian with the aid of google translate, or asking friends who speak Russian, what's your point?

All we changed in the last couple weeks is the changes to regex patterns for the new website layout. Old plugin and new plugin are the same in respects to controlling, nothing has changed.

imgsrc isn't vk, they are not related. vk already has request limits applied, don't know how many times I have to tell you this. You clearly don't understand basic English.

raztoki

raztoki · #**2208** 13.09.2016, 09:13

my internet connection is not in question here.
I never said I could or couldn't prove it, so how did this come into the conversation?

All I have said is vk still has controlling, the same it did as months ago when you claim it works. Since nothing has changed in this respect, you need to ask yourself what has? We know vk interface has, maybe they changed something on there side, for example the limits which used to work, might not now. To me that's more likely to be the case, as it's the most logical.

raztoki

djmakinera · #**2209** 16.09.2016, 21:52

Quote:

raztoki:
look, you can't achieve what you're trying todo. It's already controlled within the VK plugin.

Deferred execution vk-api-calls provides a way to collect several API calls and run them all at once via execute method. This approach can speed up , as yo're able to retreive all data need by one shot.

vk.execution() â†’ execution
This method return an Execution object instance.

execution.push(method, [query]) â†’ this
Add an API call to the set.

Arguments are same as in #peformApiCall() except callback â€” no callbacks needed here.

execution.code() â†’ string
Generates code for execution by VK at any point of time.

execution.execute([callback]) â†’ promise/vk-api-calls instance
Runs the execution via #peformApiCall() with 'execute' as first argument.

Example:

Code:

var exec = vk.execution();
 
exec
.push('users.get', {user_ids: 1})
.push('wall.get', {owner_id: 1})
.push('photos.get', {owner_id: 1})
.execute()
.then(function (data) {
    console.log('Name: ' + data[0].response.first_name);
    console.log('Wall posts: ' + data[1].response.count);
    console.log('Photos posts: ' + data[2].response.count);
});

djmakinera · #**2210** 17.09.2016, 00:05

Found Bug:

16.09.16 22.43.21 <--> 16.09.16 23.00.37 jdlog://7560481887641/

at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(Unknown Source)
at java.net.SocketInputStream.read(Unknown Source)
at java.net.SocketInputStream.read(Unknown Source)
at org.bouncycastle.util.io.Streams.readFully(Unknown Source)
at org.bouncycastle.util.io.Streams.readFully(Unknown Source)
at org.bouncycastle.crypto.tls.TlsUtils.readFully(Unknown Source)
at org.bouncycastle.crypto.tls.RecordStream.decodeAndVerify(Unknown Source)
at org.bouncycastle.crypto.tls.RecordStream.readRecord(Unknown Source)
at org.bouncycastle.crypto.tls.TlsProtocol.safeReadRecord(Unknown Source)
at org.bouncycastle.crypto.tls.TlsProtocol.readApplicationData(Unknown Source)
at org.bouncycastle.crypto.tls.TlsInputStream.read(Unknown Source)
at java.io.FilterInputStream.read(Unknown Source)
at java.io.FilterInputStream.read(Unknown Source)
at org.appwork.utils.net.CountingInputStream.read(CountingInputStream.java:62)
at org.appwork.utils.net.LimitedInputStream.read(LimitedInputStream.java:70)
at java.util.zip.InflaterInputStream.fill(Unknown Source)
at java.util.zip.InflaterInputStream.read(Unknown Source)
at java.util.zip.GZIPInputStream.read(Unknown Source)
at java.io.FilterInputStream.read(Unknown Source)
at jd.http.Request.read(Request.java:127)
at jd.http.Request.read(Request.java:717)
at jd.http.Browser.loadConnection(Browser.java:1281)
at jd.http.Browser.getPage(Browser.java:1137)
at jd.http.Browser.getPage(Browser.java:1133)
at jd.plugins.hoster.VKontakteRuHoster.getPageSafe(VKontakteRuHoster.java:760)
at jd.plugins.hoster.VKontakteRuHoster.requestFileInformation(VKontakteRuHoster.java:332)
at jd.plugins.hoster.VKontakteRuHoster.requestFileInformation(VKontakteRuHoster.java:154)
at jd.plugins.PluginForHost.checkLink(PluginForHost.java:1742)
at jd.controlling.linkchecker.LinkChecker.updateAvailableStatus(LinkChecker.java:553)
at jd.controlling.linkchecker.LinkChecker.access$200(LinkChecker.java:38)
at jd.controlling.linkchecker.LinkChecker$1.run(LinkChecker.java:410)

raztoki · #**2211** 17.09.2016, 09:46

Quote:

Originally Posted by djmakinera

Deferred execution vk-api-calls provides a way to collect several API calls and run them all at once via execute method. This approach can speed up , as yo're able to retreive all data need by one shot.

vk.execution() â†’ execution
This method return an Execution object instance.

execution.push(method, [query]) â†’ this
Add an API call to the set.

Arguments are same as in #peformApiCall() except callback â€” no callbacks needed here.

execution.code() â†’ string
Generates code for execution by VK at any point of time.

execution.execute([callback]) â†’ promise/vk-api-calls instance
Runs the execution via #peformApiCall() with 'execute' as first argument.

Example:

Code:

var exec = vk.execution();
 
exec
.push('users.get', {user_ids: 1})
.push('wall.get', {owner_id: 1})
.push('photos.get', {owner_id: 1})
.execute()
.then(function (data) {
    console.log('Name: ' + data[0].response.first_name);
    console.log('Wall posts: ' + data[1].response.count);
    console.log('Photos posts: ' + data[2].response.count);
});

once again it's not the requests to the api which is blocking you, its requests to standard website. And since our tasks are single threads you can not combine tasks, so each job will do its own requests. All requests to VK are rate limited and have been for a very long time!

Quote:

Originally Posted by djmakinera

Found Bug:

16.09.16 22.43.21 <--> 16.09.16 23.00.37 jdlog://7560481887641/

at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(Unknown Source)
at java.net.SocketInputStream.read(Unknown Source)
at java.net.SocketInputStream.read(Unknown Source)
at org.bouncycastle.util.io.Streams.readFully(Unknown Source)
at org.bouncycastle.util.io.Streams.readFully(Unknown Source)
at org.bouncycastle.crypto.tls.TlsUtils.readFully(Unknown Source)
at org.bouncycastle.crypto.tls.RecordStream.decodeAndVerify(Unknown Source)
at org.bouncycastle.crypto.tls.RecordStream.readRecord(Unknown Source)
at org.bouncycastle.crypto.tls.TlsProtocol.safeReadRecord(Unknown Source)
at org.bouncycastle.crypto.tls.TlsProtocol.readApplicationData(Unknown Source)
at org.bouncycastle.crypto.tls.TlsInputStream.read(Unknown Source)
at java.io.FilterInputStream.read(Unknown Source)
at java.io.FilterInputStream.read(Unknown Source)
at org.appwork.utils.net.CountingInputStream.read(CountingInputStream.java:62)
at org.appwork.utils.net.LimitedInputStream.read(LimitedInputStream.java:70)
at java.util.zip.InflaterInputStream.fill(Unknown Source)
at java.util.zip.InflaterInputStream.read(Unknown Source)
at java.util.zip.GZIPInputStream.read(Unknown Source)
at java.io.FilterInputStream.read(Unknown Source)
at jd.http.Request.read(Request.java:127)
at jd.http.Request.read(Request.java:717)
at jd.http.Browser.loadConnection(Browser.java:1281)
at jd.http.Browser.getPage(Browser.java:1137)
at jd.http.Browser.getPage(Browser.java:1133)
at jd.plugins.hoster.VKontakteRuHoster.getPageSafe(VKontakteRuHoster.java:760)
at jd.plugins.hoster.VKontakteRuHoster.requestFileInformation(VKontakteRuHoster.java:332)
at jd.plugins.hoster.VKontakteRuHoster.requestFileInformation(VKontakteRuHoster.java:154)
at jd.plugins.PluginForHost.checkLink(PluginForHost.java:1742)
at jd.controlling.linkchecker.LinkChecker.updateAvailableStatus(LinkChecker.java:553)
at jd.controlling.linkchecker.LinkChecker.access$200(LinkChecker.java:38)
at jd.controlling.linkchecker.LinkChecker$1.run(LinkChecker.java:410)

not a bug, as said in other thread in which you duplicated this. It's a thread dump and is of normal operation to read SSL connection (https).

raztoki

djmakinera · #**2212** 01.10.2016, 11:38

Bug or not bug but code in the plug is defective and causes an infinite number of blocks while downloading.
Still referer wrong.

Code:

This is incorrect referer!
vk.com/feed
vk.com/photoXXX_XXX

Correct referer:

Code:

hxxps://vk.com/al_photos.php

Please refer to the API documentation.

Please fix it:
Example download album:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

and check Referer:
Request Referer:vkontakte.ru_jd.plugins.hoster.VKontakteRuHoster.log

pspzockerscene · #**2213** 07.10.2016, 18:05

Updated Referer again.
It is exactly as I thought it would be: The modified Referer does not change the serverside behavior.

Best regards,
pspzockerscene

djmakinera · #**2214** 07.10.2016, 19:57

Too many request within one second = immediate block download.

Shouldbe:

Quote:

Max one request to this module page (al_photos.php) per second.

Code:

--ID:107TS:1475858655800-16-10-07 18:44:15 -  [jd.http.Browser(loadConnection)] -> 
--ID:108TS:1475858656240-16-10-07 18:44:16 -  [jd.http.Browser(loadConnection)] -> 
--ID:109TS:1475858657300-16-10-07 18:44:17 -  [jd.http.Browser(loadConnection)] -> 
--ID:124TS:1475858656507-16-10-07 18:44:16 -  [jd.http.Browser(loadConnection)] -> 
--ID:126TS:1475858657056-16-10-07 18:44:17 -  [jd.http.Browser(loadConnection)] -> 
--ID:128TS:1475858657091-16-10-07 18:44:17 -  [jd.http.Browser(loadConnection)] -> 
--ID:129TS:1475858657178-16-10-07 18:44:17 -  [jd.http.Browser(loadConnection)] -> 
--ID:131TS:1475858657341-16-10-07 18:44:17 -  [jd.http.Browser(loadConnection)] -> 
--ID:132TS:1475858657542-16-10-07 18:44:17 -  [jd.http.Browser(loadConnection)] -> 
--ID:133TS:1475858657587-16-10-07 18:44:17 -  [jd.http.Browser(loadConnection)] -> 
--ID:134TS:1475858657518-16-10-07 18:44:17 -  [jd.http.Browser(loadConnection)] -> 
--ID:135TS:1475858657827-16-10-07 18:44:17 -  [jd.http.Browser(loadConnection)] -> 
--ID:136TS:1475858657909-16-10-07 18:44:17 -  [jd.http.Browser(loadConnection)] -> 
--ID:137TS:1475858657903-16-10-07 18:44:17 -  [jd.http.Browser(loadConnection)] -> 
--ID:139TS:1475858657978-16-10-07 18:44:17 -  [jd.http.Browser(loadConnection)] -> 
--ID:142TS:1475858658984-16-10-07 18:44:18 -  [jd.http.Browser(loadConnection)] -> 
--ID:143TS:1475858658711-16-10-07 18:44:18 -  [jd.http.Browser(loadConnection)] -> 
--ID:144TS:1475858659078-16-10-07 18:44:19 -  [jd.http.Browser(loadConnection)] -> 
--ID:145TS:1475858660362-16-10-07 18:44:20 -  [jd.http.Browser(loadConnection)] -> 
--ID:150TS:1475858659308-16-10-07 18:44:19 -  [jd.http.Browser(loadConnection)] -> 
--ID:154TS:1475858659680-16-10-07 18:44:19 -  [jd.http.Browser(loadConnection)] -> 
--ID:155TS:1475858660597-16-10-07 18:44:20 -  [jd.http.Browser(loadConnection)] -> 
--ID:156TS:1475858660923-16-10-07 18:44:20 -  [jd.http.Browser(loadConnection)] -> 
--ID:158TS:1475858661221-16-10-07 18:44:21 -  [jd.http.Browser(loadConnection)] -> 
--ID:159TS:1475858660265-16-10-07 18:44:20 -  [jd.http.Browser(loadConnection)] -> 
--ID:162TS:1475858661598-16-10-07 18:44:21 -  [jd.http.Browser(loadConnection)] -> 
--ID:164TS:1475858665625-16-10-07 18:44:25 -  [jd.http.Browser(loadConnection)] -> 
--ID:165TS:1475858665286-16-10-07 18:44:25 -  [jd.http.Browser(loadConnection)] -> 
--ID:166TS:1475858665967-16-10-07 18:44:25 -  [jd.http.Browser(loadConnection)] -> 
--ID:173TS:1475858666974-16-10-07 18:44:26 -  [jd.http.Browser(loadConnection)] -> 
--ID:174TS:1475858667567-16-10-07 18:44:27 -  [jd.http.Browser(loadConnection)] -> 
--ID:175TS:1475858666225-16-10-07 18:44:26 -  [jd.http.Browser(loadConnection)] -> 
--ID:176TS:1475858667957-16-10-07 18:44:27 -  [jd.http.Browser(loadConnection)] -> 
--ID:177TS:1475858668292-16-10-07 18:44:28 -  [jd.http.Browser(loadConnection)] -> 
--ID:178TS:1475858668631-16-10-07 18:44:28 -  [jd.http.Browser(loadConnection)] -> 
--ID:179TS:1475858666636-16-10-07 18:44:26 -  [jd.http.Browser(loadConnection)] -> 
--ID:180TS:1475858669236-16-10-07 18:44:29 -  [jd.http.Browser(loadConnection)] -> 
--ID:181TS:1475858667309-16-10-07 18:44:27 -  [jd.http.Browser(loadConnection)] -> 
--ID:182TS:1475858668997-16-10-07 18:44:28 -  [jd.http.Browser(loadConnection)] -> 
--ID:183TS:1475858669649-16-10-07 18:44:29 -  [jd.http.Browser(loadConnection)] -> 
--ID:184TS:1475858670172-16-10-07 18:44:30 -  [jd.http.Browser(loadConnection)] -> 
--ID:187TS:1475858671005-16-10-07 18:44:31 -  [jd.http.Browser(loadConnection)] -> 
--ID:188TS:1475858670566-16-10-07 18:44:30 -  [jd.http.Browser(loadConnection)] -> 
--ID:201TS:1475858671290-16-10-07 18:44:31 -  [jd.http.Browser(loadConnection)] -> 
--ID:202TS:1475858671698-16-10-07 18:44:31 -  [jd.http.Browser(loadConnection)] -> 
--ID:204TS:1475858672004-16-10-07 18:44:32 -  [jd.http.Browser(loadConnection)] -> 
--ID:205TS:1475858671424-16-10-07 18:44:31 -  [jd.http.Browser(loadConnection)] -> 
--ID:208TS:1475858672199-16-10-07 18:44:32 -  [jd.http.Browser(loadConnection)] -> 
--ID:212TS:1475858672534-16-10-07 18:44:32 -  [jd.http.Browser(loadConnection)] -> 
--ID:95TS:1475858655833-16-10-07 18:44:15 -  [jd.http.Browser(loadConnection)] -> 
--ID:96TS:1475858656563-16-10-07 18:44:16 -  [jd.http.Browser(loadConnection)] -> 
--ID:97TS:1475858656362-16-10-07 18:44:16 -  [jd.http.Browser(loadConnection)] ->

djmakinera · #**2215** 07.10.2016, 22:36

Still bad!
is:
Referer: **External links are only visible to Support Staff****External links are only visible to Support Staff**
===========================
Shouldbe:
Referer: **External links are only visible to Support Staff****External links are only visible to Support Staff**
X-Requested-With: XMLHttpRequest

pspzockerscene · #**2216** 08.10.2016, 12:50

Updated Referer.
I will NOT be watching your "support.jdownloader.org" tickets anymore.
If you open any other tickets with other username --> Ban
I will not answer any vk.com related support.jdownloader.org tickets opened by you!
---

[Please read]=>How/when do I get updates?
Read it carefully BEFORE complaining that something would still be not working!
Update cycles depend on your installed JD version!!

---
[Bitte lesen]=>Wie/wann bekomme ich Updates?
Bitte vollständig lesen bevor ihr euch beschwert, dass etwas immernoch nicht funktionieren würde!
Die Updatezyklen variieren je nach installierter JD Version!!

GreeZ pspzockerscene

djmakinera · #**2217** 10.10.2016, 02:18

I do not know what you mean, that you all my life thought only ban me. Grow up in the end.

Ps. Very true.

djmakinera · #**2218** 10.10.2016, 08:39

Referer is good, but is still missing important entries in the code.
I showed screenshots, but never allow them here!

djmakinera · #**2219** 11.10.2016, 04:47

Decrypt - perfect work.
Still Issue Download (too many request per second!)
error message: "Too fast! You are trying to load too many pages in one second!"
Loading multiple pages photoXXX_XXX (per 1 second !!!) will always result in block download!
Please try to open multiple pages in a browser in a super-short period of time.
I repeat once again. It is not allowed to open multiple pages in one second!
Every millisecond is important.
Html each module should be loaded at an interval of one second.

raztoki · #**2220** 12.10.2016, 02:49

decrypter runs single thread, decrypter uses the same request intervals as hoster, just it runs as single thread vs multithread for download. As stated if you run into issues you can control this by minimising how many downloads start for vkontakte.ru in advanced setting > GeneralSettings.domainrules.

current rule allows for 20 burst in 30 seconds then 334 ms wait

raztoki

Thread Tools
Show Printable Version Email this Page
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

	JDownloader Community Board - Archive - Top
Provided By AppWork GmbH \| Privacy \| Imprint