JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #2201  
Old 12.09.2016, 15:53
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

I wrote to the developers VK Community and said that the code in the plug is incorrect.

http://116.imagebam.com/download/I-H...D%3D%3D%3D.jpg

Last edited by raztoki; 13.09.2016 at 01:23.
Reply With Quote
  #2202  
Old 12.09.2016, 15:59
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

Quote:
look, you can't achieve what you're trying todo. It's already controlled within the VK plugin.
VKHoster ? = DOWNLOAD (control not work)
VKDecrypter ? = PARSE (control work)
Reply With Quote
  #2203  
Old 12.09.2016, 17:32
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

I know what causes the problem !!!
"My profile(MY HOME PAGE)" JD2 bug (errors)
"Pictures & Audio & Video" User - work

REPRODUCE & test:
Try to many times refresh short time own vk.com/yourprofile(your HOME PAGE).
So, my question is how to avoid loading my profile (my account) in a very short time

http://116.imagebam.com/download/3Qs...M%3D%3D%3D.jpg

Last edited by raztoki; 13.09.2016 at 06:10.
Reply With Quote
  #2204  
Old 13.09.2016, 06:14
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,647
Default

Quote:
Originally Posted by djmakinera View Post
I wrote to the developers VK Community and said that the code in the plug is incorrect.

http://116.imagebam.com/download/I-H...D%3D%3D%3D.jpg
wrong, you wrote to _**External links are only visible to Support Staff**
Quote:
Originally Posted by djmakinera View Post
VKHoster ? = DOWNLOAD (control not work)
VKDecrypter ? = PARSE (control work)
sigh....
decrypter needs internal retry, since it can't retry.
hoster plugin uses exception handling which allows for retry/temp unavailable, thus you don't need internal plugin handling, you use core function how its intended to work.
Once again you're commenting on something you know little or nothing about. Post after post in the last days you're trying to fix this vk issue within advanced settings or other non related components.

Loading of pages is a GLOBAL restriction on vk.com, its based on loads to page(html) request that you create. It has nothing todo with the same page been loaded 'more than once within a second' that message from vk.com is a lie/misdirection. Before you bring up restriction on api, we hardly use api and the message shown/returned isn't for API its for standard page(html) requests.

Quote:
Originally Posted by djmakinera View Post
I know what causes the problem !!!
"My profile(MY HOME PAGE)" JD2 bug (errors)
"Pictures & Audio & Video" User - work

REPRODUCE & test:
Try to many times refresh short time own vk.com/yourprofile(your HOME PAGE).
So, my question is how to avoid loading my profile (my account) in a very short time

http://116.imagebam.com/download/3Qs...M%3D%3D%3D.jpg
we don't load my profile page specifically, though they might redirect you to that page.

raztoki
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]

Last edited by raztoki; 13.09.2016 at 06:16.
Reply With Quote
  #2205  
Old 13.09.2016, 07:44
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

raztoki -
I gave only a sample page in English, but like they say on the forum in the Russian (Vk.com/page-XXXXX) language, what I summarize similar answer? Hm? You may not believe me! I do not care. I will not summarize the posts in Russian, unless you know the Russian language, because most developers are Russians. Do you speak Russian?
The old plugin works great, really cool [0% Error "TOO MANY REQUEST.."] but after the update again, is wrong ...
How to restore the old plug-in, which works perfectly. I do not have a backup! :(
You do not want to help me it is not. I will not ask for anything more.
because it does not work for me and I can show on a video, in 5-10 seconds downloading and block and block and block and block and block and block and block and block.
The End.

Ps. 10000% identical error in IMGSRC.RU (TOO MANY REQUEST IN SHORT TIME) you fixed after several updates, I wonder why you can not fix itself in the plug VK?
Reply With Quote
  #2206  
Old 13.09.2016, 07:54
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

It is not true that only I have this problem ! :(

Many users of the application has a similar problem and how to solve them. If you do not understand Russian you can translate.
It is not true that only I have this problem.
Many users of the application has a similar problem and how to solve them. If you do not understand Russian you can translate.

Ps. 2
How fast you have internet and PING?
The distance between Australia and servers in Russia.
How fast you download files from VK.
Unless you are using the simultaneous download.
Do you get this error you? So no, can you prove it?

Last edited by raztoki; 13.09.2016 at 08:01.
Reply With Quote
  #2207  
Old 13.09.2016, 07:57
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,647
Default

Yes I can read Russian with the aid of google translate, or asking friends who speak Russian, what's your point?

All we changed in the last couple weeks is the changes to regex patterns for the new website layout. Old plugin and new plugin are the same in respects to controlling, nothing has changed.

imgsrc isn't vk, they are not related. vk already has request limits applied, don't know how many times I have to tell you this. You clearly don't understand basic English.

raztoki
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #2208  
Old 13.09.2016, 08:13
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,647
Default

my internet connection is not in question here.
I never said I could or couldn't prove it, so how did this come into the conversation?

All I have said is vk still has controlling, the same it did as months ago when you claim it works. Since nothing has changed in this respect, you need to ask yourself what has? We know vk interface has, maybe they changed something on there side, for example the limits which used to work, might not now. To me that's more likely to be the case, as it's the most logical.

raztoki
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]

Last edited by raztoki; 13.09.2016 at 08:30.
Reply With Quote
  #2209  
Old 16.09.2016, 20:52
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

Quote:
raztoki:
look, you can't achieve what you're trying todo. It's already controlled within the VK plugin.
Deferred execution vk-api-calls provides a way to collect several API calls and run them all at once via execute method. This approach can speed up , as yo're able to retreive all data need by one shot.

vk.execution() → execution
This method return an Execution object instance.

execution.push(method, [query]) → this
Add an API call to the set.

Arguments are same as in #peformApiCall() except callback — no callbacks needed here.

execution.code() → string
Generates code for execution by VK at any point of time.

execution.execute([callback]) → promise/vk-api-calls instance
Runs the execution via #peformApiCall() with 'execute' as first argument.

Example:

Code:
var exec = vk.execution();
 
exec
.push('users.get', {user_ids: 1})
.push('wall.get', {owner_id: 1})
.push('photos.get', {owner_id: 1})
.execute()
.then(function (data) {
    console.log('Name: ' + data[0].response.first_name);
    console.log('Wall posts: ' + data[1].response.count);
    console.log('Photos posts: ' + data[2].response.count);
});
Reply With Quote
  #2210  
Old 16.09.2016, 23:05
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

Found Bug:

16.09.16 22.43.21 <--> 16.09.16 23.00.37 jdlog://7560481887641/



at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(Unknown Source)
at java.net.SocketInputStream.read(Unknown Source)
at java.net.SocketInputStream.read(Unknown Source)
at org.bouncycastle.util.io.Streams.readFully(Unknown Source)
at org.bouncycastle.util.io.Streams.readFully(Unknown Source)
at org.bouncycastle.crypto.tls.TlsUtils.readFully(Unknown Source)
at org.bouncycastle.crypto.tls.RecordStream.decodeAndVerify(Unknown Source)
at org.bouncycastle.crypto.tls.RecordStream.readRecord(Unknown Source)
at org.bouncycastle.crypto.tls.TlsProtocol.safeReadRecord(Unknown Source)
at org.bouncycastle.crypto.tls.TlsProtocol.readApplicationData(Unknown Source)
at org.bouncycastle.crypto.tls.TlsInputStream.read(Unknown Source)
at java.io.FilterInputStream.read(Unknown Source)
at java.io.FilterInputStream.read(Unknown Source)
at org.appwork.utils.net.CountingInputStream.read(CountingInputStream.java:62)
at org.appwork.utils.net.LimitedInputStream.read(LimitedInputStream.java:70)
at java.util.zip.InflaterInputStream.fill(Unknown Source)
at java.util.zip.InflaterInputStream.read(Unknown Source)
at java.util.zip.GZIPInputStream.read(Unknown Source)
at java.io.FilterInputStream.read(Unknown Source)
at jd.http.Request.read(Request.java:127)
at jd.http.Request.read(Request.java:717)
at jd.http.Browser.loadConnection(Browser.java:1281)
at jd.http.Browser.getPage(Browser.java:1137)
at jd.http.Browser.getPage(Browser.java:1133)
at jd.plugins.hoster.VKontakteRuHoster.getPageSafe(VKontakteRuHoster.java:760)
at jd.plugins.hoster.VKontakteRuHoster.requestFileInformation(VKontakteRuHoster.java:332)
at jd.plugins.hoster.VKontakteRuHoster.requestFileInformation(VKontakteRuHoster.java:154)
at jd.plugins.PluginForHost.checkLink(PluginForHost.java:1742)
at jd.controlling.linkchecker.LinkChecker.updateAvailableStatus(LinkChecker.java:553)
at jd.controlling.linkchecker.LinkChecker.access$200(LinkChecker.java:38)
at jd.controlling.linkchecker.LinkChecker$1.run(LinkChecker.java:410)
Reply With Quote
  #2211  
Old 17.09.2016, 08:46
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,647
Default

Quote:
Originally Posted by djmakinera View Post
Deferred execution vk-api-calls provides a way to collect several API calls and run them all at once via execute method. This approach can speed up , as yo're able to retreive all data need by one shot.

vk.execution() → execution
This method return an Execution object instance.

execution.push(method, [query]) → this
Add an API call to the set.

Arguments are same as in #peformApiCall() except callback — no callbacks needed here.

execution.code() → string
Generates code for execution by VK at any point of time.

execution.execute([callback]) → promise/vk-api-calls instance
Runs the execution via #peformApiCall() with 'execute' as first argument.

Example:

Code:
var exec = vk.execution();
 
exec
.push('users.get', {user_ids: 1})
.push('wall.get', {owner_id: 1})
.push('photos.get', {owner_id: 1})
.execute()
.then(function (data) {
    console.log('Name: ' + data[0].response.first_name);
    console.log('Wall posts: ' + data[1].response.count);
    console.log('Photos posts: ' + data[2].response.count);
});
once again it's not the requests to the api which is blocking you, its requests to standard website. And since our tasks are single threads you can not combine tasks, so each job will do its own requests. All requests to VK are rate limited and have been for a very long time!

Quote:
Originally Posted by djmakinera View Post
Found Bug:

16.09.16 22.43.21 <--> 16.09.16 23.00.37 jdlog://7560481887641/



at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(Unknown Source)
at java.net.SocketInputStream.read(Unknown Source)
at java.net.SocketInputStream.read(Unknown Source)
at org.bouncycastle.util.io.Streams.readFully(Unknown Source)
at org.bouncycastle.util.io.Streams.readFully(Unknown Source)
at org.bouncycastle.crypto.tls.TlsUtils.readFully(Unknown Source)
at org.bouncycastle.crypto.tls.RecordStream.decodeAndVerify(Unknown Source)
at org.bouncycastle.crypto.tls.RecordStream.readRecord(Unknown Source)
at org.bouncycastle.crypto.tls.TlsProtocol.safeReadRecord(Unknown Source)
at org.bouncycastle.crypto.tls.TlsProtocol.readApplicationData(Unknown Source)
at org.bouncycastle.crypto.tls.TlsInputStream.read(Unknown Source)
at java.io.FilterInputStream.read(Unknown Source)
at java.io.FilterInputStream.read(Unknown Source)
at org.appwork.utils.net.CountingInputStream.read(CountingInputStream.java:62)
at org.appwork.utils.net.LimitedInputStream.read(LimitedInputStream.java:70)
at java.util.zip.InflaterInputStream.fill(Unknown Source)
at java.util.zip.InflaterInputStream.read(Unknown Source)
at java.util.zip.GZIPInputStream.read(Unknown Source)
at java.io.FilterInputStream.read(Unknown Source)
at jd.http.Request.read(Request.java:127)
at jd.http.Request.read(Request.java:717)
at jd.http.Browser.loadConnection(Browser.java:1281)
at jd.http.Browser.getPage(Browser.java:1137)
at jd.http.Browser.getPage(Browser.java:1133)
at jd.plugins.hoster.VKontakteRuHoster.getPageSafe(VKontakteRuHoster.java:760)
at jd.plugins.hoster.VKontakteRuHoster.requestFileInformation(VKontakteRuHoster.java:332)
at jd.plugins.hoster.VKontakteRuHoster.requestFileInformation(VKontakteRuHoster.java:154)
at jd.plugins.PluginForHost.checkLink(PluginForHost.java:1742)
at jd.controlling.linkchecker.LinkChecker.updateAvailableStatus(LinkChecker.java:553)
at jd.controlling.linkchecker.LinkChecker.access$200(LinkChecker.java:38)
at jd.controlling.linkchecker.LinkChecker$1.run(LinkChecker.java:410)
not a bug, as said in other thread in which you duplicated this. It's a thread dump and is of normal operation to read SSL connection (https).

raztoki
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #2212  
Old 01.10.2016, 10:38
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

Bug or not bug but code in the plug is defective and causes an infinite number of blocks while downloading.
Still referer wrong.
Code:
This is incorrect referer!
vk.com/feed
vk.com/photoXXX_XXX
Correct referer:
Code:
hxxps://vk.com/al_photos.php
Please refer to the API documentation.

Please fix it:
Example download album:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

and check Referer:
Request Referer:
vkontakte.ru_jd.plugins.hoster.VKontakteRuHoster.log
Reply With Quote
  #2213  
Old 07.10.2016, 17:05
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,985
Default

Updated Referer again.
It is exactly as I thought it would be: The modified Referer does not change the serverside behavior.

Best regards,
pspzockerscene
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #2214  
Old 07.10.2016, 18:57
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

Too many request within one second = immediate block download.

Shouldbe:
Quote:
Max one request to this module page (al_photos.php) per second.

Code:
--ID:107TS:1475858655800-16-10-07 18:44:15 -  [jd.http.Browser(loadConnection)] -> 
--ID:108TS:1475858656240-16-10-07 18:44:16 -  [jd.http.Browser(loadConnection)] -> 
--ID:109TS:1475858657300-16-10-07 18:44:17 -  [jd.http.Browser(loadConnection)] -> 
--ID:124TS:1475858656507-16-10-07 18:44:16 -  [jd.http.Browser(loadConnection)] -> 
--ID:126TS:1475858657056-16-10-07 18:44:17 -  [jd.http.Browser(loadConnection)] -> 
--ID:128TS:1475858657091-16-10-07 18:44:17 -  [jd.http.Browser(loadConnection)] -> 
--ID:129TS:1475858657178-16-10-07 18:44:17 -  [jd.http.Browser(loadConnection)] -> 
--ID:131TS:1475858657341-16-10-07 18:44:17 -  [jd.http.Browser(loadConnection)] -> 
--ID:132TS:1475858657542-16-10-07 18:44:17 -  [jd.http.Browser(loadConnection)] -> 
--ID:133TS:1475858657587-16-10-07 18:44:17 -  [jd.http.Browser(loadConnection)] -> 
--ID:134TS:1475858657518-16-10-07 18:44:17 -  [jd.http.Browser(loadConnection)] -> 
--ID:135TS:1475858657827-16-10-07 18:44:17 -  [jd.http.Browser(loadConnection)] -> 
--ID:136TS:1475858657909-16-10-07 18:44:17 -  [jd.http.Browser(loadConnection)] -> 
--ID:137TS:1475858657903-16-10-07 18:44:17 -  [jd.http.Browser(loadConnection)] -> 
--ID:139TS:1475858657978-16-10-07 18:44:17 -  [jd.http.Browser(loadConnection)] -> 
--ID:142TS:1475858658984-16-10-07 18:44:18 -  [jd.http.Browser(loadConnection)] -> 
--ID:143TS:1475858658711-16-10-07 18:44:18 -  [jd.http.Browser(loadConnection)] -> 
--ID:144TS:1475858659078-16-10-07 18:44:19 -  [jd.http.Browser(loadConnection)] -> 
--ID:145TS:1475858660362-16-10-07 18:44:20 -  [jd.http.Browser(loadConnection)] -> 
--ID:150TS:1475858659308-16-10-07 18:44:19 -  [jd.http.Browser(loadConnection)] -> 
--ID:154TS:1475858659680-16-10-07 18:44:19 -  [jd.http.Browser(loadConnection)] -> 
--ID:155TS:1475858660597-16-10-07 18:44:20 -  [jd.http.Browser(loadConnection)] -> 
--ID:156TS:1475858660923-16-10-07 18:44:20 -  [jd.http.Browser(loadConnection)] -> 
--ID:158TS:1475858661221-16-10-07 18:44:21 -  [jd.http.Browser(loadConnection)] -> 
--ID:159TS:1475858660265-16-10-07 18:44:20 -  [jd.http.Browser(loadConnection)] -> 
--ID:162TS:1475858661598-16-10-07 18:44:21 -  [jd.http.Browser(loadConnection)] -> 
--ID:164TS:1475858665625-16-10-07 18:44:25 -  [jd.http.Browser(loadConnection)] -> 
--ID:165TS:1475858665286-16-10-07 18:44:25 -  [jd.http.Browser(loadConnection)] -> 
--ID:166TS:1475858665967-16-10-07 18:44:25 -  [jd.http.Browser(loadConnection)] -> 
--ID:173TS:1475858666974-16-10-07 18:44:26 -  [jd.http.Browser(loadConnection)] -> 
--ID:174TS:1475858667567-16-10-07 18:44:27 -  [jd.http.Browser(loadConnection)] -> 
--ID:175TS:1475858666225-16-10-07 18:44:26 -  [jd.http.Browser(loadConnection)] -> 
--ID:176TS:1475858667957-16-10-07 18:44:27 -  [jd.http.Browser(loadConnection)] -> 
--ID:177TS:1475858668292-16-10-07 18:44:28 -  [jd.http.Browser(loadConnection)] -> 
--ID:178TS:1475858668631-16-10-07 18:44:28 -  [jd.http.Browser(loadConnection)] -> 
--ID:179TS:1475858666636-16-10-07 18:44:26 -  [jd.http.Browser(loadConnection)] -> 
--ID:180TS:1475858669236-16-10-07 18:44:29 -  [jd.http.Browser(loadConnection)] -> 
--ID:181TS:1475858667309-16-10-07 18:44:27 -  [jd.http.Browser(loadConnection)] -> 
--ID:182TS:1475858668997-16-10-07 18:44:28 -  [jd.http.Browser(loadConnection)] -> 
--ID:183TS:1475858669649-16-10-07 18:44:29 -  [jd.http.Browser(loadConnection)] -> 
--ID:184TS:1475858670172-16-10-07 18:44:30 -  [jd.http.Browser(loadConnection)] -> 
--ID:187TS:1475858671005-16-10-07 18:44:31 -  [jd.http.Browser(loadConnection)] -> 
--ID:188TS:1475858670566-16-10-07 18:44:30 -  [jd.http.Browser(loadConnection)] -> 
--ID:201TS:1475858671290-16-10-07 18:44:31 -  [jd.http.Browser(loadConnection)] -> 
--ID:202TS:1475858671698-16-10-07 18:44:31 -  [jd.http.Browser(loadConnection)] -> 
--ID:204TS:1475858672004-16-10-07 18:44:32 -  [jd.http.Browser(loadConnection)] -> 
--ID:205TS:1475858671424-16-10-07 18:44:31 -  [jd.http.Browser(loadConnection)] -> 
--ID:208TS:1475858672199-16-10-07 18:44:32 -  [jd.http.Browser(loadConnection)] -> 
--ID:212TS:1475858672534-16-10-07 18:44:32 -  [jd.http.Browser(loadConnection)] -> 
--ID:95TS:1475858655833-16-10-07 18:44:15 -  [jd.http.Browser(loadConnection)] -> 
--ID:96TS:1475858656563-16-10-07 18:44:16 -  [jd.http.Browser(loadConnection)] -> 
--ID:97TS:1475858656362-16-10-07 18:44:16 -  [jd.http.Browser(loadConnection)] ->
Reply With Quote
  #2215  
Old 07.10.2016, 21:36
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

Still bad!
is:
Referer: **External links are only visible to Support Staff****External links are only visible to Support Staff**
===========================
Shouldbe:
Referer: **External links are only visible to Support Staff****External links are only visible to Support Staff**
X-Requested-With: XMLHttpRequest
Reply With Quote
  #2216  
Old 08.10.2016, 11:50
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,985
Default

Updated Referer.
I will NOT be watching your "support.jdownloader.org" tickets anymore.
If you open any other tickets with other username --> Ban
I will not answer any vk.com related support.jdownloader.org tickets opened by you!
---
[Please read]=>How/when do I get updates?
Read it carefully BEFORE complaining that something would still be not working!
Update cycles depend on your installed JD version!!

---
[Bitte lesen]=>Wie/wann bekomme ich Updates?
Bitte vollständig lesen bevor ihr euch beschwert, dass etwas immernoch nicht funktionieren würde!
Die Updatezyklen variieren je nach installierter JD Version!!


GreeZ pspzockerscene
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #2217  
Old 10.10.2016, 01:18
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

I do not know what you mean, that you all my life thought only ban me. Grow up in the end.

Ps. Very true.
Reply With Quote
  #2218  
Old 10.10.2016, 07:39
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

Referer is good, but is still missing important entries in the code.
I showed screenshots, but never allow them here!
Reply With Quote
  #2219  
Old 11.10.2016, 03:47
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

Decrypt - perfect work.
Still Issue Download (too many request per second!)
error message: "Too fast! You are trying to load too many pages in one second!"
Loading multiple pages photoXXX_XXX (per 1 second !!!) will always result in block download!
Please try to open multiple pages in a browser in a super-short period of time.
I repeat once again. It is not allowed to open multiple pages in one second!
Every millisecond is important.
Html each module should be loaded at an interval of one second.
Reply With Quote
  #2220  
Old 12.10.2016, 01:49
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,647
Default

decrypter runs single thread, decrypter uses the same request intervals as hoster, just it runs as single thread vs multithread for download. As stated if you run into issues you can control this by minimising how many downloads start for vkontakte.ru in advanced setting > GeneralSettings.domainrules.

current rule allows for 20 burst in 30 seconds then 334 ms wait

raztoki
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #2221  
Old 12.10.2016, 07:57
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

Many times I said that Decrypter WORK = 1000%
A lot of links PARSE PERFECT WORK
Error Match: NOT FOUND

Only Download PROBLEM (VK Hoster). Please remember.

Post #2165 and subsequent updates cause problems in downloading.
What has changed in the code that are causing problems in Downlaod ?!
The old CODE class (HOSTER) Does not contain any interval:
It works quickly, without delays and without blocking, so how can this be?
Please answer this question.
Why now several months after the change of code:

1. can not download files is a high speed (causing NON-STOP block)
2. can not use 2 simultaneous download (or more) causes NON-STOP blocks.
Something is wrong to change the code.
I checked the login of the old and the new class (VK HOSTER)

The old class (HOSTER). A limited number of REQUEST in 1 second!

The new class (HOSTER). Too many REQUEST and it shows clearly and explicitly log that the module is loaded too many times in a super-short period of time!


Example:
OLD CLASS (HOSTER)
1 ... 2 request al_photos.php / HTMLPER 1 SECOND = 100% work download

new class (HOSTER)
+/-3 ... 6 request = too many requst PER 1 SECOND = NON-STOP BLOCK
Reply With Quote
  #2222  
Old 12.10.2016, 08:54
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

Still bug Plugin...
pspzockerscene. Please Fix It.

NEW UPDATE PLUGIN
jd.plugins.hoster.VKontakteRuHoster
----------------Request Information-------------
URL: **External links are only visible to Support Staff****External links are only visible to Support Staff**
SSLCipher: TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256
ConnectIP: vk.com/95.213.11.129:443
Connection-Timeout: 20000ms
Read-Timeout: 20000ms
----------------Request-------------------------
POST /al_photos.php HTTP/1.1
Host: vk.com
User-Agent: Mozilla/5.0 (Windows NT 6.1; rv:47.0) Gecko/20100101 Firefox/47.0
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
Accept-Language: de,en-gb;q=0.7, en;q=0.3
Accept-Encoding: gzip,deflate
Cache-Control: no-cache
X-Requested-With: XMLHttpRequest
Content-Type: application/x-www-form-urlencoded; charset=UTF-8
Content-Length: 75
Cookie: remixlang=...........................
act=show&al=1&module=photos&list=album..............
==================================================================

OLD WORKING PLUGIN
MAX SIMULTANEOUS
WITHOUT ERROR "TOO MANY REQUEST" 100 % WORK

----------------Request Information-------------
URL: hXXs://vk.com/photo-XXXX_XXXX
SSLCipher: TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256
ConnectIP: vk.com/87.240.165.88:443
Connection-Timeout: 20000ms
Read-Timeout: 60000ms
----------------Request-------------------------
GET /photo-XXX_XXX HTTP/1.1
Host: vk.com
Reply With Quote
  #2223  
Old 12.10.2016, 09:03
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

code is flawed

is:
URL: **External links are only visible to Support Staff****External links are only visible to Support Staff** or photoXXX_XXX
GET /photo-xxx_xxxx HTTP/1.1

Shouldbe:
Code:
POST /al_photos.php HTTP/1.1
URL: **External links are only visible to Support Staff**X-Requested-With: XMLHttpRequest
act=show&al=1&module=photos&list=album.......................
Reply With Quote
  #2224  
Old 14.10.2016, 14:57
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,985
Default

Your problem description is bad and I cannot find any issues in the code for single picture download ...

If you think it's so bad, maybe you should get the code and change it to how it is better in your opinion ! ! !

GreeZ psp
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #2225  
Old 14.10.2016, 15:37
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

Too many requests, he sent a number of logs (Believe that you do not need new logs because they contain the same errors too many requests)

Quote:
raztoki: new update replaces the old class.
Quote:
ask for a repair raztoki or pspzocker.
Max. One Request = ALWAYS al_photos.php Always work

example 6 Request per second = It exceeded the number of applications. LOGs do not lie!
Jiaz should add a counter requests, so the log is improved and more real!

The new code is flawed - causing problems. Please compare with the old log or plugs. The new update fixes other things, but also spoils the other. THANKS.
Reply With Quote
  #2226  
Old 14.10.2016, 15:49
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

Quote:
pspzockersce:
single picture download ...
Quote:
Jioaz: Increase concurrent downloads. With 1 download there is not much you can do about this.
Again ban. I recently had a number of times about 1 month. Enough is enough. For many months.
ONLY TEAMVIEW developers ALWAYS can prove to everyone that I speak 100% TRUTH AND NOBODY TELL ME MORE DO THAT AND ALL U ALL "fake" WORKS PERFECTLY.
Reply With Quote
  #2227  
Old 14.10.2016, 15:57
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

Opening an infinite number of links al_photos.php - Zero error / never, ever block.
Opening few or more links photonumber - block, bad code.

Photo(-)XXX-XXX = BAD /WRONG

URL /POST / MODULE /al_photos.php = GOOD
Reply With Quote
  #2228  
Old 14.10.2016, 16:03
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

Old Class:

Support 2 TO 50 threads = simultaneous downloas. YES. If Max. one reques per second.
Superfast = very fast Download = YES It should be quickly
Block ? = NO

New Class:
1 threads = 1 simultaneous. Work. Yes. But Not alywas
2 or more threads suport ? no. No. Since only stirred for a few seconds and running immediately prohibit downloading (with repeated lock)
You can fix it, but you have to change the code in the plug (recommended one hens for one module in one second) and you can have all this beauty. This must be respected.
Reply With Quote
  #2229  
Old 14.10.2016, 16:31
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

Crazy action! 12 request per second = ALWAYS ERROR.

Example:

--ID:109TS:1475858657300-16-10-07 18:44:17 - [jd.http.Browser(loadConnection)] ->
--ID:126TS:1475858657056-16-10-07 18:44:17 - [jd.http.Browser(loadConnection)] ->
--ID:128TS:1475858657091-16-10-07 18:44:17 - [jd.http.Browser(loadConnection)] ->
--ID:129TS:1475858657178-16-10-07 18:44:17 - [jd.http.Browser(loadConnection)] ->
--ID:131TS:1475858657341-16-10-07 18:44:17 - [jd.http.Browser(loadConnection)] ->
--ID:132TS:1475858657542-16-10-07 18:44:17 - [jd.http.Browser(loadConnection)] ->
--ID:133TS:1475858657587-16-10-07 18:44:17 - [jd.http.Browser(loadConnection)] ->
--ID:134TS:1475858657518-16-10-07 18:44:17 - [jd.http.Browser(loadConnection)] ->
--ID:135TS:1475858657827-16-10-07 18:44:17 - [jd.http.Browser(loadConnection)] ->
--ID:136TS:1475858657909-16-10-07 18:44:17 - [jd.http.Browser(loadConnection)] ->
--ID:137TS:1475858657903-16-10-07 18:44:17 - [jd.http.Browser(loadConnection)] ->
--ID:139TS:1475858657978-16-10-07 18:44:17 - [jd.http.Browser(loadConnection)] ->


Quote:
"Do not overdo it." Too many requests per second.
Ask devloper to repair code / reduce the number of request. Use the API to avoid future errors.
Reply With Quote
  #2230  
Old 14.10.2016, 17:38
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,985
Default

No idea what you mean.
Maybe use less simultaneous downloads if vk.com blocks you frequently.

Also I have no idea what you mean in post 2227 - you're not really explaining anything that is supposedly wrong in any readable/understandable way.

If the old plugin works better for you, maybe continue to use it instead of posting felt 100 posts per day.

GreeZ pspzockerscene
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #2231  
Old 14.10.2016, 17:56
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

I can not use the old plug because after repairing the problem with logging(ACCOUNT BROKEN) are the above-mentioned problems with blocking while downloading.


Quote:
Maybe use less simultaneous downloads if vk.com blocks you frequently.
"Nasty" workaround.
Very bad solution. After some time, the download will continue to appear blocks.

The best solution:
1. Max one request to this module page (al_photis.php per second).
Example:
Request Time:
12:02:02 (Request 1)
12:02:03 (SEQUENCE Request 2)
12:02:04 (SEQUENCE Request 3)
Max one request:thumbup: to this module page (al_photis.php, al_video.php and etc.) per second.
2. Please correct the link POST / GET, and add the missing module.
Reply With Quote
  #2232  
Old 14.10.2016, 19:21
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

Quote:
pspzockerscene:
Again caused by vk.com html changes.
Fixed.
---
"Repair" really flawed! This causes a problem now downloading! Now there are a lot of request. Something is wrong!
Reply With Quote
  #2233  
Old 14.10.2016, 19:47
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

ISSUE DOWNLOAD.
You can add/set or customize a 1 second interval ?
One REQUEST for this module loading / this page.


Code:
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "**External links are only visible to Support Staff**>
<html xmlns="**External links are only visible to Support Staff** xml:lang="en" lang="en">
<head>
<meta http-equiv="X-UA-Compatible" content="IE=edge" />
<link rel="shortcut icon" href="/images/icons/favicons/fav_logo.ico?5" />
....................
Code:
<div id="content"><div class="message_page page_block">
  <div class="message_page_title">Error</div>
  <div class="message_page_body">
    You tried to load the same page more than once in one second.<br>Please go back and try again.
    <button class="flat_button message_page_btn" id="msg_back_button">Back</buton>
Reply With Quote
  #2234  
Old 15.10.2016, 11:11
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

pspzockerscene & raztoki -
Set previous best settings and can download as want, when want.
It works great! can download without blocks.

Code:
Previous best setting: max. 2
Code:
"New UPDATE": average 3 - 8
, so these are not the correct settings.
So please developers to restore(correct) the previous best - working settings, and please do not increase this value!
Thank You Very Much!
Reply With Quote
  #2235  
Old 17.10.2016, 21:44
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

Quote:
[jd.controlling.linkchecker.LinkChecker(updateAvailableStatus)]
Quote:
Jiaz:
each request. that results in max 3 requests per second
Jiaz - That's not true! You do not believe??? TeamViewer - prove it!!!
For me shows up to 8 requests per second. This is too much! and get non-stop blockade!

pspzockerscene - Please AGAIN set up to max. 2 requests per second.
Previously version plugin 2 request per second [SETTING BETTER](fast and good NEVER BLOCKADE):thumbup::thumbup:

Now 8 request per second (Super-fast-too quick) and wrong (!!!)
Reply With Quote
  #2236  
Old 18.10.2016, 17:51
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

pspzockerscene & Jiaz -

https://board.jdownloader.org/showpo...1&postcount=12
https://board.jdownloader.org/showpo...2&postcount=13


Update.
Quote:
Tue Oct 18 17:42:56 CEST 2016
Package: package_1476803051503.awf
Install
Write Revision: 8752

Restart JD2. Still Too Many Request:
18.10.16 17.42.54 <--> 18.10.16 17.47.07 jdlog://3388681887641/

Example 5 request per second:
Code:
--ID:332TS:1476805487262-16-10-18 17:44:47 -  [jd.http.Browser(openRequestConnection)] -> 
--ID:328TS:1476805487915-16-10-18 17:44:47 -  [jd.http.Browser(openRequestConnection)] -> 
--ID:329TS:1476805487598-16-10-18 17:44:47 -  [jd.http.Browser(openRequestConnection)] -> 
--ID:343TS:1476805487680-16-10-18 17:44:47 -  [jd.http.Browser(openRequestConnection)] -> 
--ID:338TS:1476805487003-16-10-18 17:44:47 -  [jd.http.Browser(openRequestConnection)] ->
Code:
--ID:309TS:1476805482253-16-10-18 17:44:42 -  [jd.http.Browser(openRequestConnection)] -> 
--ID:306TS:1476805482912-16-10-18 17:44:42 -  [jd.http.Browser(openRequestConnection)] -> 
--ID:308TS:1476805482583-16-10-18 17:44:42 -  [jd.http.Browser(openRequestConnection)] -> 
--ID:317TS:1476805482999-16-10-18 17:44:42 -  [jd.http.Browser(openRequestConnection)] -> 
--ID:313TS:1476805482331-16-10-18 17:44:42 -  [jd.http.Browser(openRequestConnection)] ->
Reply With Quote
  #2237  
Old 19.10.2016, 08:00
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

Quote:
Jiaz: Increase concurrent downloads.
3 request per second? This only works for one concurrent / downloading at the same time.
Please do so that you can download with increased concurrent without block!
Please test with an increased number! A suggested by raztoki solutions are very bad. Because it does not solve anything! Still TOO MANY REQUEST PER ONE SECOND 5-8 Still there are blocks and blocks and blocks.
Quote:
Jiaz: next update. Its a complete different domain so limitations did not trigger
Please do not ignore this post, because the logs are too many requests. And this is the truth, pure truth.
It is impossible to reduce the opening of requests per second?
19.10.16 07.41.54 <--> 19.10.16 07.56.45 jdlog://0439681887641/
New update yet perhaps more wrong.
Only a few seconds to download files and downloading is blocked.
Reply With Quote
  #2238  
Old 19.10.2016, 19:32
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default Today Update = java.lang.StackOverflowError (VERY BIG LOG!)

------------------------Thread: 887:vkontakte.ru_jd.plugins.hoster.VKontakteRuHoster.log-----------------------
--ID:887TS:1476898069907-16-10-19 19:27:49 - [jd.controlling.downloadcontroller.DownloadWatchDog(handleReturnState)] -> Plugin Defect.1
------------------------Thread: 884:vkontakte.ru_jd.plugins.hoster.VKontakteRuHoster.log-----------------------
--ID:884TS:1476898069907-16-10-19 19:27:49 - [] -> java.lang.StackOverflowError
at org.appwork.utils.net.HeaderCollection.add(HeaderCollection.java:58)
at jd.http.RequestHeader.put(RequestHeader.java:84)
at jd.http.RequestHeader.put(RequestHeader.java:88)
at jd.plugins.hoster.VKontakteRuHoster.setHeadersPhoto(VKontakteRuHoster.java:411)
at jd.plugins.hoster.VKontakteRuHoster.setHeadersPhoto(VKontakteRuHoster.java:413)
at jd.plugins.hoster.VKontakteRuHoster.setHeadersPhoto(VKontakteRuHoster.java:413)
at jd.plugins.hoster.VKontakteRuHoster.setHeadersPhoto(VKontakteRuHoster.java:413)
-hundreds more-

Last edited by tony2long; 22.10.2016 at 11:00.
Reply With Quote
  #2239  
Old 20.10.2016, 09:44
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 80,387
Default

fixed with next update
__________________
JD-Dev & Server-Admin
Reply With Quote
  #2240  
Old 20.10.2016, 10:21
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default Why shows the status of "?". Should show "OK Online"

Why shows the status of "?"

Should show "OK Online"

20.10.16 09.31.10 <--> 20.10.16 10.17.55 jdlog://0920781887641/
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 15:15.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.