JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1861  
Old 19.03.2016, 11:45
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,451
Default

raztoki - No!

Can not connect to the site and my profile,
Too many requests in a short time ...
Code:
<div class="body">
    You tried to load the same page more than once in one second.<br>Please go back and try again.<br>
    <div class="button_blue"><button id="msg_back_button">Back</button></div>
  </div>
You tried to load the same page more than once in one second.
Please go back and try again.


--ID:109TS:1458378200624-3/19/16 10:03:20 AM - [] -> jd.http.Browser$BrowserException
at jd.http.Browser.openRequestConnection(Browser.java:1612)
at jd.http.Browser.openRequestConnection(Browser.java:1548)
at jd.http.Browser.getPage(Browser.java:1291)
at jd.http.Browser.getPage(Browser.java:1287)
at jd.plugins.hoster.VKontakteRuHoster.login(VKontakteRuHoster.java:666)
at jd.plugins.decrypter.VKontakteRu.getUserLogin(VKontakteRu.java:1822)
at jd.plugins.decrypter.VKontakteRu.decryptIt(VKontakteRu.java:275)
at jd.plugins.PluginForDecrypt.decryptIt(PluginForDecrypt.java:245)
at jd.plugins.PluginForDecrypt.decryptLink(PluginForDecrypt.java:275)
at jd.controlling.linkcrawler.LinkCrawler.crawl(LinkCrawler.java:2503)
at jd.controlling.linkcollector.LinkCollectorCrawler.crawl(LinkCollectorCrawler.java:33)
at jd.controlling.linkcrawler.LinkCrawler$11.crawling(LinkCrawler.java:1051)
at jd.controlling.linkcrawler.LinkCrawlerRunnable.run_now(LinkCrawlerRunnable.java:89)
at jd.controlling.linkcrawler.LinkCrawlerRunnable.run(LinkCrawlerRunnable.java:28)
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)
Caused by: java.net.UnknownHostException: Could not resolve: -vk.com<->vk.com-
at org.appwork.utils.net.httpconnection.HTTPConnectionUtils.resolvHostIP(HTTPConnectionUtils.java:198)
at org.appwork.utils.net.httpconnection.HTTPConnectionImpl.resolvHostIP(HTTPConnectionImpl.java:1384)
at org.appwork.utils.net.httpconnection.HTTPConnectionImpl.connect(HTTPConnectionImpl.java:623)
at org.appwork.utils.net.httpconnection.HTTPConnectionImpl.finalizeConnect(HTTPConnectionImpl.java:1000 )
at jd.http.Request.connect(Request.java:304)
at jd.http.Browser.openRequestConnection(Browser.java:1573)
... 16 more
Reply With Quote
  #1862  
Old 19.03.2016, 11:59
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,627
Default

downloading vk entirely again are we ? :p.

I would recommend that you don't add so many links at once, that might lead back to a given URL that's shared between them.

raztoki
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #1863  
Old 19.03.2016, 13:04
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,627
Default

it has nothing todo with the old core. once again you have limited to no idea of the situation, and we are not going to write a solution which allow you to crawl entire vk site.
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #1864  
Old 19.03.2016, 13:12
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,451
Default

raztoki - show me where the log is indexing the entire site

"And do not skip my prev posts" (moderation)
Reply With Quote
  #1865  
Old 19.03.2016, 13:35
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,627
Default

Since plugin restricts to a single decrypting task, it means x task starts > finishes > next starts and hits "some url", in which you then receive block. This is the only way it can happen as I see it.

re: log? proof is your history of doing this over the last 5+ years. Do we need anymore?

raztoki
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #1866  
Old 19.03.2016, 13:57
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,451
Default

I wrote how you can solve this problem, but why you do not listen to me?, where are my previous posts?
The problem is the "old sessions" JD2 not termianate "the old sessions" because from time to time "off account"

See Russian forums or VK Developer Group, people have a similar problem (not only me) and how to solve this problem ... or enter YouTube in Russian language error and a tutorial on how to solve the problem.

raztoki - VK have an account?
Open your profile in your browser "multiple x times"
guarantees that you'll get a block.

raztoki -

See Description
Russian translate into English, or read comments
Quote:
Я НЕНАВИЖУ "Слишком быстро...Вы попытались загрузить...
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

many users have this problem....

Probably a good solution is to regularly clean the old session (this can be done in the "Security")
**External links are only visible to Support Staff****External links are only visible to Support Staff**

My question:

Is JD2 can do it automatically (without manual)

*ешение проблемы Вы попытались загрузить более одной однотипной страницы в секунду
You tried to load the same page more than once in one second.
Please go back and try again.


You can implement this function in JD2?
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Quote:
raztoki - it has nothing todo with the old core.
Yea ...It will also work, but you have to use other device (use a second installation JD2 - and it will be another session) :d :d

Last edited by raztoki; 19.03.2016 at 14:57. Reason: merge conseq posts
Reply With Quote
  #1867  
Old 19.03.2016, 14:55
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,627
Default

No, I do not have an account. Psp usually sends me one when he wants me to 'look into/fix' something which he gets stumped at.

Numerous of your previous posts where deleted. If you want to make loads of posts that's fine, just don't expect them to be approved. Please think/and review post before submitting, most importantly make sure it make sense.

Underlying issue is, VK doesn't want you to hit the same URL more than x times / y time. They block you for a undisclosed reason.

I loaded your provided vk links, but translation services only work so well. From what I can see lots people asking same question, some times difference advice given as response but other nothing. Personally I wouldn't take it as gospel.

Youtube video is next to pointless/useless (Russian).

Then why do you keep saying it has todo with the core?, each JD will have its own configs! Clearly another installation will have another set of cookie values.

raztoki
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]

Last edited by raztoki; 19.03.2016 at 14:59.
Reply With Quote
  #1868  
Old 19.03.2016, 15:12
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,451
Default

raztoki -

You said:
Quote:
you do not have an account.
Without an account can not reproduce this problem!!!
Reply With Quote
  #1869  
Old 19.03.2016, 15:19
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,627
Default

Not once did I say I was trying to reproduce this problem.

raztoki
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #1870  
Old 19.03.2016, 15:55
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,451
Default

My test:

Download: Add-on (Firefox)
Code:
Open Multiple Locations
My setting:

1.Enter or paste URLs

2. Add: 200 link

3. Delay between opening successive locations: [1 second]

It does not show an error. So why here it works without errors???:blink:

a) JD2 shows from time to time - error.
b) Trying to avoid the block (but "VKdevelopers" said that this is not API)
C) If you show too many errors log (the repetition of the same action and more avoid)
Safety system detects these crazy actions and temporarily block profile (not URL)
Please understand this ..
d) Logout and back page works - without an account ...
So it blocks the my/your profile (not url)

Last edited by raztoki; 19.03.2016 at 16:17.
Reply With Quote
  #1871  
Old 19.03.2016, 16:16
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,627
Default

I never said I didn't understand what the cause is.

Assuming you do not add links which will lead to the same URL that you've hit within the last '1(x) second', you shouldn't have a problem. This is what I've said in previous response.... do not add links which will trigger problem (sounds simple no?). As I said I earlier we rather not code that lets you bypass there restriction, this is effectively what we would need to create in order for it to work within JD. We would need to track which URL was requested with timestamp.

Of course it blocks your profile as your logged in! they track you via these identifying markers.

raztoki
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #1872  
Old 19.03.2016, 16:29
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,451
Default

I think that JD2, trying to "read" my profile + analyze eg. link to the album (it is associated with a doubling of the action)

link my profile + link crawl = double action
Reply With Quote
  #1873  
Old 19.03.2016, 16:53
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,451
Default

Mr raztoki -

virtually every link is analyzed block 1/10
It should not be like that.... o.O

Screen:

Reply With Quote
  #1874  
Old 04.04.2016, 14:39
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,451
Default

Code:
https://board.jdownloader.org/showpost.php?p=366534&postcount=1873
It applies only to analyze the photo albums (id|album|album-|albums|albums-)
Api metods Execute
**External links are only visible to Support Staff****External links are only visible to Support Staff**
OR

JSONP
Quote:
VK API requests can be processed in browser from other sites' pages or IFrame apps.
To perform this kind of request, each time you call an API method you need to connect to the page a separate <script> tag. In the callback parameter should be a name of a function which will be executed with the method's work results when the answer is received.


Reply With Quote
  #1875  
Old 04.04.2016, 16:32
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,627
Default

Since we don't listen to other peoples use of VK parameters, and we nearly exclusively use VK page vs someone else page & iframe, parameters from iframe isn't going to be useful for us!

As stated I understand the issue, but to create effective support due to how our application works, we would need to track all URL access in the VK plugin. It's in my opinion only a issue if you had hundreds of links which lead to one another/common url (within short period).

for example.
[a] > [b] > [c]
[e] > [b] > [z] *stopped at b*
[f] > [b] > [o] *stopped at b*

It should not be a problem if you add links to unique data. Your common way to add links from history is to add links from some wall > which has tens to hundreds of links. Then you loose control of which content you hit. Avoid this....

If we can find the time we will make support, until then do not add links which hop/jump about the place, and you will effectively reduce the chances of you having issue.

raztoki
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]

Last edited by raztoki; 04.04.2016 at 16:35.
Reply With Quote
  #1876  
Old 04.04.2016, 16:58
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,451
Default

raztoki - Just look at the ID log:



--ID:86TS:1459744043610-4/4/16 6:27:23 second AM -
--ID:86TS:1459744043863-4/4/16 6:27:23 second AM -
Probably bug...

is:
Code:
0 second
Shouldbe minimum delay 1000 - 1500 ms
Code:
My plugin setting:
Code:
Define sleep time for general pagination: 2100 ms
Define sleep time for community videos pagination: 2000 ms
Define sleep time for general pagination: 3000 ms
Reply With Quote
  #1877  
Old 04.04.2016, 17:11
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,451
Default

raztoki - Load is multiple links within 1 second
You should not load multiple links within 1 second, the need to minimum delay(e.g. 1 second)

See:



Advanced settings are wrong or something should fix the code. I do not know ...
Reply With Quote
  #1878  
Old 04.04.2016, 17:31
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,627
Default

plugin allows burst rates, for x requests.

No need to bring this up again as I understand the issue (as stated numerous times), and placing higher wait times between requests will just result in you complaining about slowness (as it has in the past).

raztoki
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #1879  
Old 04.04.2016, 17:47
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,451
Default

raztoki - Do not you understand what I mean!

JD2 Load Multiple URL at the same time = temporary block
Repeating the same action several times (even to the setting of sleep) does not resolve the problem !


It is something like when you're trying to load multiple pages per second.
It does not lock immediately but after some time, and later again to load if many links, the lock will appear more often.
M I S S I N G QUEUE

OK:
Decrypt:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
Queue
Decrypt2:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
Decrypt3:
Queue
**External links are only visible to Support Staff****External links are only visible to Support Staff**

BAD:
Decrypt Multiple URL 1, 2, 3
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Delay = not solved /still block and slow decrypt
Sleep = not solved /still block and slow decrypt

Queue = Solved fast decrypt (without waiting)

Please add "Queue"


Last edited by tony2long; 04.04.2016 at 18:43.
Reply With Quote
  #1880  
Old 04.04.2016, 18:00
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,627
Default

thread closed. I understand the issue stop preaching your nonsense.
you will need to WAIT until we find the time, and or energy to make proper support. do not bring this up directly or indirectly again, else BAN.
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 02:17.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2023, Jelsoft Enterprises Ltd.