[User feedback required] Vk.com Vkontakte.ru - Page 59 - JDownloader Community

ZenoN · #**2321** 17.11.2016, 04:33

@raztoki
once again i added directly urls from previous posts, just look it...

Spoiler:

Quote:

Originally Posted by ZenoN

Hi guys can u help me? I am trying to dl files from my %docs% by url like this:
**External links are only visible to Support Staff**...
But plugin don't see anything so. I add links by grabb
And they look like this:
**External links are only visible to Support Staff**...
But, there is an error about authorization in logs now.

Spoiler:

Plugin settings:

Spoiler:

How can i authorize it ?

ZenoN · #**2322** 17.11.2016, 04:35

@raztoki

Once again, i added directly url's

Spoiler:

Quote:

Originally Posted by ZenoN

Hi guys can u help me? I am trying to dl files from my %docs% by url like this:
**External links are only visible to Support Staff**...
But plugin don't see anything so. I add links by grabb
And they look like this:
**External links are only visible to Support Staff**...
But, there is an error about authorization in logs now.

Spoiler:

Plugin settings:

Spoiler:

How can i authorize it ?

tony2long · #**2323** 17.11.2016, 09:50

@raztoki
Maybe this can be fixed:
--ID:82TS:1478833055541-11.11.16 4:57:35 - [jd.plugins.PluginForDecrypt(decryptLink)] -> CrawlerPlugin out of date: jd.plugins.decrypter.VKontakteRu@549ecabf :35380
11.11.16 04.57.29 <--> 11.11.16 05.04.43 jdlog://1520981887641/

@ZenoN
Your log shows you tried to download docsXXXXXXXX, not docXXXXXXXX_XXXXXXX as you wrote in your post that you quoted.

raztoki · #**2324** 17.11.2016, 10:29

@tony2long
done

@ZenoN
remove the links, and try adding again... unsupported links will not add to gui now or say crawler out of date within log.

raztoki

raztoki · #**2325** 17.11.2016, 10:30

@tony2long
done

@ZenoN
remove the links, and try adding again... unsupported links will not add to gui now or say crawler out of date within log.

raztoki

ZenoN · #**2326** 17.11.2016, 13:11

@tony2long

it's docXXXXXXXX_XXXXXXX i send log before. i can send new log
17.11.16 13.56.09 <--> 17.11.16 14.05.17 jdlog://2206981887641/

@raztoki
Am i speaking with robots? If u don't want to make it work just said it don't waste my time. I grabb links manual cuz u grabbler sux and don't pars vk.com/docs so i just copy them from my clipboard

once more new log with this super fix "remove the links, and try adding again.."
17.11.16 13.56.09 <--> 17.11.16 14.05.17 jdlog://2206981887641/

all u need to do: is make this link docXXXXXXXX_XXXXXXX to be able to dl file from the next step behind of it
they looks like this **External links are only visible to Support Staff****External links are only visible to Support Staff**

raztoki · #**2327** 17.11.2016, 13:21

Quote:

Originally Posted by raztoki

@ZenoN
Its supported at the individual document level '/doc[\d-]+_[\d-]+'.

log showed docs\d+ and we don't support that hence my previous response. I also explained why /docs doesn't work, not supported nor do I see us adding support to download ones own files out of profile.

going to your new log, and downloads, do you have multiple vk accounts enabled in account manager? because there is a check for html

Code:

        if (downloadLink.getDownloadURL().matches(VKontakteRuHoster.TYPE_DOCLINK)) {
            if (br.containsHTML("This document is available only to its owner\\.")) {
                throw new PluginException(LinkStatus.ERROR_FATAL, "This document is available only to its owner");
            }

Would it be possible to borrow your account, to test this more?

raztoki

ZenoN · #**2328** 17.11.2016, 14:05

@raztoki

no i linked only one acc
sent it pm,

tony2long · #**2329** 18.11.2016, 14:40

Sorry, I only checked decrypter log, turns out that docXXXXXXXX_XXXXXXX is handled directly by hoster plugin.
While waiting for raztoki's fix, I have made a temporary change, please try again after plugin update.
Please upload new log if still failed.

ZenoN · #**2330** 18.11.2016, 19:04

@tony2long

Yeah finally all work fine, you are awesome guys, sry for my bad english and bad manners. Just was bad days and i was starting to do this by api vk.

raztoki · #**2331** 19.11.2016, 00:13

@tony2long
thanks tony2long
I had made the changes and forgot to commit again o_O.

@ZenoN
wonderful =]

raztoki

djmakinera · #**2332** 19.11.2016, 11:28

Bug:

It should decrypt one image, but decrypts 499 other pictures.

**External links are only visible to Support Staff****External links are only visible to Support Staff**

djmakinera · #**2333** 19.11.2016, 11:35

Bug: Wrong File Type
Is: Video File Type

It should be: "Other File Type" (the file name without the extension jpg)

**External links are only visible to Support Staff****External links are only visible to Support Staff**

pspzockerscene · #**2334** 23.11.2016, 13:04

RE #2332:
Fixed.

RE #2333:
Works fine here.
---

[Please read]=>How/when do I get updates?
Read it carefully BEFORE complaining that something would still be not working!
Update cycles depend on your installed JD version!!

---
[Bitte lesen]=>Wie/wann bekomme ich Updates?
Bitte vollständig lesen bevor ihr euch beschwert, dass etwas immernoch nicht funktionieren würde!
Die Updatezyklen variieren je nach installierter JD Version!!

GreeZ pspzockerscene

djmakinera · #**2335** 23.11.2016, 13:15

Quote:

Originally Posted by pspzockerscene

RE #2332:

Works fine here.

can not fix in my case?

djmakinera · #**2336** 23.11.2016, 21:11

Issue @Decrypter:

please:
1. Set the correct URL
2. Set the correct Referer
to fully prevent all the blocks.

https://board.jdownloader.org/showpo...&postcount=673

djmakinera · #**2337** 24.11.2016, 12:05

post#2336

Code:

URL: /POST
Referer:

Code:

can only load 1 page in one second

**External links are only visible to Support Staff**

Code:

can only load 1 page in one second

**External links are only visible to Support Staff**

Code:

can load up to 25 pages per second, 
So effectively avoid blockages and faster to analyze links / albums 

**External links are only visible to Support Staff**

So please correct it

pspzockerscene · #**2338** 24.11.2016, 15:18

Again:
Post REAL example urls, post the CURRENT behavior (Referer) and post the behavior that you WANT!

GreeZ psp

djmakinera · #**2339** 25.11.2016, 05:36

id / profile user

Spoiler:

**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

raztoki · #**2340** 25.11.2016, 06:59

As stated numerous times already to you over the last couple weeks....
our Browser limiter only rate limits on domain, its for all requests (get/posts), and takes nothing into account for the url path.

To rate limit at this given time we MUST rate limit at the highest level to prevent blocking for all types. We can not distinguish at this time! The ticket Jiaz made the other day should be able to influence it more, but feature does not exist yet. You will need to WAIT.

djmakinera · #**2341** 25.11.2016, 08:42

raztoki - Not interval issue !!
Issue @decrypter
Change the only method of execution. URL and Referer
This method works perfectly. Tested. it never blocks. Never say never.
Add 200 link. Decrypt 1.400.000 links / 2000 packages without block, so it works perfectly method.
Only minimal improvement method.

Code:

photo or album -> al_photos.php

raztoki - not to be confused with the previous issue @Hoster (Issue Speed Download)
I believe that King of The Plug Mr. pspzockerscene will know what I mean.

raztoki · #**2342** 25.11.2016, 09:03

my previous comment was for your #2337 post, not the urls given above. Sorry I should have used quote.
that message directly implied x per second which is interval....

hence my answer.

djmakinera · #**2343** 25.11.2016, 13:21

raztoki - Just a POST request (but incorrect URL and address referrer)
any differences will always have an unexpected result in the form of a blockade,
Correct use of methods and solve all problems with blocks

pspzockerscene · #**2344** 25.11.2016, 16:52

There is no correct or incorrect way - it is just how they try to detect "bots".

Aso ,I still have no idea what you mean.

GreeZ psp

djmakinera · #**2345** 25.11.2016, 17:12

Example:
Analyze empty albums / offline links = too fast to load pages = Does not work in this case, the "sleep" 1 sec!

Blocks because of invalid URL and Referer.
Please Set correctly URL and Referer and everything will work!
Advantages:
1. always superfast decrypt = never block!
2. It does not require increasing the "sleep" !

pspzockerscene · #**2346** 25.11.2016, 18:14

Changed Referer.
I only tested it up to 2000 photos - I don't have the time to check this deeper but if it helps, you'll see it ...

[Please read]=>How/when do I get updates?
Read it carefully BEFORE complaining that something would still be not working!
Update cycles depend on your installed JD version!!

---
[Bitte lesen]=>Wie/wann bekomme ich Updates?
Bitte vollständig lesen bevor ihr euch beschwert, dass etwas immernoch nicht funktionieren würde!
Die Updatezyklen variieren je nach installierter JD Version!!

GreeZ pspzockerscene

djmakinera · #**2347** 25.11.2016, 18:54

I updated, still wrong URL and Referer

Code:

 You tried to load the same page more than once in one second. Please go back and try again.

Also, a bug in the advanced settings!

Code:

Define sleep time for general pagination:

1000 ms

It does not work if the links "offline" or empty albums.
directhttp_jd.plugins.hoster.DirectHTTP.log-----------------------
--ID:180TS:1480095789189-16-11-25 18:43:09 - [jd.controlling.linkcrawler.LinkCrawler(processHostPlugin)] -> Processing: direct**External links are only visible to Support Staff** Here it should also be sleep 1000 ms (minimum)

or set correctly (better method API execute method) and the URL referer (up to 25 pages per 1 second! = never block)

pspzockerscene · #**2348** 25.11.2016, 19:03

1. No idea what you mean - the Referer is definitly set.
Please post a log and show me exactly where it is wrong.

2. Nope, for offline urls there is no waittime thisd is NOT a bug!

GreeZ psp

djmakinera · #**2349** 25.11.2016, 19:10

2.
Too many request = Too many pages loaded within one second! = ALWAYS BLOCK !

7 pages loaded within one second. Current method allows a maximum of only one page per 1 second.
The best method (API Execute Method) up to 25 request per second = NEVER BLOCK!.

--ID:186TS:1480095789014-16-11-25 18:43:09 - [jd.http.Browser(loadConnection)] ->
--ID:186TS:1480095789185-16-11-25 18:43:09 - [jd.http.Browser(loadConnection)] ->
--ID:186TS:1480095789348-16-11-25 18:43:09 - [jd.http.Browser(loadConnection)] ->
--ID:186TS:1480095789469-16-11-25 18:43:09 - [jd.http.Browser(loadConnection)] ->
--ID:186TS:1480095789633-16-11-25 18:43:09 - [jd.http.Browser(loadConnection)] ->
--ID:186TS:1480095789790-16-11-25 18:43:09 - [jd.http.Browser(loadConnection)] ->
--ID:186TS:1480095789932-16-11-25 18:43:09 - [jd.http.Browser(loadConnection)] ->

pspzockerscene · #**2350** 25.11.2016, 19:13

Stop trying to download so much from VK, this will for sure solve your issue.

Again JDownloader is not made for this.

I will not pput any time into optimizing JDownloader for your personal needs.

My idea for you:
Get yourself a programmer to change the plugin for your needs.

-psp-

djmakinera · #**2351** 25.11.2016, 19:17

Quote:

Originally Posted by pspzockerscene

no waittime

Example: Add 100 links offline, check the log, a lot of blocks!

Code:

Error: Too fast load page per second

offline (wait 1 second) [minimum]
online (wait 1 second) [minimum]

No believe? TeamViewer = Prove!

pspzockerscene · #**2352** 25.11.2016, 19:18

Again:
For every normal user our vk.com plugin will work just fine.

Just look back the 115+ pages of this thread and you will notice that 99% of all these vk.com "bugreports" cam from you!

GreeZ psp

djmakinera · #**2353** 25.11.2016, 19:21

Quote:

Originally Posted by pspzockerscene

Stop trying to download so much from VK,

I do not download anything, all links offline!

How to solve all the problems are 2 solutions:
1. Use of better methods
OR
2. add sleep 1 second (minimum) for offline links (only source links)

djmakinera · #**2354** 25.11.2016, 19:26

You need to think intelligently.
There was no need to change the method and to continue to work everything :)

Code:

Wrong:
----------------Request-------------------------
GET /album...._.... HTTP/1.1

:unsure:

Plese set

Code:

URL: POST /al_photos.php HTTP/1.1

Referer: **External links are only visible to Support Staff**

Please help!

djmakinera · #**2355** 25.11.2016, 19:35

Normal Users do not analyze errors in the log.
I just like to clean logs without errors.
I think this is the idea of a plug?

In theory it works fine, but if these blocks will be a lot of analysis will take a very long time!
Change the method GET to POST, the links offline
Thank you!

ROLO · #**2356** 25.11.2016, 19:42

@pspzockerscene
issues 2(post #2314) and 3 confirmed? has been more than a week and no answer...

djmakinera · #**2357** 25.11.2016, 19:57

Quote:

Originally Posted by pspzockerscene

1. No idea what you mean - the Referer is definitly set.
Please post a log and show me exactly where it is wrong.

Issue Decrypter
See:
#2284
Satisfied because the previous method (settings) were perfect.
See my answer.
https://board.jdownloader.org/showpo...postcount=2287

djmakinera · #**2358** 25.11.2016, 20:13

Post #2287
100% work well

Again, make any changes
Post #2289
Again, do not work as expected.
sometimes blocks, and if the blocks are too many account block for
20 min - 2 hours!
if trying to analyze offline links (source) or source mixed (offline + online)
That's why I want to avoid these blocks by using other methods, which are recommended if the request uses multiple request in a short time (1 second)

pspzockerscene · #**2359** 25.11.2016, 20:14

#2353:
1. I don't see anything to improve.
2. The sleep is not needed.
We're open source - if you want it, go ahead and add that one line of code!

#2354, #2357, #2358:
No idea what you want from me here.

#2355:
I will not simply change a method from GET to POST - this is bullsh1t again.

@ROLO:
On it ...

GreeZ pspzockerscene

djmakinera · #**2360** 25.11.2016, 20:27

GET limited to only max. 1 request per second.
Need wait after each link 1 second.
Not support analyze a multiple links in one second!
I understand. If this can not be "easy change" I will have much longer to wait for the end of the analysis.

POST Request work max. 25 many request per second.

The end of my "ineffective" requests (suggestion) here.

Thread Tools
Show Printable Version Email this Page
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

	JDownloader Community Board - Archive - Top
Provided By AppWork GmbH \| Privacy \| Imprint