JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1801  
Old 20.02.2016, 15:47
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,451
Default VK - Setting the maximum number of decrypt "offset"

Setting the maximum number of "offset"
Example:

vk.com/wall-ID?offset=XXX

XXX - number


You can add the advanced function because of the unique situation.

Some of the walls are large, plug works well, but if I eg. Update (download files) only from the last days or months - do not want to re-analyze the entire wall.

I found a huge wall 1,500,000 post (many files)

You may be able to decrypt it, but it requires a lot of time(few hours) and RAM

So you can set the Limit number decrypt "offset" (Plugin Advanced Setting) - if possible :D

Ps.
if not, and decrypts all that, because I like everything and I love.
Reply With Quote
  #1802  
Old 20.02.2016, 15:50
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,451
Default

**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #1803  
Old 20.02.2016, 21:02
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,451
Default decrypter.VKontakteRu(apiHandleErrors)] -> Access denied

[jd.http.Browser(loadConnection)] ->
{"error":{"error_code":15,"error_msg":"Access denied: this wall available only for community members"

--ID:162TS:1455993501427-2/20/16 7:38:21 PM - [jd.plugins.decrypter.VKontakteRu(apiHandleErrors)] -> Access denied

I am a "member" (closed group), I have, of course, authorized !, but JD2 not decrypts the wall!
Strange, because before some time to decrypt, but now it does not work.

**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #1804  
Old 20.02.2016, 21:20
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,451
Default

Update:

Very strange, because sometimes it works and sometimes it does not - perhaps the group is very active and very often occur on the changes, adding or deleting posts (if one considers spam)
Reply With Quote
  #1805  
Old 20.02.2016, 21:21
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,451
Default

Now works...
Reply With Quote
  #1806  
Old 21.02.2016, 03:32
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,659
Default

@djmakinera
How offset generally works is a value is given and it displays the OTHER side of offset. So your request would only work if they show oldest -> newest with spanning page support. Most sites place new content first and offset would mean you get older content. From what I can tell from those provided links they show newest -> oldest. The only way I can see we can offset implementation would be without spanning page support, so it would only process that given page. Would that be acceptable?

raztoki
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #1807  
Old 21.02.2016, 04:12
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,659
Default

@djmakinera
to me that would be issue of vk backend, since we auto login when decrypting if your account is enabled and is valid.. If there API responds with those error messages it would mean false positive, or maybe your login expired (which is unlikely).

raztoki
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #1808  
Old 21.02.2016, 10:41
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,451
Default

Sometimes it returns the correct code, sometimes with information on the block

**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #1809  
Old 21.02.2016, 10:41
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,451
Default

--ID:139TS:1455995203302-2/20/16 8:06:43 PM - [jd.http.Browser(loadConnection)] ->
{"error":{"error_code":15,"error_msg":"Access denied: this wall available only for community members","request_params":[{"key":"oauth","value":"1"},{"key":"method","value":"wall.get"},{"key":"format","value":"json"},{"ke y":"owner_id","value":"-XXX"},{"key":"count","value":"1"},{"key":"offset","value":"0"},{"key":"filter","value":"all"},{"key":"ex tended","value":"0"}]}}
Reply With Quote
  #1810  
Old 21.02.2016, 10:50
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,451
Default

Administrator wrote to all users:
"If you have trouble accessing the site, change the age at 18+"
but I have set good age

Reply With Quote
  #1811  
Old 21.02.2016, 20:16
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,451
Default

The offset may be changed every 20

Latest content is always an starting offset


**External links are only visible to Support Staff****External links are only visible to Support Staff**

example (end offset)
**External links are only visible to Support Staff****External links are only visible to Support Staff**


Eg. I want to set the limit offset: [120]
**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #1812  
Old 21.02.2016, 20:20
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,451
Default

Example:
Reply With Quote
  #1813  
Old 22.02.2016, 01:20
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,659
Default

sorry, but once again you don't understand.
If offset was to be supported it be from offset position to end, not beginning to offset. That's how the function works on website and would have to work on JDownloader otherwise it would confuse users and we would get too many reports about it. Does VK offer RSS feeds to walls ? maybe you could monitor new posts via that in dedicated RSS software and send new wall objects to JDownloader via API.
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #1814  
Old 22.02.2016, 12:12
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,451
Default



http://113.imagebam.com/download/7dr...05%20AM%3D.jpg

About nothing more questions. Topic can not be considered solved, but can be closed.
Attached Thumbnails
Screen%20Shot%2002-22-16%20at%2011.05%20AM%3D.jpg  

Last edited by raztoki; 22.02.2016 at 15:16.
Reply With Quote
  #1815  
Old 22.02.2016, 15:17
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,659
Default

Ok request is declined since offset is designed for the purpose of offset to end not beginning to offset.

yay a image which I can understand!
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #1816  
Old 22.02.2016, 16:16
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,451
Default Update: VK - Setting the maximum number of decrypt "offset"

VK - Setting the maximum number of decrypt "offset"

https://board.jdownloader.org/showpo...97&postcount=1


I asked for the closure of the topic, because it is possible in a very simple way
feed is not a solution,
in my specific case !!! (Which do not reflect individual walls, I want to really update - only in this case)

Not best solution, but really work
"Manually Interrupted decrypt" = does not decrypt all offset

just need to check the logs in real time.
Reply With Quote
  #1817  
Old 22.02.2016, 16:28
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,451
Default

Mini-example :D

--ID:1557TS:1455995710404-2/20/16 8:15:10 PM - [jd.plugins.decrypter.VKontakteRu(decryptWallLink)] -> Decrypted offset 3800 / 1323924
--ID:1557TS:1455995710404-2/20/16 8:15:10 PM - [jd.plugins.decrypter.VKontakteRu(decryptWallLink)] -> Starting to decrypt offset 3900 / 1323924
Reply With Quote
  #1818  
Old 26.02.2016, 21:35
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,451
Default The number of threads for Vk

The number of threads for Vk?

If he should analyze only one link at the same time?
Code:
 You tried to load the same page more than once in one second.<br>Please go back and try again.<br>
Add 2 link decrypt:

**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Reply With Quote
  #1819  
Old 27.02.2016, 05:17
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,659
Default

@djmakinera
only one task processes at the time, the number of 'threads' isn't the cause of your drama, its the constant decrypting and downloading

raztoki
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #1820  
Old 28.02.2016, 10:37
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,451
Default

So try to open multiple "DIFFERENT" pages in a browser you'll get an error that trying to load the same page "within 1 second.

"DIFFERENT" pages(eg. different id link) = load the same page
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 10:33.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.