[pspzockerscene]

Hi,

I've added this to our existing vk ticket:


Support for .gif images in the near future is unlikely going to be added ...

-psp-

[sharkboy]

Issue parsing.
Do not parse all albums if more than 50.
There should be 52 albums.

Source:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Missing album:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

[pspzockerscene]

Fixed.
It found all 46 000 entries (52 packages/albums) here.

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!
---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

-psp-

[sharkboy]

Problem, parsing wall stuck at "Found 5030"
Crawling stuck...
It doesn't even register anything new in the log since that moment in...
vk.com_jd.plugins.decrypter.VKontakteRu

**External links are only visible to Support Staff****External links are only visible to Support Staff**

Enabled "all types Grab" (setting)

[sharkboy]

A lot of data losting during decryption, many links are not found during analysis, please see for example if the log contains this type of link:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
I do not have, like many others ... (the more older the post analyzes), the more these links will not be found ...

Important: Only please start test decrypting from source:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

[pspzockerscene]

I'm unable to reproduce your issue and it never gets stuck for me.

It is possible that there is a large amount of posts in a row without any downloadable content.

Right now I got 5058 vk URLs and 1 youtube package.

Please post your log-ID here | bitte poste deine Log-ID hier.

-psp-

[sharkboy]

This is not a big wall. 10k only It is really small and should parse quickly.
The log should be significantly larger than 180 MB, if it stops in the log nothing new is recorded even for an hour or more or unknown long time
I don't parse all photo links in the log, and it's easy to check (find url editor)
Work maybe some firsts offset, and other stuck...
Probably (!!) this is caused if the wall contains any video links, then you can never fully analyze the site. All the time then parsing is endless over and over and nothing is registered in the log further!
But I only want to complete register log.

The log takes 110MB.
I had to stop because I never stop working even when I work all day. Copmplete stuckIt doesn't register anything new in the log!

27.06.20 20.43.11 <--> 27.06.20 20.55.58 jdlog://7748025302851/

[sharkboy]

Parsing is complete. Links are missing e.g. to posts, photos (not video!) E.g. from this offset or all recent offsets (approximately)

See screenshot. Click on some photo (walll website vk.com) copy -idXXX_XXX and search in the DECRYPTER log.


**External links are only visible to Support Staff****External links are only visible to Support Staff**

[pspzockerscene]

Sorry but without detailed URLs to the missing content, I'm unable to help you.

Also you seem to be the only user with this issue.

-psp-

[jdjon10]

Originally Posted by pspzockerscene

Please post another log if that happens again - best would be content that is still online once I'm there to check your logs -psp-

Originally Posted by pspzockerscene

If you want you can just keep me updated via PN this way I might read it soon enough but as said, I was unable to reproduce any issues with this plugin, at least with video downloading. -psp-

pspzockerscene, I still have problems with vk.com videos. JD can’t find any video here: **External links are only visible to Support Staff****External links are only visible to Support Staff**
You can watch it in the browser without any problem.
In JD it looks like “offline” and instead of the videofile you see this line: “video-130074765_456239794”.
29.06.20 21.12.02 <--> 29.06.20 21.17.43 jdlog://1698025302851/
I hope you see it soon enough. I'll try to send a PN to you.

[pspzockerscene]

@jdjon10

I'm unable to reproduce your issue.
I get one item, 1080+ and about 4,9GiB in size.

Please open a new JD session (= restart JD), do NOT add anything else but problematic vk.com URLs and then upload a new log.

-psp-

[jdjon10]

Hi pspzockerscene,
The video from yesterday works now for me as well: 1080p and about 4,9 GB in size.

Originally Posted by pspzockerscene

@jdjon10
Please open a new JD session (= restart JD), do NOT add anything else but problematic vk.com URLs and then upload a new log.

The video from today has the same problem: **External links are only visible to Support Staff****External links are only visible to Support Staff**
In JD it looks like “offline” but you can watch it in the browser.
In the log-file are only 4-5 minutes, only this link (exactly like the log of yesterday) 01.07.20 21.46.20 <--> 01.07.20 21.50.28 jdlog://1649025302851/
I hope that you can see the link soon...

[pspzockerscene]

Originally Posted by jdjon10

Hi pspzockerscene,
The video from yesterday works now for me as well: 1080p and about 4,9 GB in size.

The video from today has the same problem: **External links are only visible to Support Staff****External links are only visible to Support Staff**
In JD it looks like “offline” but you can watch it in the browser.

This "offline" status will often happen on plugin failures for vk.com URLs because for this website, it is really hard to tell if content is offline or if there is a plugin issue ...

Originally Posted by jdjon10

In the log-file are only 4-5 minutes, only this link (exactly like the log of yesterday) 01.07.20 21.46.20 <--> 01.07.20 21.50.28 jdlog://1649025302851/
I hope that you can see the link soon...

As said, I've implemented a workaround which may- or may not solves your issue.

Please wait for the next CORE-Update to get released to try it out:

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!
---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

-psp-

[jdjon10]

Thank you for the answer, pspzockerscene.
This video from today evening, which doesn’t work in JD, is definitely online, because at the same time you can download it with youtube-dl.
**External links are only visible to Support Staff****External links are only visible to Support Staff**
02.07.20 22.34.40 <--> 02.07.20 23.06.26 jdlog://5869025302851/

C:\Users\b>youtube-dl --list-formats **External links are only visible to Support Staff****External links are only visible to Support Staff**
[vk] -130074765_456239801: Downloading JSON metadata
[vk] -130074765_456239801: Downloading m3u8 information
[info] Available formats for -130074765_456239801:
format code extension resolution note
hls-1474 mp4 640x360 1474k
hls-1966 mp4 853x480 1966k
hls-2949 mp4 1280x720 2949k
hls-4423 mp4 1920x1080 4423k (best)

I hope that this workaround solves this issue.

[pspzockerscene]

Hi again,

I don't need any new logs/example URLs regarding this issue.

Please wait for the next CORE-update and check it it resolves your issues.
In the meantime you can download such videos with the help of browser addons like "Video DownloadHelper" & JDownloader or, as you've already discovered, youtube-dl.

-psp-

[sharkboy]

pspzockerscene
I can't download content from the wall.
If I start the analysis from the beginning.
I will open the log and want to find the content, but there is none. Not found.
I know that once I could see every "offset" number in the log - now I don't know this detailed information in the log.

I entered in the test editor and extracted all "jd2" offset - I didn't analyze some offset
offset=(\d+)
[spoiler]
Correct per one offset=20+
Bug:

offset=11143
offset=11143

This is a decryption error, it analyzes the wrong offset (see in the log Log.maxlogfilesize, 200 + MB log size setting is required) to record all data There is no such thing as:

All posts11,143
Enter a word or phrase here ...
The wall is empty.

04.07.2020 (Date)
Correct max:
?offset=11140

I analyze/crawling the wall for about 10 minutes.

[sharkboy]

New informations.
I found an error.
The log cuts off at offset =
offset = 2480
So after ~2500 to 11140, offset is no longer properly analyzed (missing content)

The offset list is here:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

example wall
**External links are only visible to Support Staff****External links are only visible to Support Staff**

[pspzockerscene]

Working fine here.
You can also let JD only crawl a range e.g.:
vk.com/wall-123456789?currentoffset=2500&maxoffset=3000

-psp-

[sharkboy]

In my log, the scope indicated by me is clearly missing.
If possible, send me the full (high compressed) log.
You can only delete "sensitive user data" if there are any, thank you in advance.
I will need it so that I can compare my log with yours, which is actually missing. And indicate if you are really ok.
Tell me what size your log contains and tell me what are your current advanced plugin settings. Settings screenshot, please.

[sharkboy]

Example:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

This is not a valid links an invalid range.

[jd.plugins.decrypter.VKontakteRu(decryptWall_Website)] -> Decrypting offset 260
act=get_wall&al=1&fixed=&offset=260&owner_id=-120780206&type=own&wall_start_from=260



Min Value 0
Max. Value 11280

\?offset=0*([0-9]|[1-8][0-9]|9[0-9]|[1-8][0-9]{2}|9[0-8][0-9]|99[0-9]|[1-8][0-9]{3}|9[0-8][0-9]{2}|99[0-8][0-9]|999[0-9]|10[0-9]{3}|11[01][0-9]{2}|112[0-7][0-9]|11280)

The log cannot be uploaded, is too large, and an error occurs.
[null][null]

title: Exception ocurred