[pspzockerscene]

Originally Posted by djmakinera

Apparently, "search" is not supported, but the materials automatically establish such an address.
But nothing is impossible.
This expression (constantly improved) only shows the actual link to the video or other material.
That is why I will be thankful for your support.

Yes I understand that your URL leads to a single video.
This is already supported and working fine here but an account is required!

Originally Posted by djmakinera

((\bwall|\bphoto|\bvideo|\btopic)(\-*)(\d+)_(\d+))|(club|id|public|group|board|albums|sel=[c]*)(\-*)(\d+)|(\bfriends\b|\bfeed\b|\bgroups\b|\bfave\b|\bphotos\b|\bvideos\b|\bim\b(?!\?))

Test Regex:
https://postimg.cc/0zZdBg9Z

I know how RegEx works - I do not need your help


If it does not work for you, please post a log.

Please post your log-ID here | bitte poste deine Log-ID hier.

Originally Posted by djmakinera

This may be because the address in the browser is not real, it only shows part of the link and the material may not be available.
But I don't know what information I could provide because you would have to analyze the group (wall with links).
For example, after clicking on a material, the link adds other parts of parameters to the normal link. If I find this situation, I will provide a link and a log.

No idea what you mean.
Your URL is fine and JD will change it to "vk.com/video-bla" which will also work fine.

-psp-

[djmakinera]

Vk Decrypt problem:

Caused by: com.fasterxml.jackson.core.JsonParseException: Unexpected character ('i' (code 105)): was expecting double-quote to start field name

Log:
10.03.20 12.46.45 <--> 10.03.20 13.00.00 jdlog://8914715302851/

[pspzockerscene]

Originally Posted by djmakinera

Vk Decrypt problem:

Caused by: com.fasterxml.jackson.core.JsonParseException: Unexpected character ('i' (code 105)): was expecting double-quote to start field name

This is only a warning which does not lead to a complete stop!
It is working fine here with- and without account:

Originally Posted by djmakinera

Log:
10.03.20 12.46.45 <--> 10.03.20 13.00.00 jdlog://8914715302851/

Again you are asking about one thing and then post a log which has nothing todo with that one thing ...

Add a better problem description, add a new log!

-psp-

[djmakinera]

Problem decrypt all photos album:

----------------Request Content-------------
<!--{"payload":["8",[""You tried to load the same page more than once in one second.<br>Please go back and try again.""

Album: 20903 photos
Decrypt: vk.com: Done, decrypted: 8160 links!

**External links are only visible to Support Staff****External links are only visible to Support Staff**

10.03.20 12.46.45 <--> 10.03.20 13.39.12 jdlog://4024715302851/

[pspzockerscene]

I've fixed the retry function for this case.

I was able to successfully get all 20906 items in ~5 minutes.

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!
---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

-psp-

[bcrj]

Originally Posted by bcrj

link grabber ignores all vk.com video links to videos that are over 25 mins long.

up to 24m59 secs I have no problems using the vk.com host plugin for any resolution.
above 25m links are ignored for all resolutions.

Using other download methods (saveVK for example) there seems to be no issue.

Is this a JDownloader2 limitation?

Please post example URLs!


No - at least not on purpose!

Sorry about coming back so late.

Examples:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
bbc News 24m28sec - link grabber identified the link immediately and it downloads

This vid from same VK.com user
**External links are only visible to Support Staff****External links are only visible to Support Staff**
27m03secs
plays fine but is not picked up by linkgrabber when copied not when inserted in via +Add New Links.
The issue seems to be around a 25 min limit above which JDownloader2 ignores vk.com files.
This issue with vk.com only has been around for at least last 6 months, perhaps longer

REspect for the great product.

[pspzockerscene]

Originally Posted by bcrj

Sorry about coming back so late.

No problem

Originally Posted by bcrj

plays fine but is not picked up by linkgrabber when copied not when inserted in via +Add New Links.
The issue seems to be around a 25 min limit above which JDownloader2 ignores vk.com files.
This issue with vk.com only has been around for at least last 6 months, perhaps longer

REspect for the great product.

As said there is no such limit.

Your 2nd video can only be viewed when you're logged in.
You can simply test that by opening it in a private browser window

With my VK account activated in JDownloader, I can add- and download your 2nd video just fine

-psp-

[bcrj]

Originally Posted by pspzockerscene

No problem


As said there is no such limit.

Your 2nd video can only be viewed when you're logged in.
You can simply test that by opening it in a private browser window

With my VK account activated in JDownloader, I can add- and download your 2nd video just fine

-psp-

Aha - that explains a lot - thanks.
A vk.com limitation.
I never really thought they I was logged into to vk.com on the browser - but I was of course.

Many thanks - great product

[pspzockerscene]

Thanks for your feedback.

Now that I have a little bit more time, you can send me more VK issues.

I've already fixed- and improved a lot but a crawler like this is a never ending story especially if they decide to make website changes again

-psp-

[sharkboy]

I have a question. How to set limited "offset=" wall parse?
I want to download only the latest materials, I don't want to parse the entire wall again.

Example:
Min offset=0
Max offset=60
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

[pspzockerscene]

Try using "currentoffset" as the start-offset and "maxoffset" as the end-offset.
This should work.

-psp-

[sharkboy]

Hello. I have a problem and I would like to ask for help.

Probably incorrect change link.
Completely different than it should replace the link. Also looking for a 'wall'.
Can you go back to the old method of replacing/change 'id' with 'albums'?


1 album
9 photo
Source link:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

replace with:
**External links are only visible to Support Staff****External links are only visible to Support Staff**


Source link:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

replace with:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

[OniiW5ZNlOdq69MNwC*jC3mDK]

Hi not sure if this is the correct place to ask.

When adding VK video URLs Jdownloader uses the video "title" for some links while other times it ues the source url and group name?

for instance:

**External links are only visible to Support Staff****External links are only visible to Support Staff** = VPorn_-131933199_456241718_1080p

while this url does this

**External links are only visible to Support Staff****External links are only visible to Support Staff** = Kira Queen - XXXX - Sex party with friends 1080p_1080p

[pspzockerscene]

@sharkboy
Works fine here.
For your "/id" URL, I get 3 packages, one with 9 items, one with 1 item and one containing an offline element only.

Your 2nd URL is a wall URL.
There is no need to replace it in the plugin.
If you want this, please do this manually.

@OniiW5ZNlOdq69MNwC*jC3mDK
Fixed.
This was caused by an odl pice of code, preventing "too long filenames" from being used.

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!
---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

-psp-

[sharkboy]

Wrong data decrypt for album.

Example source:
**External links are only visible to Support Staff****External links are only visible to Support Staff**



JD2. Decrypt: 10 album

User: only 6 album

also wrong id
124167161_000

[pspzockerscene]

I can see 9 albums via browser.
In JD I got 9 packages containing different amounts of items.
One of them contains over 9000 items.

Please add a better problem description.
Please add a screenshot where I can see which albums you expect it to grab and which ones not.

-psp-

[sharkboy]

I'm trying to add links, but parsing doesn't work. Stops.

Decrypted 0 total links out of a wall-link

**External links are only visible to Support Staff****External links are only visible to Support Staff**

[pspzockerscene]

Sorry for the late answer.

@sharkboy
Adding your URL gets me over 600 items wth- and without vk account!
I've stopped testing at this point.
If you are still having this issue, please post a log:
Please post your log-ID here | bitte poste deine Log-ID hier.


Apart from that:
I've been working on this from time to time.
I still got some points on my TODO list but overall, vk is working good and login is also working but it will fail if you have 2-factor-auhentification enabled in your vakontakte account!

I've added a warning message for such users just preventive.

-psp-

[sharkboy]

Thanks for the answer. I understand you, but this is due to the Advanced Settings Plugin (It does not depend on the 2-step verif. Account).
I just want to download the source of the page <div class="wall_post_text"> some text here </div>, actually without data (no video files, no pictures etc.), and only collect this information in the log.

vk.com_jd.plugins.decrypter.VKontakteRu.log

Log.maxlogfilesize: set: 1GB+

Depending on the page size, the logs contained even 1GB of data and it is perfectly correct, because it saved almost everything I needed. It was possible - currently not working. It stops "Collect log".
Please turn off typical settings and test e.g.
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Screenshot my plugin setting:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

[sharkboy]

Turn on the advanced setting: grab photo link
Now it collects the text in the log. Yes, so what I just expect.

**External links are only visible to Support Staff****External links are only visible to Support Staff**

[pspzockerscene]

@sharkboy
1. Regarding log and log size:
No idea what you mean.

2. Regarding plugin settings:
Your settings were wrong.
By default, JD grabs everything so you must have changed them to only grab documents.

3. The log will even warn you about bad settings:

 [ jd.plugins.decrypter.VKontakteRu(decryptSingleWallPostAndComments_Website) ] -> Found 0 items
 [ jd.plugins.decrypter.VKontakteRu(decryptWall_Website) ] -> Failed to find any items for offset: 40
 [ jd.plugins.decrypter.VKontakteRu(decryptWall_Website) ] -> Found 0 items so far
 [ jd.plugins.decrypter.VKontakteRu(decryptWall_Website) ] -> Stopping because: Failed to find more items for 5 times in the row
 [ jd.plugins.decrypter.VKontakteRu(decryptWall_Website) ] -> Done!
 [ jd.plugins.decrypter.VKontakteRu(decryptIt) ] -> Decrypted 0 total links out of a wall-link
 [ jd.plugins.decrypter.VKontakteRu(decryptIt) ] -> Check your plugin settings -> They affect the results!

4. Regarding your post #2820:
As already said before it is working fine here.
If I leave it running for some time, it will find 1364 photo items.
EDIT2
All items were downloadable without any issues --> 1364 items --> 149,54 MiB

-psp-
EDIT

5. No we do not provide a page source (.html) crawler.
If you want to do this, please use other tools!

[sharkboy]

I think you misunderstood me. I don't mean HTML code, which is completely unnecessary for me.
The "Decrpter log" contains all the information I need, which I want to extract "String Only". And that's what this is about!
It also works well here, only for different sites should be set differently setting and everything will collect whatever the user wants.

Also, after changing the settings it works - and no third-party tool is required!

[pspzockerscene]

Originally Posted by sharkboy

I think you misunderstood me. I don't mean HTML code, which is completely unnecessary for me.
The "Decrpter log" contains all the information I need, which I want to extract "String Only". And that's what this is about!

Ok.

Originally Posted by sharkboy

It also works well here, only for different sites should be set differently setting and everything will collect whatever the user wants.

No idea what you mean.
Do you mean different plugin settings for different types of links or so?
Sorry, if you ask me, the current settings are fine for normal users.
Our tool is not designed e.g. to crawl complete websites.
If you are looking for something like this, you are wrong here.

Originally Posted by sharkboy

Also, after changing the settings it works - and no third-party tool is required!

Ok.

-psp-

[sharkboy]

No idea what you mean.
Do you mean different plugin settings for different types of links or so?

Crawling all the offset on the wall - it's probably not a complicated thing in JD2.
Parsing takes a few minutes to several minutes in this case, because I always minimize the settings (and this means less required things to analyze).

[pspzockerscene]

What do you mean with "minimize"?

What does this have to do with the offset?
Do you mean that the crawler gets slow when it parses a lot of elements?
This should not happen as it will dump old data after 5000 URLs and start again with that offset.

Are you a 2nd account of the user "djmakinera"?
Just in case:
You know that it is prohibited to re-register after being banned in a forum?

-psp-

[sharkboy]

I don't know what you are talking about, what account. I don't understand why you accuse me of such things.

I will just select just anything (just be on the wall) and it will only analyze these files instead of all the files on the wall, and by the way I will have html in the log
HTML Anchor tag
<a\s+(?:(?:\w+\s*=\s*)(?:\w+|"[^"]*"|'[^']*'))*?\s*href\s*=\s*(?<url>\w+|"[^"]*"|'[^']*')(?:(?:\s+\w+\s*=\s*)(?:\w+|"[^"]*"|'[^']*'))*?>.+?</a>

[pspzockerscene]

Ok - this was just a friendly reminder that we have forum rules here that apply for everyone.
Of course you can do whatever you want with your own logs.

-psp-

[jdjon10]

Hi! I have problems with vk.com videos.
Yesterday JD didn’t find any video under:
Psychosis **External links are only visible to Support Staff****External links are only visible to Support Staff** [video is available till 9 May 2020 at 6.30pm CET]
Here is the log for the time I tried and didn’t succeed: 08.05.20 20.32.28 <--> 08.05.20 20.42.59 jdlog://7135915302851/

JD doesn’t find any video here:
Tchaikovsky **External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff** (the same link and video)
Both don’t work, I don’t why. Here is the log for the time I tried and didn’t succeed: 09.05.20 17.10.13 <--> 09.05.20 17.19.09 jdlog://1235915302851/

[pspzockerscene]

@jdjon10
For link 1 & 3 , I get this errormessage via browser (even when I'm logged-in):

For link 2, I get this errormessage via browser:


No idea how you expect JD to grab content that is offline ...

-psp-

[jdjon10]

Thank you for the answer, pspzockerscene. You are right, all the videos are deleted now.
But at the time of my message one could watch both videos without any account (I don't have one) in any browser without any problem, but JD didn't grab them. I thought, you can follow these circumstances via these Logs.
I would't expect JD to grab the content, which is offline

[pspzockerscene]

I was unable to find anything useful in your log.

Please post another log if that happens again - best would be content that is still online once I'm there to check your logs

-psp-

[jdjon10]

Originally Posted by pspzockerscene

best would be content that is still online once I'm there to check your logs -psp-

:biggrin: That would be surely the best. But its really going to be difficult in these strange corona times, if many videoproductions are only online for a few hours.

[pspzockerscene]

If you want you can just keep me updated via PN this way I might read it soon enough but as said, I was unable to reproduce any issues with this plugin, at least with video downloading.

-psp-

[sharkboy]

Problem detecting these types of video links.
Source:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

The plugin should redirect to the video address:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

[mynamejeff]

it adds html and js code from the page into the file/folder name and trying to remove these tags hangs up jdownloader and I have to force close it.

example links:

**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**


05.06.20 15.49.22 <--> 05.06.20 15.49.23 jdlog://0692025302851/

[pspzockerscene]

Hi,

fixed.

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!
---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

-psp-

[pspzockerscene]

@sharkboy
Fixed!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!
---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

-psp-

[mynamejeff]

@pspzockerscene

when I try to remove the old links (the one that had the symbols and html tags in it) from jdownloader. the ui hangs and I have to restart it and the link is not removed.

07.06.20 15.19.48 <--> 07.06.20 15.21.25 jdlog://9353025302851/

[pspzockerscene]

Hm this did not happen here but I can imagine this happening due to this huge string that was set as filename.

At this moment the only thing I can recommend you would be to delete your current downloadlist and backup all URLs you want to keep in beforehand.
Similar to here but instead of using these backups/downloadlistXXX files, just delete all of them:
https://support.jdownloader.org/Know...nkgrabber-list

-psp-

[sharkboy]

It does not detect the single wall post with the (GIF extension).
Detects only 2 pictures (JPG) in the comment.

**External links are only visible to Support Staff****External links are only visible to Support Staff**