JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #2881  
Old 24.08.2020, 13:55
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 54,869
Default

Merged VK threads.

@miguelsat
Check Settings --> Plugins --> vkontakte.ru

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #2882  
Old 16.09.2020, 16:11
sharkboy sharkboy is offline
Bandwidth Beast
 
Join Date: Apr 2020
Posts: 135
Default

The problem with crawling of posts containing, for example, content + photos, or the wall text content itself is strictly dependent on the "Grab URLs inside wall post" setting, which must be enabled additionally from "grabb album + grabb photo"
Previously, I thought only
Enable the settings "photo" + "album" does not crawl all content offset
Which proves confusing so you can add a little note in the plugin's advanced settings that this option also applies to photos.
Reply With Quote
  #2883  
Old 16.09.2020, 16:49
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 54,869
Default

Again I do not understand what you mean.

That setting is relevant for:
- Crawling a complete WALL of a user
- Crawling a WALL-post

If you're experiencing issues with this functionality, please add a detailed description and a log.

I do not see the need to add any kind of extra description to that mentioned plugin setting.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #2884  
Old 16.09.2020, 18:30
sharkboy sharkboy is offline
Bandwidth Beast
 
Join Date: Apr 2020
Posts: 135
Default

For example
If grabb turns on:
Code:
Album links
Photo links
Log is not complete, especially old posts are not logged. Omits some data (photos, text). Especially if the post is long and you need to click "Show all"

If I enable grabb:
Code:
Album links
Photo Links
URLs inside
All the necessary data is saved in the log (i.e. the text in the posts of the user who has posted on the wall). It's probably obvious just like people posting some posts in a Facebook group, that's what I mean.



Code:
All data is recorded in the log:
C:\JD\logs\
Vkontakte.Decrypter IDXXX.log
Reply With Quote
  #2885  
Old 17.09.2020, 00:18
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 54,869
Default

Again:
Without a log, I'm unable to help you.
I need working example URLs, I need the exact URLs to the posts of which content does not get crawled.

Without this, I won't be able to help you.

-psp-
EDIT

And again:
I know you're playing around with JDownloaders log content --> This is not any kind of (official) feature so I will not help you to get content of the vk website in our logs.
If you are having a real issue with our plugin, provide the required logs so that I can try to help you ...
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #2886  
Old 17.09.2020, 08:45
sharkboy sharkboy is offline
Bandwidth Beast
 
Join Date: Apr 2020
Posts: 135
Default

Surely you think that I underestimate your time, your dedication and your work. You're wrong.

Everything is fine for me now, only you misinterpret my posts.
Previously, I gave the links, nothing in these links has changed and is still the same, and I do not want to spam the same links over and over again.
You just didn't reply to my previous older posts. Probably skip a very important post.
You didn't give me an answer. I asked you for a screen of your advanced Vkontakte plugin settings. How do I know what your settings are and everything is OK decrypt for you.
If you had given me a screenshot earlier, I would have avoided a 1-month ban.
You can provide a screenshot of your settings "deprypt all photo in wall", I mean only photos without other materials. Just enough. That should clear things up.

**External links are only visible to Support Staff**...
Reply With Quote
  #2887  
Old 17.09.2020, 09:51
sharkboy sharkboy is offline
Bandwidth Beast
 
Join Date: Apr 2020
Posts: 135
Default

Defective decryption of user profile (photo albums)

Source:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

shouldbe decrypt two album:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Also check the correctness of the decrypted ID-album XXX_XXX

17.09.20 09.47.48 <--> 17.09.20 09.51.45 jdlog://5007225302851/
Reply With Quote
  #2888  
Old 17.09.2020, 17:03
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 54,869
Default

Quote:
Originally Posted by sharkboy View Post
Defective decryption of user profile (photo albums)
[...]
shouldbe decrypt two album:[...]
No it should not.
These albums are nowhere linked in that profile.
In this case, only the single photos will be crawled.

I still don't see any issue here.

I expect more precise descriptions otherwise you're again just wasting my time ...
Where are these albums linked on that profile?
Add a URL which leads directly to the single wall post that contains these albums otherwise it will be impossible for me to even verify your request ...

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #2889  
Old 17.09.2020, 17:42
sharkboy sharkboy is offline
Bandwidth Beast
 
Join Date: Apr 2020
Posts: 135
Default

Previously, fully supportive, even in this topic there was an old topic of changing nickname to albumsXXX (albumsID)
You improved the plugin after changing the new graphic design of Vkontakte, but nothing has changed here, there should be the same method of changing the main profile name or id to albums.

Decrypt source:
nickname -> albumsXXX
**External links are only visible to Support Staff****External links are only visible to Support Staff**
change to: **External links are only visible to Support Staff****External links are only visible to Support Staff**


id -> albumsXXX
**External links are only visible to Support Staff****External links are only visible to Support Staff**
change to: **External links are only visible to Support Staff****External links are only visible to Support Staff**

Screen:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #2890  
Old 18.09.2020, 15:28
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 54,869
Default

Quote:
Originally Posted by sharkboy View Post
Previously, fully supportive, even in this topic there was an old topic of changing nickname to albumsXXX (albumsID)
You improved the plugin after changing the new graphic design of Vkontakte, but nothing has changed here, there should be the same method of changing the main profile name or id to albums.
This might have been an old setting which has been removed.

So far you're the only user who is asking for this functionality.

I will not implement this as I do not see any advantage of this for any of our other users.
Again you seem to do site-rips and other dubious things for which special scripts are needed.
If you need special software solutions for your plans, find a company that makes them for you but do not ask us for functionality which only you would use.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #2891  
Old 09.10.2020, 20:43
sharkboy sharkboy is offline
Bandwidth Beast
 
Join Date: Apr 2020
Posts: 135
Default

If you add vk.com/id or vk.com/nickname - The link to the album is directly in the source of the page (profile user), so even "Deep-Crawl" is disabled in the plugin in this case? No write special script is required in the case.

<a class="page_counter" href="/albumsXXXXX?profile=1"

<a\s+(?:(?:\w+\s*=\s*)(?:\w+|"[^"]*"|'[^']*'))*?\s*href\s*=\s*(?<url>\w+|"[^"]*"|'[^']*')(?:(?:\s+\w+\s*=\s*)(?:\w+|"[^"]*"|'[^']*'))*?>.+?</a>
/[0-9]+/[0-9]+/[0-9]+/[0-9-]+
Reply With Quote
  #2892  
Old 12.10.2020, 15:01
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 54,869
Default

As we've already told you multiple times:
You cannot use the deep-crawler if a plugin is there to handle the URLs that you want to add.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #2893  
Old 12.10.2020, 18:03
sharkboy sharkboy is offline
Bandwidth Beast
 
Join Date: Apr 2020
Posts: 135
Default

I still see the bug Crawler

Example:
User Two album
**External links are only visible to Support Staff****External links are only visible to Support Staff**

7 + 241 number photos

See LinkCrawler screenshot:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Log:
12.10.20 17.54.26 <--> 12.10.20 18.03.07 jdlog://7624325302851/
Reply With Quote
  #2894  
Old 12.10.2020, 18:44
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 54,869
Default

Works fine here.
Also, your screenshot shows another URL than the one that is in your post.
Screenshot:


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #2895  
Old 12.10.2020, 18:49
sharkboy sharkboy is offline
Bandwidth Beast
 
Join Date: Apr 2020
Posts: 135
Default

I use Chrome and it shows me the link correctly when I click in the album.

The crawler's wrong is that it decrypt the same pictures on the wall even unnecessarily:

See in the log:
decryption: wall_post_ID

This is a photo album, not a wall.
Reply With Quote
  #2896  
Old 12.10.2020, 18:55
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 54,869
Default

Quote:
Originally Posted by sharkboy View Post
See in the log:
decryption: wall_post_ID
Yes because the function that crawls the content is used for multiple types of URLs.

Stop these random reports!
You can get our source-code HERE.
You can check such things before making unnecessary reports!


-psp-
EDIT

Source code:
See jd.plugins.decrypter.VKontakteRu.java
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #2897  
Old 12.10.2020, 19:05
sharkboy sharkboy is offline
Bandwidth Beast
 
Join Date: Apr 2020
Posts: 135
Default

But JD2 also parses such links.
Add crawl:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
also parse...
**External links are only visible to Support Staff****External links are only visible to Support Staff**

If the user has huge walls. This can take a lot of time to parse the wall, not small albums.
So I want to avoid parsing big walls, I just want an just album
Please understound.
Reply With Quote
  #2898  
Old 12.10.2020, 19:10
sharkboy sharkboy is offline
Bandwidth Beast
 
Join Date: Apr 2020
Posts: 135
Default

I've seen a lot of forums, and it seemed a polite and friendly atmosphere, but you dismiss everything as it goes ...
I understand your indignation and the lack of any understanding on your part, possibly some personal dislike of me.
I prefer to be silent than next warns/bans.
Since it won't change anything.
Goodbye.
Reply With Quote
  #2899  
Old 12.10.2020, 19:17
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 54,869
Default

Regarding your "z=albums" URL:
- Yes JD can handle such URLs
- Your URL shows the following error in browser: "This profile is private"
--> Same with the same URL/ID as "wall" link.
I cannot open that URL and I still have no idea which bug you mean.

If you need specified vkontakte crawler feature, please use other software that is specifically designed therefore ...

Quote:
Originally Posted by sharkboy View Post
I've seen a lot of forums, and it seemed a polite and friendly atmosphere, but you dismiss everything as it goes ...
I understand your indignation and the lack of any understanding on your part, possibly some personal dislike of me.
That is wrong!
You're disrespecting our forum rules, wasting our time, reporting nonsense-reports and doing all of this with a broken/auto-translated English which is hard to understand.

Quote:
Originally Posted by sharkboy View Post
I prefer to be silent than next warns/bans.
Since it won't change anything.
Goodbye.
Good idea!

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #2900  
Old 12.10.2020, 19:29
sharkboy sharkboy is offline
Bandwidth Beast
 
Join Date: Apr 2020
Posts: 135
Default

All links to albums require an account.
If you don't have accounts, you will see "private album / private profile" or some "unknown error" all the time.
Without an account, nothing will work.
Do you have an Vkontakte account or do you use: "No account"?
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 14:14.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.