JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #2841  
Old 15.06.2020, 18:10
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 53,736
Default

Hi,

I've added this to our existing vk ticket:


Support for .gif images in the near future is unlikely going to be added ...

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
How to create a log || Wie man einen Log erstellt
Captcha FAQ EN || Captcha FAQ DE || Erste Schritte & Tutorials
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #2842  
Old 17.06.2020, 00:22
sharkboy sharkboy is offline
Banned
 
Join Date: Apr 2020
Posts: 82
Default

Issue parsing.
Do not parse all albums if more than 50.
There should be 52 albums.

Source:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Missing album:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #2843  
Old 17.06.2020, 14:39
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 53,736
Default

Fixed.
It found all 46 000 entries (52 packages/albums) here.

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
How to create a log || Wie man einen Log erstellt
Captcha FAQ EN || Captcha FAQ DE || Erste Schritte & Tutorials
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #2844  
Old 26.06.2020, 22:16
sharkboy sharkboy is offline
Banned
 
Join Date: Apr 2020
Posts: 82
Default

Problem, parsing wall stuck at "Found 5030"
Crawling stuck...
It doesn't even register anything new in the log since that moment in...
vk.com_jd.plugins.decrypter.VKontakteRu

**External links are only visible to Support Staff****External links are only visible to Support Staff**

Enabled "all types Grab" (setting)
Reply With Quote
  #2845  
Old 26.06.2020, 23:06
sharkboy sharkboy is offline
Banned
 
Join Date: Apr 2020
Posts: 82
Default

A lot of data losting during decryption, many links are not found during analysis, please see for example if the log contains this type of link:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
I do not have, like many others ... (the more older the post analyzes), the more these links will not be found ...

Important: Only please start test decrypting from source:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #2846  
Old 27.06.2020, 18:56
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 53,736
Default

I'm unable to reproduce your issue and it never gets stuck for me.

It is possible that there is a large amount of posts in a row without any downloadable content.

Right now I got 5058 vk URLs and 1 youtube package.

Please post your log-ID here | bitte poste deine Log-ID hier.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
How to create a log || Wie man einen Log erstellt
Captcha FAQ EN || Captcha FAQ DE || Erste Schritte & Tutorials
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #2847  
Old 27.06.2020, 20:59
sharkboy sharkboy is offline
Banned
 
Join Date: Apr 2020
Posts: 82
Default

This is not a big wall. 10k only It is really small and should parse quickly.
The log should be significantly larger than 180 MB, if it stops in the log nothing new is recorded even for an hour or more or unknown long time
I don't parse all photo links in the log, and it's easy to check (find url editor)
Work maybe some firsts offset, and other stuck...
Probably (!!) this is caused if the wall contains any video links, then you can never fully analyze the site. All the time then parsing is endless over and over and nothing is registered in the log further!
But I only want to complete register log.

The log takes 110MB.
I had to stop because I never stop working even when I work all day. Copmplete stuckIt doesn't register anything new in the log!

27.06.20 20.43.11 <--> 27.06.20 20.55.58 jdlog://7748025302851/
Reply With Quote
  #2848  
Old 27.06.2020, 21:27
sharkboy sharkboy is offline
Banned
 
Join Date: Apr 2020
Posts: 82
Default

Parsing is complete. Links are missing e.g. to posts, photos (not video!) E.g. from this offset or all recent offsets (approximately)

See screenshot. Click on some photo (walll website vk.com) copy -idXXX_XXX and search in the DECRYPTER log.


**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #2849  
Old 29.06.2020, 13:01
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 53,736
Default

Sorry but without detailed URLs to the missing content, I'm unable to help you.

Also you seem to be the only user with this issue.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
How to create a log || Wie man einen Log erstellt
Captcha FAQ EN || Captcha FAQ DE || Erste Schritte & Tutorials
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #2850  
Old 29.06.2020, 21:23
jdjon10 jdjon10 is offline
Linkgrabbing Monster
 
Join Date: Aug 2010
Posts: 80
Default

Quote:
Originally Posted by pspzockerscene View Post
Please post another log if that happens again - best would be content that is still online once I'm there to check your logs -psp-
Quote:
Originally Posted by pspzockerscene View Post
If you want you can just keep me updated via PN this way I might read it soon enough but as said, I was unable to reproduce any issues with this plugin, at least with video downloading. -psp-
pspzockerscene, I still have problems with vk.com videos. JD can’t find any video here: **External links are only visible to Support Staff****External links are only visible to Support Staff**
You can watch it in the browser without any problem.
In JD it looks like “offline” and instead of the videofile you see this line: “video-130074765_456239794”.
29.06.20 21.12.02 <--> 29.06.20 21.17.43 jdlog://1698025302851/
I hope you see it soon enough. I'll try to send a PN to you.
Reply With Quote
  #2851  
Old 30.06.2020, 13:21
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 53,736
Default

@jdjon10

I'm unable to reproduce your issue.
I get one item, 1080+ and about 4,9GiB in size.

Please open a new JD session (= restart JD), do NOT add anything else but problematic vk.com URLs and then upload a new log.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
How to create a log || Wie man einen Log erstellt
Captcha FAQ EN || Captcha FAQ DE || Erste Schritte & Tutorials
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #2852  
Old 01.07.2020, 21:56
jdjon10 jdjon10 is offline
Linkgrabbing Monster
 
Join Date: Aug 2010
Posts: 80
Default

Hi pspzockerscene,
The video from yesterday works now for me as well: 1080p and about 4,9 GB in size.
Quote:
Originally Posted by pspzockerscene View Post
@jdjon10
Please open a new JD session (= restart JD), do NOT add anything else but problematic vk.com URLs and then upload a new log.
The video from today has the same problem: **External links are only visible to Support Staff****External links are only visible to Support Staff**
In JD it looks like “offline” but you can watch it in the browser.
In the log-file are only 4-5 minutes, only this link (exactly like the log of yesterday) 01.07.20 21.46.20 <--> 01.07.20 21.50.28 jdlog://1649025302851/
I hope that you can see the link soon...
Reply With Quote
  #2853  
Old 02.07.2020, 13:38
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 53,736
Default

Quote:
Originally Posted by jdjon10 View Post
Hi pspzockerscene,
The video from yesterday works now for me as well: 1080p and about 4,9 GB in size.

The video from today has the same problem: **External links are only visible to Support Staff****External links are only visible to Support Staff**
In JD it looks like “offline” but you can watch it in the browser.
This "offline" status will often happen on plugin failures for vk.com URLs because for this website, it is really hard to tell if content is offline or if there is a plugin issue ...

Quote:
Originally Posted by jdjon10 View Post
In the log-file are only 4-5 minutes, only this link (exactly like the log of yesterday) 01.07.20 21.46.20 <--> 01.07.20 21.50.28 jdlog://1649025302851/
I hope that you can see the link soon...
As said, I've implemented a workaround which may- or may not solves your issue.

Please wait for the next CORE-Update to get released to try it out:

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
How to create a log || Wie man einen Log erstellt
Captcha FAQ EN || Captcha FAQ DE || Erste Schritte & Tutorials
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist

Last edited by raztoki; 03.07.2020 at 12:34.
Reply With Quote
  #2854  
Old 03.07.2020, 00:07
jdjon10 jdjon10 is offline
Linkgrabbing Monster
 
Join Date: Aug 2010
Posts: 80
Default

Thank you for the answer, pspzockerscene.
This video from today evening, which doesn’t work in JD, is definitely online, because at the same time you can download it with youtube-dl.
**External links are only visible to Support Staff****External links are only visible to Support Staff**
02.07.20 22.34.40 <--> 02.07.20 23.06.26 jdlog://5869025302851/

C:\Users\b>youtube-dl --list-formats **External links are only visible to Support Staff****External links are only visible to Support Staff**
[vk] -130074765_456239801: Downloading JSON metadata
[vk] -130074765_456239801: Downloading m3u8 information
[info] Available formats for -130074765_456239801:
format code extension resolution note
hls-1474 mp4 640x360 1474k
hls-1966 mp4 853x480 1966k
hls-2949 mp4 1280x720 2949k
hls-4423 mp4 1920x1080 4423k (best)

I hope that this workaround solves this issue.
Reply With Quote
  #2855  
Old 03.07.2020, 15:20
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 53,736
Default

Hi again,

I don't need any new logs/example URLs regarding this issue.

Please wait for the next CORE-update and check it it resolves your issues.
In the meantime you can download such videos with the help of browser addons like "Video DownloadHelper" & JDownloader or, as you've already discovered, youtube-dl.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
How to create a log || Wie man einen Log erstellt
Captcha FAQ EN || Captcha FAQ DE || Erste Schritte & Tutorials
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #2856  
Old 04.07.2020, 00:11
sharkboy sharkboy is offline
Banned
 
Join Date: Apr 2020
Posts: 82
Default

pspzockerscene
I can't download content from the wall.
If I start the analysis from the beginning.
I will open the log and want to find the content, but there is none. Not found.
I know that once I could see every "offset" number in the log - now I don't know this detailed information in the log.

I entered in the test editor and extracted all "jd2" offset - I didn't analyze some offset
offset=(\d+)
[spoiler]
Correct per one offset=20+
Bug:

offset=11143
offset=11143


This is a decryption error, it analyzes the wrong offset (see in the log Log.maxlogfilesize, 200 + MB log size setting is required) to record all data There is no such thing as:

Code:
All posts11,143
Enter a word or phrase here ...
The wall is empty.
04.07.2020 (Date)
Correct max:
?offset=11140

I analyze/crawling the wall for about 10 minutes.
Reply With Quote
  #2857  
Old 04.07.2020, 00:32
sharkboy sharkboy is offline
Banned
 
Join Date: Apr 2020
Posts: 82
Default

New informations.
I found an error.
The log cuts off at offset =
offset = 2480
So after ~2500 to 11140, offset is no longer properly analyzed (missing content)

The offset list is here:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

example wall
**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #2858  
Old 06.07.2020, 13:19
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 53,736
Default

Working fine here.
You can also let JD only crawl a range e.g.:
vk.com/wall-123456789?currentoffset=2500&maxoffset=3000

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
How to create a log || Wie man einen Log erstellt
Captcha FAQ EN || Captcha FAQ DE || Erste Schritte & Tutorials
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #2859  
Old 06.07.2020, 13:59
sharkboy sharkboy is offline
Banned
 
Join Date: Apr 2020
Posts: 82
Default

In my log, the scope indicated by me is clearly missing.
If possible, send me the full (high compressed) log.
You can only delete "sensitive user data" if there are any, thank you in advance.
I will need it so that I can compare my log with yours, which is actually missing. And indicate if you are really ok.
Tell me what size your log contains and tell me what are your current advanced plugin settings. Settings screenshot, please.
Reply With Quote
  #2860  
Old 23.07.2020, 14:11
sharkboy sharkboy is offline
Banned
 
Join Date: Apr 2020
Posts: 82
Default

Example:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

This is not a valid links an invalid range.

[jd.plugins.decrypter.VKontakteRu(decryptWall_Website)] -> Decrypting offset 260
act=get_wall&al=1&fixed=&offset=260&owner_id=-120780206&type=own&wall_start_from=260



Min Value 0
Max. Value 11280

\?offset=0*([0-9]|[1-8][0-9]|9[0-9]|[1-8][0-9]{2}|9[0-8][0-9]|99[0-9]|[1-8][0-9]{3}|9[0-8][0-9]{2}|99[0-8][0-9]|999[0-9]|10[0-9]{3}|11[01][0-9]{2}|112[0-7][0-9]|11280)

The log cannot be uploaded, is too large, and an error occurs.

[null][null]

title: Exception ocurred
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 14:05.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.