JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #2821  
Old 06.05.2020, 15:31
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 68,419
Default

@sharkboy
1. Regarding log and log size:
No idea what you mean.

2. Regarding plugin settings:
Your settings were wrong.
By default, JD grabs everything so you must have changed them to only grab documents.

3. The log will even warn you about bad settings:
Code:
 [ jd.plugins.decrypter.VKontakteRu(decryptSingleWallPostAndComments_Website) ] -> Found 0 items
 [ jd.plugins.decrypter.VKontakteRu(decryptWall_Website) ] -> Failed to find any items for offset: 40
 [ jd.plugins.decrypter.VKontakteRu(decryptWall_Website) ] -> Found 0 items so far
 [ jd.plugins.decrypter.VKontakteRu(decryptWall_Website) ] -> Stopping because: Failed to find more items for 5 times in the row
 [ jd.plugins.decrypter.VKontakteRu(decryptWall_Website) ] -> Done!
 [ jd.plugins.decrypter.VKontakteRu(decryptIt) ] -> Decrypted 0 total links out of a wall-link
 [ jd.plugins.decrypter.VKontakteRu(decryptIt) ] -> Check your plugin settings -> They affect the results!
4. Regarding your post #2820:
As already said before it is working fine here.
If I leave it running for some time, it will find 1364 photo items.
EDIT2
All items were downloadable without any issues --> 1364 items --> 149,54 MiB

-psp-
EDIT

5. No we do not provide a page source (.html) crawler.
If you want to do this, please use other tools!
__________________

On vacation / im Urlaub
START: 2023-09-26
END: TBA


JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist


Last edited by pspzockerscene; 06.05.2020 at 15:34.
Reply With Quote
  #2822  
Old 06.05.2020, 15:59
sharkboy sharkboy is offline
Banned
 
Join Date: Apr 2020
Posts: 171
Default

I think you misunderstood me. I don't mean HTML code, which is completely unnecessary for me.
The "Decrpter log" contains all the information I need, which I want to extract "String Only". And that's what this is about!
It also works well here, only for different sites should be set differently setting and everything will collect whatever the user wants.

Also, after changing the settings it works - and no third-party tool is required!
Reply With Quote
  #2823  
Old 06.05.2020, 16:08
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 68,419
Default

Quote:
Originally Posted by sharkboy View Post
I think you misunderstood me. I don't mean HTML code, which is completely unnecessary for me.
The "Decrpter log" contains all the information I need, which I want to extract "String Only". And that's what this is about!
Ok.

Quote:
Originally Posted by sharkboy View Post
It also works well here, only for different sites should be set differently setting and everything will collect whatever the user wants.
No idea what you mean.
Do you mean different plugin settings for different types of links or so?
Sorry, if you ask me, the current settings are fine for normal users.
Our tool is not designed e.g. to crawl complete websites.
If you are looking for something like this, you are wrong here.

Quote:
Originally Posted by sharkboy View Post
Also, after changing the settings it works - and no third-party tool is required!
Ok.

-psp-
__________________

On vacation / im Urlaub
START: 2023-09-26
END: TBA


JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist

Reply With Quote
  #2824  
Old 06.05.2020, 16:28
sharkboy sharkboy is offline
Banned
 
Join Date: Apr 2020
Posts: 171
Default

Quote:
No idea what you mean.
Do you mean different plugin settings for different types of links or so?
Crawling all the offset on the wall - it's probably not a complicated thing in JD2.
Parsing takes a few minutes to several minutes in this case, because I always minimize the settings (and this means less required things to analyze).
Reply With Quote
  #2825  
Old 06.05.2020, 17:42
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 68,419
Default

What do you mean with "minimize"?

What does this have to do with the offset?
Do you mean that the crawler gets slow when it parses a lot of elements?
This should not happen as it will dump old data after 5000 URLs and start again with that offset.

Are you a 2nd account of the user "djmakinera"?
Just in case:
You know that it is prohibited to re-register after being banned in a forum?

-psp-
__________________

On vacation / im Urlaub
START: 2023-09-26
END: TBA


JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist

Reply With Quote
  #2826  
Old 06.05.2020, 21:08
sharkboy sharkboy is offline
Banned
 
Join Date: Apr 2020
Posts: 171
Default

I don't know what you are talking about, what account. I don't understand why you accuse me of such things.

I will just select just anything (just be on the wall) and it will only analyze these files instead of all the files on the wall, and by the way I will have html in the log
HTML Anchor tag
<a\s+(?:(?:\w+\s*=\s*)(?:\w+|"[^"]*"|'[^']*'))*?\s*href\s*=\s*(?<url>\w+|"[^"]*"|'[^']*')(?:(?:\s+\w+\s*=\s*)(?:\w+|"[^"]*"|'[^']*'))*?>.+?</a>
Reply With Quote
  #2827  
Old 07.05.2020, 09:29
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 68,419
Default

Ok - this was just a friendly reminder that we have forum rules here that apply for everyone.
Of course you can do whatever you want with your own logs.

-psp-
__________________

On vacation / im Urlaub
START: 2023-09-26
END: TBA


JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist

Reply With Quote
  #2828  
Old 09.05.2020, 17:25
jdjon10 jdjon10 is offline
Giga Loader
 
Join Date: Aug 2010
Posts: 91
Default

Hi! I have problems with vk.com videos.
Yesterday JD didn’t find any video under:
Psychosis **External links are only visible to Support Staff****External links are only visible to Support Staff** [video is available till 9 May 2020 at 6.30pm CET]
Here is the log for the time I tried and didn’t succeed: 08.05.20 20.32.28 <--> 08.05.20 20.42.59 jdlog://7135915302851/

JD doesn’t find any video here:
Tchaikovsky **External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff** (the same link and video)
Both don’t work, I don’t why. Here is the log for the time I tried and didn’t succeed: 09.05.20 17.10.13 <--> 09.05.20 17.19.09 jdlog://1235915302851/
Reply With Quote
  #2829  
Old 11.05.2020, 15:36
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 68,419
Default

@jdjon10
For link 1 & 3 , I get this errormessage via browser (even when I'm logged-in):

For link 2, I get this errormessage via browser:


No idea how you expect JD to grab content that is offline ...

-psp-
__________________

On vacation / im Urlaub
START: 2023-09-26
END: TBA


JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist

Reply With Quote
  #2830  
Old 11.05.2020, 23:00
jdjon10 jdjon10 is offline
Giga Loader
 
Join Date: Aug 2010
Posts: 91
Default

Thank you for the answer, pspzockerscene. You are right, all the videos are deleted now.
But at the time of my message one could watch both videos without any account (I don't have one) in any browser without any problem, but JD didn't grab them. I thought, you can follow these circumstances via these Logs.
I would't expect JD to grab the content, which is offline
Reply With Quote
  #2831  
Old 12.05.2020, 14:52
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 68,419
Default

I was unable to find anything useful in your log.

Please post another log if that happens again - best would be content that is still online once I'm there to check your logs

-psp-
__________________

On vacation / im Urlaub
START: 2023-09-26
END: TBA


JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist

Reply With Quote
  #2832  
Old 14.05.2020, 16:43
jdjon10 jdjon10 is offline
Giga Loader
 
Join Date: Aug 2010
Posts: 91
Default

Quote:
Originally Posted by pspzockerscene View Post
best would be content that is still online once I'm there to check your logs -psp-
:biggrin: That would be surely the best. But its really going to be difficult in these strange corona times, if many videoproductions are only online for a few hours.
Reply With Quote
  #2833  
Old 15.05.2020, 12:35
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 68,419
Default

If you want you can just keep me updated via PN this way I might read it soon enough but as said, I was unable to reproduce any issues with this plugin, at least with video downloading.

-psp-
__________________

On vacation / im Urlaub
START: 2023-09-26
END: TBA


JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist

Reply With Quote
  #2834  
Old 25.05.2020, 13:10
sharkboy sharkboy is offline
Banned
 
Join Date: Apr 2020
Posts: 171
Default

Problem detecting these types of video links.
Source:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

The plugin should redirect to the video address:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #2835  
Old 05.06.2020, 12:58
mynamejeff mynamejeff is offline
JD Alpha
 
Join Date: Jul 2018
Posts: 21
Default weird symbols in filenames from vk

it adds html and js code from the page into the file/folder name and trying to remove these tags hangs up jdownloader and I have to force close it.

example links:

**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**


05.06.20 15.49.22 <--> 05.06.20 15.49.23 jdlog://0692025302851/
Reply With Quote
  #2836  
Old 05.06.2020, 13:34
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 68,419
Default

Hi,

fixed.

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________

On vacation / im Urlaub
START: 2023-09-26
END: TBA


JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist

Reply With Quote
  #2837  
Old 05.06.2020, 13:46
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 68,419
Default

@sharkboy
Fixed!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________

On vacation / im Urlaub
START: 2023-09-26
END: TBA


JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist

Reply With Quote
  #2838  
Old 07.06.2020, 12:22
mynamejeff mynamejeff is offline
JD Alpha
 
Join Date: Jul 2018
Posts: 21
Default

@pspzockerscene

when I try to remove the old links (the one that had the symbols and html tags in it) from jdownloader. the ui hangs and I have to restart it and the link is not removed.

07.06.20 15.19.48 <--> 07.06.20 15.21.25 jdlog://9353025302851/
Reply With Quote
  #2839  
Old 08.06.2020, 15:53
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 68,419
Default

Hm this did not happen here but I can imagine this happening due to this huge string that was set as filename.

At this moment the only thing I can recommend you would be to delete your current downloadlist and backup all URLs you want to keep in beforehand.
Similar to here but instead of using these backups/downloadlistXXX files, just delete all of them:
https://support.jdownloader.org/Know...nkgrabber-list

-psp-
__________________

On vacation / im Urlaub
START: 2023-09-26
END: TBA


JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist

Reply With Quote
  #2840  
Old 14.06.2020, 15:34
sharkboy sharkboy is offline
Banned
 
Join Date: Apr 2020
Posts: 171
Default

It does not detect the single wall post with the (GIF extension).
Detects only 2 pictures (JPG) in the comment.

**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 02:37.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2023, Jelsoft Enterprises Ltd.