JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 04.04.2023, 16:22
Red-Cipher Red-Cipher is offline
JD Beta
 
Join Date: Nov 2020
Posts: 57
Default [LinkCrawler rules] Plugin for vsex.in

Hello. I'd like to request a plugin for vsex.in

It seems there might be more than one hoster in the site.
if possible please add them all. If not possible, then I'd like to pick the hoster in the first link:

**External links are only visible to Support Staff****External links are only visible to Support Staff**

**External links are only visible to Support Staff****External links are only visible to Support Staff**

**External links are only visible to Support Staff****External links are only visible to Support Staff**

**External links are only visible to Support Staff****External links are only visible to Support Staff**


Plz add quality settings as well.
Thanks!
Reply With Quote
  #2  
Old 04.04.2023, 16:27
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 74,739
Default

Hi,
a plugin for this website is not needed because all required links are already supported and are inside the html code.
(For example katfile.dlc.ovh and katfile.com.)

You can use our deep-parser or a LinkCrawler rule to add those links to JDownloader.

Regarding quality settings:
Are you talking about their video streams?
If so: They're hosted on "netu.tv".
More information about "netu.tv":
https://board.jdownloader.org/showthread.php?t=80090
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 04.04.2023 at 16:27. Reason: Added missing hyperlink to linkcrawler rule support article
Reply With Quote
  #3  
Old 04.04.2023, 16:36
Red-Cipher Red-Cipher is offline
JD Beta
 
Join Date: Nov 2020
Posts: 57
Default

Hello psp.

Unfortunately deep link analyse does not work with any of the links.
I've also crawled katfile.dlc.ovh directly, but got nothing.

**External links are only visible to Support Staff****External links are only visible to Support Staff**



I'd like to grab the video streams instead of the .rar files from katfile. If possible.
Reply With Quote
  #4  
Old 04.04.2023, 16:39
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 74,739
Default

Our katfile.cld.ovh plugin (and katfile.com) is working fine here.
Sounds like you might got blocked by Cloudflare.

If you want me to check this, please enable debug mode and provide a log.

Please post your log-ID here | bitte poste deine Log-ID hier.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #5  
Old 04.04.2023, 16:40
Red-Cipher Red-Cipher is offline
JD Beta
 
Join Date: Nov 2020
Posts: 57
Default

After inspecting page source code. The video links are on **External links are only visible to Support Staff****External links are only visible to Support Staff**

is this the same hoster as netu?
Reply With Quote
  #6  
Old 04.04.2023, 16:45
Red-Cipher Red-Cipher is offline
JD Beta
 
Join Date: Nov 2020
Posts: 57
Default

@psp here is the log

04.04.23 17.43.15 <--> 04.04.23 17.45.00 jdlog://6354311370661/
Reply With Quote
  #7  
Old 04.04.2023, 16:53
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 74,739
Default

Quote:
Originally Posted by Red-Cipher View Post
After inspecting page source code. The video links are on nvdd.dlc.ovh
Not here or let's put it this way:
I can also see that links but for me they're redirecting to "69x.online" which seems to be an advertisement website.
I can't find anything downloadable here and no, we do not have a plugin for "nvdd.dlc.ovh" in fact I've never seen any "nvdd.dlc.ovh" links.
If you think there are working "nvdd.dlc.ovh" links, please provide some.

Quote:
Originally Posted by Red-Cipher View Post
@psp here is the log
That one looks alright: The katfile.dlc.ovh are processed without any problems (leads to normal "katfile.com" links).
I can't find any traces of a deep-decrypt attempt of "vsex.in" though.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 04.04.2023 at 16:59. Reason: Improved wording
Reply With Quote
  #8  
Old 04.04.2023, 17:03
Red-Cipher Red-Cipher is offline
JD Beta
 
Join Date: Nov 2020
Posts: 57
Default

second log. this time definitely did a deep analyse

04.04.23 17.43.15 <--> 04.04.23 18.02.33 jdlog://7354311370661/
Reply With Quote
  #9  
Old 04.04.2023, 19:38
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 74,739
Default

I just noticed that we don't have any logging in place for the deep-crawler - sorry for that.

Instead, please add the following LinkCrawler rule of type DEEPDECRYPT (the rule has logging enabled) and provide a fresh log:
Rule:
Code:
[
  {
    "enabled": true,
    "logging": true,
    "maxDecryptDepth": 1,
    "name": "example rule for vsex.in",
    "pattern": "https?://vsex\\.in/[0-9]+-[a-z0-9\\-]+\\.html",
    "rule": "DEEPDECRYPT",
    "packageNamePattern": "<h1>([^<]+)</h1>",
    "deepPattern": "target=\"_blank\" href=\"(https?://[^\"]+)"
  }
]
Rule as plaintext for easier copy & paste:
pastebin.com/raw/XExmgs1P

As a small bonus, this rule will be helpful for you, if/once you're not blocked by Cloudflare or similar anymore.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #10  
Old 04.04.2023, 19:48
Red-Cipher Red-Cipher is offline
JD Beta
 
Join Date: Nov 2020
Posts: 57
Default

Apologies. It seem the 'archive' file type was turned off in my custom views. That's why I missed it.

The crawler is working fine. sorry for wasting your time.

thanks for the support ��
Reply With Quote
  #11  
Old 05.04.2023, 11:10
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 74,739
Default

Thanks for your feedback-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 05.04.2023 at 11:11. Reason: Fixed typo
Reply With Quote
  #12  
Old 21.03.2024, 11:12
Red-Cipher Red-Cipher is offline
JD Beta
 
Join Date: Nov 2020
Posts: 57
Default

Hello again.

This site added a new host, aside from katfile. The new host is freedl.ink (which is free).

But using the previous linkcrawler rule does not grab the required link, despite the site being supported by JD.

for example:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

by inspecting the source html, the freedl link is:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

If I copy & paste it directly to JD it will be grabbed. Which is not the case if I crawl vsex.in.

Help.
Reply With Quote
  #13  
Old 21.03.2024, 11:23
Red-Cipher Red-Cipher is offline
JD Beta
 
Join Date: Nov 2020
Posts: 57
Default

A second request:
Is it possible to make the linkcrawler rule's packageNamePattern use more than one regex group:

from the previous example:
{
...
"packageNamePattern": "<h1>([^<]+)</h1>",
...
}

what I want:

"packageNamePattern": "<h1>(first pattern)</h1>[...] (second pattern)",

result:
first pattern second pattern


I test it correctly on regex101, but it seems JD uses only the first captured group.
Reply With Quote
  #14  
Old 21.03.2024, 11:49
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 74,739
Default

About your post #12
Updated dlc.ovh crawler to not only listen to katfile.dlc.ovh but to "...\\w+\\.dlc\\.ovh/enlace/redireccion/[^/]+".

That will fix the problem for you without the need to update the rule.

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #15  
Old 21.03.2024, 11:50
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 74,739
Default

Quote:
Originally Posted by Red-Cipher View Post
A second request:
Is it possible to make the linkcrawler rule's packageNamePattern use more than one regex group:
No, not possible.

Your options:
- Use an EventScripter script
- or: set the full title (also the content you do not want like what it in between your two capture groups at this moment) and use a Packagizer Rule later to split it up as Packagizer rules allow you to modify package names based on existing package names and also allow you to work with multiple capture groups
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #16  
Old 21.03.2024, 13:15
Red-Cipher Red-Cipher is offline
JD Beta
 
Join Date: Nov 2020
Posts: 57
Default

It now works. Thanks!
Reply With Quote
  #17  
Old 21.03.2024, 16:19
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 74,739
Default

Thanks for your feedback.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #18  
Old 29.12.2024, 06:57
Red-Cipher Red-Cipher is offline
JD Beta
 
Join Date: Nov 2020
Posts: 57
Default

Hello again.

This site uses multiple hosters.

Some of the videos on this site are hosted on lulustream using **External links are only visible to Support Staff****External links are only visible to Support Staff** which JD can't grab.
example:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

mixdrop using **External links are only visible to Support Staff****External links are only visible to Support Staff**
example:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

A third one i'm not sure of using **External links are only visible to Support Staff****External links are only visible to Support Staff**
example:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Can you please make JD also grab the video streams and not just rar files?

Thanks.
Reply With Quote
  #19  
Old 30.12.2024, 20:56
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 82,299
Default

@Red-Cipher: updated existing lulustream plugin to support new domain. updated redirect plugin to also support embedded videos. wait for next plugin update
__________________
JD-Dev & Server-Admin
Reply With Quote
  #20  
Old 21.03.2025, 07:43
Red-Cipher Red-Cipher is offline
JD Beta
 
Join Date: Nov 2020
Posts: 57
Default

Hello again.

JD can no longer grab freedl links in the page.

Examples:

**External links are only visible to Support Staff****External links are only visible to Support Staff**
shortened link: **External links are only visible to Support Staff****External links are only visible to Support Staff**

**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #21  
Old 21.03.2025, 09:37
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 82,299
Default

@Red-Cipher: both working fine here, cannot reproduce any issues. Please provide a debug log, see https://support.jdownloader.org/de/k...d-session-logs
Enable debug mode, restart JDownloader and then wait for issue, create log and then post logID here
__________________
JD-Dev & Server-Admin
Reply With Quote
  #22  
Old 21.03.2025, 10:05
Red-Cipher Red-Cipher is offline
JD Beta
 
Join Date: Nov 2020
Posts: 57
Default

@Jiaz

Here are the logs:
21.03.25 12.03.30 <--> 21.03.25 12.05.35 jdlog://1199411370661/
Reply With Quote
  #23  
Old 21.03.2025, 10:12
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 82,299
Default

@Red-Cipher: Log does not contain a single error. Please make sure that you have to enabled any filetype/hoster filter in linkgrabber right side or in settings. Maybe the link is already part of linkgrabber and you just don't see it
__________________
JD-Dev & Server-Admin
Reply With Quote
  #24  
Old 21.03.2025, 10:56
Red-Cipher Red-Cipher is offline
JD Beta
 
Join Date: Nov 2020
Posts: 57
Default

@Jiaz

Wow! It seems you are correct. Freedl files were filtered somehow (i don't remember doing that ��).

Thanks for the support. Sorry for the false flag.
Reply With Quote
  #25  
Old 21.03.2025, 10:57
Red-Cipher Red-Cipher is offline
JD Beta
 
Join Date: Nov 2020
Posts: 57
Default

Off topic, is there any guide to how I can troubleshoot JD by myself using log files?
Reply With Quote
  #26  
Old 21.03.2025, 10:59
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 82,299
Default

@Red-Cipher: Thanks for the feedback and glad you could solve it by yourself.
You can try to troubleshoot by yourself, you can find the logs as text files in your logs folder. Each session/start creates a new subfolder, and then can analyze/look at them. eg search for "Exception" for errors. You may always ask if you've got questions about this
__________________
JD-Dev & Server-Admin
Reply With Quote
  #27  
Old 21.03.2025, 11:01
Red-Cipher Red-Cipher is offline
JD Beta
 
Join Date: Nov 2020
Posts: 57
Default

ok, Thanks!
Reply With Quote
  #28  
Old 21.03.2025, 11:06
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 82,299
Default

Quote:
Originally Posted by Red-Cipher View Post
ok, Thanks!
You're welcome
__________________
JD-Dev & Server-Admin
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 04:39.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.