[xjuminten]

Hi,

Can we get a support for topvid.tv?

**External links are only visible to Support Staff****External links are only visible to Support Staff**

Thank you

[Jiaz]

[pspzockerscene]

I do not really see the need to add a plugin for this website.
Please use this method:
https://support.jdownloader.org/know...aming-websites

So far, only one user (you) have asked for a plugin for that website -> I do not see the demand.

[xjuminten]

Originally Posted by pspzockerscene

I do not really see the need to add a plugin for this website.
Please use this method:
**External links are only visible to Support Staff**...

So far, only one user (you) have asked for a plugin for that website -> I do not see the demand.

Thank you for your response. I’m actually already using the method you mentioned. I just thought it would be more convenient to simply copy the URL and let JDownloader crawl it and retrieve the filename from the title, like other plugins do.

That said, I don’t mind continuing to use the current method.

[pspzockerscene]

If more users let us know about their demand in this thread, I'm willing to add a plugin for this website but at this moment I do not see the demand at all.

This thread will remain open for future posts of other users.

[xjuminten]

I'm able to create a LinkCrawler Rule to get the video and set up the filename using Packagizer. However, it's not handling duplicate links—duplicate links are not being rejected.

Could you please help me figure out what I did wrong?

Here's my LinkCrawler Rule

[
  {
    "cookies": null,
    "deepPattern": null,
    "formPattern": null,
    "headers": null,
    "id": 1743148046497,
    "maxDecryptDepth": 1,
    "name": "Rule for Topvid",
    "packageNamePattern": "<h1 class=\"movie-detail-name\">\\s*(.*?)\\s*</h1>",
    "passwordPattern": null,
    "pattern": "**External links are only visible to Support Staff**,
    "propertyPatterns": null,
    "rewriteReplaceWith": null,
    "rule": "DEEPDECRYPT",
    "enabled": true,
    "logging": false,
    "updateCookies": true
  }
]

[pspzockerscene]

LinkCrawler Rules have no influence on any kind of duplicate detection.
Explain your problem in more details and also compare the links that are "not being detected as duplicates": Are they the same or do they change every time you re-add the link?

Some websites put time based tokens into their links so the links will be different each time they are re-obtained.

[xjuminten]

I checked with Video DownloadHelper, and yes, I can confirm that the URL changes with every load.

So, does duplicate detection work based on the actual download URL? I initially thought it was based on the "Download from" field.

Is there any way to configure it to detect duplicates based on the "Download from" field instead?

[pspzockerscene]

Originally Posted by xjuminten

So, does duplicate detection work based on the actual download URL?

Yes and no.
It depends on multiple factors, some weaker some stringer.
If for example a plugin sets a pre-known files' MD5 hash, that will be used for duplicate checking since that is very strong.

In your case the URLs are handled by the generic plugin and all that has is a link and a file name (not even a precise file size).

Originally Posted by xjuminten

Is there any way to configure it to detect duplicates based on the "Download from" field instead?

No "official" way but this one may work:
Use an EventScripter script that sets the source URL as property "LINKDUPEID" on the DownloadLink item.
You _could_ also set an md5 hash on the item and at the same time disable CRC hash checking, that should allow the duplicate/mirror checks to work with it.

EventScripter subforum:
https://board.jdownloader.org/forumdisplay.php?f=52
EventScripter help article:
https://support.jdownloader.org/know...event-scripter

[xjuminten]

Originally Posted by pspzockerscene

Use an EventScripter script that sets the source URL as property "LINKDUPEID" on the DownloadLink item.

This works great. Thank you

[pspzockerscene]

Thanks for your feedback!

You may want to post your script here so other users can make use of it too

[xjuminten]

Sure. This is what I come up with

// Handle duplicate for topvid URLs
// Trigger Required: A new link has been added

var myPackagizerLink = link;
var url = myPackagizerLink.getProperty("URL_CONTAINER");

if (url !== null && url.includes("topvid.tv")) {
    myPackagizerLink.setProperty("LINKDUPEID", url);
}

[pspzockerscene]

Simple but effective I guess.