View Single Post
  #36  
Old 21.10.2016, 14:11
mgpai mgpai is offline
Script Master
 
Join Date: Sep 2013
Posts: 1,484
Default

@flowlapache,
Add this script to event scripter. Change the username and password. You should now be able to grab the links which were otherwise not detected by JD. Will only detect single URLs. Create linkfilter rule to block unwanted links.

@jiaz,
Thanks for the browser API and code
Code:
// Crawler: psy-music.ru
// Trigger required: "New Crawler Job"

var sourceURL = job.text;
var matchURL = (/^http:\/\/psy-music.ru\/news\/.+\/[\d-]+$/).test(sourceURL);

try {
    if (matchURL) {
        var mainURL = "**External links are only visible to Support Staff**;
        var username = "myUser"; // Change username
        var password = "myPasss"; // Change password

        var br = getBrowser();
        var postURL = mainURL + "index/sub/";
        var postData = "user=" + username + "&password=" + password + "&rem=1&a=2&ajax=1&rnd=691";
        var mainPage = br.getPage(mainURL);
        var mainPage = br.postPage(postURL, postData);
        var links = br.getPage(sourceURL);

        callAPI("linkgrabberv2", "addLinks", {
            "links": links
        });

        job.setText("");
    }
} catch (e) {
    alert("Error occured while adding \"" + sourceURL + "\". Please try again");
}
Reply With Quote