Site Related > Site / Forum Discussion

Feature request

(1/1)

MysteryFCM:
I was wondering if it would be possible to have something along the lines of the following;

1. URL to determine if site listed or not (returning a yes/no only)
2. URL to identify other site's on the same IP that are in your database

My reason for asking is that I'd like to include an option in a couple of my app's, to have your database queried, alongside the DB's already queried (hpHosts, StopForumSpam, fSpamList). For example, the URL I use in my app's for querying the hpHosts database is;

http://verify.hosts-file.net/?s={DOMAIN_OR_IP}

Example:

http://verify.hosts-file.net/?s=smileycentral.com

My reason for asking for the second, is so I could apply it in conjunction with existing features within hpHosts Online.

Drusepth:
Here's a perl script that'll do it for you: ;)

--- Code: ---#!/usr/bin/perl
# isurlmdl.pl
# by Drusepth
# Pass this script a URL and it'll query it's status according to the Malware Domain List
# at malwaredomainlist.com.  It will return a simple 'yes' or 'no' depending on whether
# or not the IP or domain shows up.
use LWP::UserAgent;

$questionable_url = shift || die "Usage: perl $0 URL\n";
# Query MDL
$source = &get($questionable_url);
# Check the source code
@lines = split(/\n/, $source);
foreach $line (@lines) {
# First, we'll find the start of the table of results:
if (index($line, "<table border='1' cellpadding='4'>") > -1) {
# Once we find it, we'll start looking for <td> tags.
# Because John coded <th> tags for the headers, any <td> tag hereafter will
# be a result.  If we find one, we'll quit with a 'yes'.
$flag{'table'} = 1; # Simple flag variable
}
if (($flag{'table'} == 1) and (index($line, "<td>") > -1)) {
# If we've passed over the table headers and find a <td> tag, we've stumbled
# upon a result from the MDL database query.  We can quit now.  We don't have
# to worry about how many results there are, since a simple boolean is being
# returned on whether or not it's in the database.
die "yes\n";
}
}
# If we've gone through all the lines of the code and not found a <td> tag, there were no
# results.  We can just quit now.
die "no\n";

sub get() {
# Usage: &get($url);
# Returns source code to the page
my $page = 'http://malwaredomainlist.com/mdl.php?search=' . $_[0] . '&colsearch=All&quantity=50';
        my $ua = LWP::UserAgent->new;
        my $req = HTTP::Request->new(GET => $page);
        my $res = $ua->request($req);
        if ($res->is_success) {
                my $source = $res->as_string;
return $source;
        } else {
                die "MDL Query Failed: " . $res->status_line . "\n";
        }
}
--- End code ---

I also modified the code to work as a CGI script, so you can send GET requests to http://drusepth.net/mdl.cgi.
For example, http://drusepth.net/mdl.cgi?ip=66.6.10.1

To John: if you would like, feel free to host the page on malwaredomainlist.com somewhere.  I attached the modified source below:

--- Code: ---#!/usr/bin/perl
# mdl.cgi
# by Drusepth
# CGI version of isurlmdl.pl
use CGI qw(:standard);
use LWP::UserAgent;
print "Content-type: text/html\n\n";
if (length(param('ip')) > 0) {
&mdl(param('ip'));
} else {
print "<h1>How to use this page:</h1>\nYou can send a get request to this page with the parameter";
print " 'ip' sent (append ?ip=127.0.0.1 to the url), and it will check if that IP is listed in ";
print "<a href='http://www.malwaredomainlist.com'>Malware Domain List</a>'s database. \n";
print "You can also use domains (?ip=www.yoursite.com) or words (?ip=zlob).<br>\n";
}

sub mdl() {
$questionable_url = $_[0];
# Query MDL
$source = &get($questionable_url);
# Check the source code
@lines = split(/\n/, $source);
foreach $line (@lines) {
# First, we'll find the start of the table of results:
if (index($line, "<table border='1' cellpadding='4'>") > -1) {
# Once we find it, we'll start looking for <td> tags.
# Because John coded <th> tags for the headers, any <td> tag hereafter will
# be a result.  If we find one, we'll quit with a 'yes'.
$flag{'table'} = 1; # Simple flag variable
}
if (($flag{'table'} == 1) and (index($line, "<td>") > -1)) {
# If we've passed over the table headers and find a <td> tag, we've stumbled
# upon a result from the MDL database query.  We can quit now.  We don't have
# to worry about how many results there are, since a simple boolean is being
# returned on whether or not it's in the database.
print "yes\n";
die;
}
}
# If we've gone through all the lines of the code and not found a <td> tag, there were no
# results.  We can just quit now.
print "no\n";
die;
}

sub get() {
# Usage: &get($url);
# Returns source code to the page
my $page = 'http://malwaredomainlist.com/mdl.php?search=' . $_[0] . '&colsearch=All&quantity=50';
        my $ua = LWP::UserAgent->new;
        my $req = HTTP::Request->new(GET => $page);
        my $res = $ua->request($req);
        if ($res->is_success) {
                my $source = $res->as_string;
return $source;
        } else {
                die "MDL Query Failed: " . $res->status_line . "\n";
        }

}
--- End code ---

I didn't know for sure what you meant by

--- Quote ---2. URL to identify other site's on the same IP that are in your database
--- End quote ---
so I'll leave that to the big boys and let them answer.  :D

MysteryFCM:
Already sorted but cheers :)

Navigation

[0] Message Index