You are going to love this script! A simple, yet
powerful cgi script with mysql database interface that will allow you to spider the
internet and collect unique urls and domain names at the speed of light! 5 minutes
to configure, set your starting url and the spider will start probing the internet from
the starting url collecting every single link and unique domain name it finds along the
way. A great way to construct targeted marketing databases or start your own search
engine. Script allows you to select spidering depth or just leave it until your hard
drive explodes with data. This script is a masterpiece.
