UCSD Crawl
Name: UCSD Crawl
Purpose: Indexing and Statistics
Comments: University of San Diego Crawler
Email: atilghma@mib.org
Updated:Jan. 2006-2007
Advanced Robots.txt Generator Website.