The TkWWW Robot
Name: The TkWWW Robot
Purpose: Indexing
Comments: Generic Search Crawler
Email: scott@cs.sunyit.edu
Updated:Jan. 2006-2007
Advanced Robots.txt Generator Website.