WebReaper
Name: WebReaper
Purpose: Indexing, Maintenance
Comments: Generic Search Engine Crawler, Offline Browsing Crawler
Email:webreaper@otway.com
Updated:Jan. 2006-2007
Advanced Robots.txt Generator Website.