Acorn/Nutch

Name: Acorn

Purpose: Indexing and maintenance

Comments:

Email: bots at basisoft.com for more info about the robot.

Updated: Feb. 2008

Back to Robots.list

Advanced Robots.txt Generator Standard offers complete control of more than 400 robots and crawlers within minutes.

Advanced Robots.txt Generator Professional is an advanced tool supporting close to 2000 robots and crawlers and allows for use in dynamic (PHP, ASP etc.) websites.

The Professional edition is available for $35, offers weekly updates of the most current robots and crawlers and naturally comes with free documentation and customer support. We also honor a 30 day no-questions asked refund policy.

See complete features list

Creating robots.txt files with Advanced Robots.txt Generator couldn't be simpler. It is just a matter of three steps:

1. Select robots/crawlers from the list of 300 robots.
2. Select the files / directories of your website.
3. Compile robots.txt - and upload automatically to your webserver.

Download Advanced Robots.txt Generator and try it now!