Advanced Robots.txt Generator Features

Advanced Robots.txt Generator is the most complete and easy to use application that allows you to create, maintain and keep track of your Robots.txt files for all your websites. The following is a list of the features of Advanced Robots.txt Generator.

A) Professional Edition

• Support for 2000 Robots and Crawlers
• Ability to add own robots
• Download the most current robots list (updated every week) from our website
• Ability to use FTP listing in order to manage non-local sites
• Support for dynamic websites (PHP, ASP, JSP etc.)
• Support for non-standard robots.txt syntax followed by some crawlers (crawl-delay and sitemap options).
• Automatic synchronization of remote and local directories
• Automatic creation of Robots.txt file
• Automatic scanning of local site directories
• Comparison and correction with previously saved Robots.txt projects
• Unlimited number of projects and websites
• Automatic uploading to the web server
• WYSIWYG selection of Robots and file/directory exclusions
• Unlimited combinations for the Robot controls
• Online and offline documentation
• manual in PDF format
• Unlimited and free customer support
• Free Upgrades for life.

B) Standard Version

• Support for ~300 Robots and Crawlers
• Automatic creation of Robots.txt file
• Automatic scanning of local site directories
• Comparison and correction with previously saved Robots.txt projects
• Unlimited number of projects and websites
• Automatic uploading to the web server
• WYSIWYG selection of Robots and file/directory exclusions
• Unlimited combinations for the Robot controls
• Online and offline documentation
• manual in PDF format
• Unlimited and free customer support
• Free Upgrades for life.

Check a comparison grid of the two versions in order to choose the right one for you.

Advanced Robots.txt Generator Standard offers complete control of more than 400 robots and crawlers within minutes.

Advanced Robots.txt Generator Professional is an advanced tool supporting close to 2000 robots and crawlers and allows for use in dynamic (PHP, ASP etc.) websites.

The Professional edition is available for $49, offers weekly updates of the most current robots and crawlers and naturally comes with free documentation and customer support. We also honor a 30 day no-questions asked refund policy.

See complete features list

Creating robots.txt files with Advanced Robots.txt Generator couldn't be simpler. It is just a matter of three steps:

1. Select robots/crawlers from the list of 300 robots.
2. Select the files / directories of your website.
3. Compile robots.txt - and upload automatically to your webserver.

NEW! video tutorials for generating robots.txt files!

Download Advanced Robots.txt Generator and try it now!

Creating robots.txt files with Advanced Robots.txt Generator couldn't be simpler. It is just a matter of three steps:

1. Select robots/crawlers from the list of 300 robots.
2. Select the files / directories of your website.
3. Compile robots.txt - and upload automatically to your webserver.

NEW! video tutorials for generating robots.txt files!

Download Advanced Robots.txt Generator and try it now!