Add Robot

Top  Previous  Next

Advanced Robots.txt Generator 3.2 Professional allows you to add robots that you have found yourself in the list of robots so that you can get complete coverage in your robots.txt files.

 

You can do this by selecting Actions > Add Robot

 

clip0034

 

This launches a window that allows you to enter the Bot name and the Agent name.

 

clip0035

 

The bots that you are adding are added at the bottom of the list of robots that is available.

 

You can also choose to inform us of this new Robot so we can include it in our list of robots that is available to download from http://www.basisoft.com/botslist.html.

 

When you download the most current list from this location any bots that you may have added manually will not be available to you any more so you will need to re-add them. For this reason it is to your advantage to inform us of your addition so that both your and our list can be kept up to date.