|
In case you have some files or directories in your site which are not part of your local file structure and you wish to include them in the robots.txt file at the moment there are two handle this situation
| 1. | Edit the created robots.txt file manually. This is not the optimal method as the additions you make will not be reflected in the Advanced Robots.txt generator project. |
| 2. | Create temporarily empty documents/directories in your local file structure of the files that exist only in your web server and use these in order to create your robot controls in Advanced Robots.txt Generator. This mechanism may be a bit more time consuming but it will allow you to manage robots.txt file easily in the future. You have to be careful not to overwrite the non-local files with your empty local documents when you upload and/or synchronize. |
Note. The next version of Advanced Robots.txt Generator will overcome this issue with another way as users will be able to browse non-local files and add them to the robot controls.
Advanced Robots.txt Generator Website.
|