Whenever a new project is created or whenever a user selects to View/Modify the properties of the current project the Properties screen is launched.
The entries that can be entered/modified in this screen are the following:
Project name: Your own choice for the name of the project. (mandatory field)
Project URL: The URL for the website for which you are creating the robots.txt file. (mandatory field)
Local Project Directory: The path to the local directory that the website files are stored. (mandatory field)
FTP Host: The FTP address for uploading to the web server.
FTP Username: The FTP Username for uploading to the web server.
FTP Password: The FTP Password for uploading to the web server
Host Directory: Path to the root folder of the website to be used when uploading.
Site not on local PC: For the case in which the website is not stored locally you can check this box and enter the directories and files manually.
Use remote FTP Listing. For websites that do not have a local copy you can check this option, the remote structure is automatically mirrored locally and synchronized whenever necessary.
Directory Prefix: Some websites need a directory prefix in the robots.txt file due some peculiarities. (Advanced option).
Sitemap: Denote the location of the sitemap of your website in XML or HTML format (supported by some robots).
Crawl Delay: Delay that the robots have to wait before returning to your website (supported by some robots).
Advanced Robots.txt Generator Website.