Robots.txt Syntax

The Syntax of a Robots.txt file is the following:

User-agent: <NAME OF AGENT>

Disallow: <NAME OF FILE / DIRECTORY>

Most crawlers do not support wild cards so you will need to  denote each directory and file explicitly in order for them not to be accessed by the appropriate crawlers.

Advanced Robots.txt Generator Website.