#Include areas of the site you don't want spidered by search engines in in this file. # an '*' for User-agent means this applies to all user agents. User-agent: * # to disallow more sections of the site just add more Disallow: #E.G.: #Disallow: /test/ #Disallow: /faq/faqs.php #Disallow: contact.php Disallow: /test/ # a '#' signifies a comment. If you place a '#' in front of a line of code it will have no effect.