# Exclude Files From All Robots: User-agent: * Disallow: /catalog Disallow: /cgi-bin Disallow: /chat Disallow: /cralwtrack Disallow: /emails Disallow: /images Disallow: /phponline Disallow: /script Disallow: /shop Disallow: /sudoku Disallow: /vars Disallow: /w3c # Optional sitemap URL: Sitemap: sitemap.xml # End robots.txt file