User-agent: * sitemap: http://example.com/sitemap.axd Disallow: /_admin/ Disallow: /_private/ Disallow: /shop_product.asp Disallow: /test.htm Disallow: /test.asp