#by default all search engines can crawl all the content on this site User-Agent: * Allow: / #restrict MSN from the dedicated paid search directory, allow Microsoft to access everything else User-Agent: msnbot Disallow: /oms/ Disallow: /oms_track/ Allow: / #restrict Yahoo from the dedicated paid search directory, allow Yahoo to access everything else User-Agent: Slurp Disallow: /oms/ Disallow: /oms_track/ Allow: / #restrict Google from the dedicated paid search directory, allow Google to access everything else User-Agent: Googlebot Disallow: /oms/ Disallow: /oms_track/ Allow: /