# Robots.txt file for http://www.r-theta.com User-agent: MS Search 4.0 Robot Disallow: / User-agent: Mozilla/4.0 (compatible; MSIE 4.01; Windows NT; MS Search 4.0 Robot) Microsoft Disallow: / User-agent: * Disallow: /_cms/ Disallow: /_db/ Disallow: /_private/ Disallow: /flash/ Disallow: /fp_include/ Disallow: /include/ Disallow: /original_nav/ Disallow: /Scripts/ Disallow: /_updates/ User-agent: msnbot Disallow: /_cms/ Disallow: /_db/ Disallow: /_private/ Disallow: /flash/ Disallow: /fp_include/ Disallow: /include/ Disallow: /original_nav/ Disallow: /Scripts/ Disallow: /_updates/ Crawl-delay: 5 User-agent: Slurp Disallow: /_*.asp # Wildcards supported - http://help.yahoo.com/help/us/ysearch/slurp/slurp-02.html Disallow: /_cms/ Disallow: /_db/ Disallow: /_private/ Disallow: /flash/ Disallow: /fp_include/ Disallow: /include/ Disallow: /original_nav/ Disallow: /Scripts/ Disallow: /_updates/ Crawl-delay: 5 User-agent: Googlebot Disallow: /_*.asp Disallow: /_cms/ Disallow: /_db/ Disallow: /_private/ Disallow: /flash/ Disallow: /fp_include/ Disallow: /include/ Disallow: /original_nav/ Disallow: /Scripts/ Disallow: /_updates/