## # Attention: Use Robots.txt syntax checker to verify the syntax of this file! # http://www.sxw.org.uk/computing/robots/check.html ## User-agent: Googlebot Crawl-delay: 1800 Disallow: User-agent: msnbot Crawl-delay: 1800 Disallow: User-agent: Slurp Crawl-delay: 1800 Disallow: User-agent: news-search-crawler Crawl-delay: 1800 Disallow: User-agent: * Disallow: / Crawl-delay: 1800 Disallow: /fileadmin/webtemplate? Disallow: /fileadmin/jvp_webtemplate? Disallow: /fileadmin/php_scripts? Disallow: /typo3temp?