# small robots.txt # more information about this file can be found at # http://www.robotstxt.org/wc/robots.html # a list of know bots can be found at # http://www.robotstxt.org/wc/active/html/index.html # see http://www.sxw.org.uk/computing/robots/check.html # for syntax checking User-agent: * Crawl-Delay: 10 Disallow: /interfaz # MSN User-agent: msnbot Crawl-Delay: 10 # Yahoo Vertical Crawler User-agent: yahoo-verticalcrawler Crawl-Delay: 10 # Yahoo Slurp User-agent: Slurp Crawl-delay: 10