# kopodo Robots.txt # http://www.kopodo.com # hola[@]kopodo.com User-agent: * Disallow: /wp-pck Disallow: /wp- Disallow: /?s= Disallow: /category/ Disallow: /tag/ Disallow: */comments/ Disallow: */trackback/ Sitemap: http://www.kopodo.com/sitemap.xml.gz User-agent: MSIECrawler Disallow: / User-agent: WebCopier Disallow: / User-agent: HTTrack Disallow: / User-agent: Microsoft.URL.Control Disallow: / User-agent: libwww Disallow: / User-agent: noxtrumbot Crawl-delay: 50 User-agent: msnbot Crawl-delay: 30 User-agent: Slurp Crawl-delay: 10