User-agent: * Disallow: /*.txt$ Disallow: /*.lzh$ User-Agent: ia_archiver Disallow: / User-Agent: http://www.almaden.ibm.com/cs/crawler Disallow: / User-Agent: fast Disallow: / User-Agent: sitecheck.internetseer.com Disallow: / User-Agent: nabot Disallow: / User-agent: * Disallow: /cgi-bin/ Disallow: /img/