User-agent: * Disallow: /cgi-bin/ Disallow: /.htaccess Disallow: /mod_log.txt Disallow: /head Disallow: /link