User-agent:* Disallow: /.*/ Disallow: /_* Disallow: /bc*/ Disallow: /cgi-bin/ Disallow: /dfgsfdb/ Disallow: /gs*/ Disallow: /images/ Disallow: /scgi-bin/ Disallow: .htaccess Disallow: *.html Disallow: *.txt Disallow: *.zip