User-agent: * Disallow: /images/ Disallow: /*.gif$ Disallow: /*.jpg$ Disallow: /*.zip$ Disallow: /*.doc$ Disallow: /*.exe$ Disallow: /*.pdf$ Disallow: /cgi-bin/