User-agent: * Disallow: /cgi-bin/ Disallow: /tmp/ Disallow: /dev/ Disallow: /pdf/ Disallow: /videos/ Disallow: /style/ Disallow: /errors/ Disallow: /downloads/