User-Agent: * Disallow: /documents Disallow: /uploads Disallow: /cgi-bin Disallow: /scripts Allow: /