User-agent:* Disallow: /admin/ Disallow: /cgi-bin/ Disallow: /private/ Disallow: /public/