# robots.txt

User-agent: http://www.almaden.ibm.com/cs/crawler 
Disallow: /

User-agent: Slurp
Crawl-delay: 60

User-agent: *
Disallow: /admin
Disallow: /editor
Disallow: /logs/
Disallow: /docs/
Disallow: /webalizer
Crawl-delay: 5