User-agent: Slurp Crawl-delay: 40 

User-agent: *
Allow: /