User-agent: msnbot Disallow: / User-agent: BecomeBot Disallow: / User-agent: psbot Disallow: / User-agent: Slurp Crawl-delay: 86400 User-agent: * Disallow: /stats/ Disallow: /img/ Disallow: /css/