User-agent: * Disallow: /images/ Disallow: /js/ User-agent: msnbot Disallow: /images/ Disallow: /js/ Crawl-delay: 5 User-agent: Slurp Disallow: /*/ctl/ # Slurp permits * Disallow: /images/ Disallow: /js/ Crawl-delay: 5 User-agent: Googlebot Disallow: /*/ctl/ # Googlebot permits * Disallow: /images/ Disallow: /js/ User-agent: Yahoo Pipes 1.0 Disallow: /images/ Disallow: /js/