The Perl Toolchain Summit needs more sponsors. If your company depends on Perl, please support this very important event.
BARBIE / CPAN-Testers-WWW-Reports-3.56 / vhost / html / robots.txt 
User-agent: Googlebot
Crawl-delay: 600
Disallow: /private/
Disallow: /*.yaml$
Disallow: /*.rss$
Disallow: /*.json$

User-agent: msnbot
Disallow: /private/
Disallow: /*.yaml$
Disallow: /*.rss$
Disallow: /*.json$

User-agent: DotBot
Crawl-delay: 600
Disallow: /private/
Disallow: /*.yaml$
Disallow: /*.rss$
Disallow: /*.json$

User-agent: *
Crawl-delay: 600
Disallow: /private/
Disallow: /*.yaml$
Disallow: /*.rss$
Disallow: /*.json$