WWW::RobotRules::Memcache - Use memcached in conjunction with WWW::RobotRules
use WWW::RobotRules::Memcache; my @memcache_servers = ('localhost:11211', '192.168.100.3:11211'); my $rules = WWW::RobotRules::Memcache->new(@memcache_servers); my $ua = WWW::RobotUA->new('my-robot/1.0', 'firstname.lastname@example.org', $rules); # Then just use $ua as usual $res = $ua->request($req);
This is a subclass of WWW::RobotRules that uses Cache::Memcache to implement persistent caching of robots.txt and host visit information.
When creating this object you must pass at least one memcache server.
<nick at gerakines.net>
Please report any bugs or feature requests to
bug-www-robotrules-cache at rt.cpan.org, or through the web interface at http://rt.cpan.org/NoAuth/ReportBug.html?Queue=WWW-RobotRules-Cache. I will be notified, and then you'll automatically be notified of progress on your bug as I make changes.
You can find documentation for this module with the perldoc command.
You can also look for information at:
Copyright 2006 Nick Gerakines, all rights reserved.
This program is free software; you can redistribute it and/or modify it under the same terms as Perl itself.