Daisuke Maki > Gungho-0.09008 > Gungho::Component::RobotsMETA

Download:
Gungho-0.09008.tar.gz

Dependencies

Annotate this POD

CPAN RT

New  6
Open  4
View/Report Bugs
Source  

NAME ^

Gungho::Component::RobotsMETA - Automatically Parse Robots META

SYNOPSIS ^

  components:
    - RobotsMETA

DESCRIPTION ^

This module automatically parses any text/html document for robots exclusion directies embedded in the document.

METHODS ^

setup

Initializes the component.

handle_response

Overrides Gungho::Component::Core::handle_response()

SEE ALSO ^

HTML::RobotsMETA

syntax highlighting: