Tony Bowden > Plucene > Plucene::Analysis::WhitespaceTokenizer

Download:
Plucene-1.25.tar.gz

Dependencies

Annotate this POD

CPAN RT

New  12
Open  5
View/Report Bugs
Source  

NAME ^

Plucene::Analysis::WhitespaceTokenizer - white space tokenizer

SYNOPSIS ^

        # isa Plucene::Analysis::CharTokenizer

DESCRIPTION ^

A WhitespaceTokenizer is a tokenizer that divides text at whitespace. Adjacent sequences of non-Whitespace characters form tokens.

METHODS ^

syntax highlighting: