package Plucene::Analysis::Analyzer;

=head1 NAME 

Plucene::Analysis::Analyzer - base class for Analyzers

=head1 SYNOPSIS

	my $analyzer = Plucene::Analysis::Analyzer::Subclass->new;

=head1 DESCRIPTION

This is an abstract base class of Analyzers.

An Analyzer builds TokenStreams, which analyze text. It thus represents 
a policy for extracting index terms from text.

Typical implementations first build a Tokenizer, which breaks the stream 
of characters from the Reader into raw Tokens. One or more TokenFilters 
may then be applied to the output of the Tokenizer.

=head1 METHODS

=cut

use strict;
use warnings;

=head2 new

	my $analyzer = Plucene::Analysis::Analyzer::Subclass->new;

=cut

sub new { bless {}, shift }

=head2 tokenstream

This must be defined in a subclass

=cut

sub tokenstream { die "tokenstream must be defined in a subclass" }

1;