The Perl Toolchain Summit needs more sponsors. If your company depends on Perl, please support this very important event.

NAME

Lingua::JA::Categorize::Tokenizer - Extract featured words from a document

SYNOPSIS

  use Lingua::JA::Categorize::Tokenizer;

  my $tokenizer = Lingua::JA::Categorize::Tokenizer->new;
  my $word_set = $tokenizer->tokenize($text_ref);

DESCRIPTION

Lingua::JA::Categorize::Tokenizer is a featured word extractor.

It is just a warpper of Lingua::JA::TFIDF.

METHODS

new

tokenize

calc

AUTHOR

takeshi miki <miki@cpan.org>

LICENSE

This library is free software; you can redistribute it and/or modify it under the same terms as Perl itself.

SEE ALSO