Hinrik Örn Sigurðsson > Hailo > Hailo::Tokenizer::Words

Download:
Hailo-0.70.tar.gz

Dependencies

Annotate this POD

Website

CPAN RT

Open  2
View/Report Bugs
Module Version: 0.70   Source   Latest Release: Hailo-0.72

NAME ^

Hailo::Tokenizer::Words - A tokenizer for Hailo which splits on whitespace and word boundaries, mostly.

DESCRIPTION ^

This tokenizer does its best to handle various languages. It knows about most apostrophes, quotes, and sentence terminators.

AUTHOR ^

Hinrik Örn Sigurðsson, hinrik.sig@gmail.com

LICENSE AND COPYRIGHT ^

Copyright 2010 Hinrik Örn Sigurðsson

This program is free software, you can redistribute it and/or modify it under the same terms as Perl itself.

syntax highlighting: