Hailo::Tokenizer::Words - A tokenizer for Hailo which splits on whitespace, mostly.
This tokenizer does its best to handle various languages. It knows about most apostrophes, quotes, and sentence terminators.
Hinrik Örn Sigurðsson, hinrik.sig@gmail.com
Copyright 2010 Hinrik Örn Sigurðsson
This program is free software, you can redistribute it and/or modify it under the same terms as Perl itself.
To install Hailo, copy and paste the appropriate command in to your terminal.
cpanm
cpanm Hailo
CPAN shell
perl -MCPAN -e shell install Hailo
For more information on module installation, please visit the detailed CPAN module installation guide.