The Perl Toolchain Summit needs more sponsors. If your company depends on Perl, please support this very important event.
Text-Statistics-Cyrillic version 0.04
==========================================

ABSTRACT

This module performs corpora(1) statatistical analysis.

DESCRIPTION

Text::Statistics::Cyrillic creates a seven column CSV file output, with one line
each token per text, given as input a latin-utf8 coded corpus that files
names follows:
    1 (1). txt', '1 (2). txt', ..., '1 (n).txt'  or
    1 \(([1-9]|[1-9][0-9]+)\)\.txt
Columns stores statistical information:
(1) number of word forms in document d;
(2) number of tokens in d;
(3) Id number of d, ie., n;
(4) frequency of term t in d;
(5) corpus frequency(2) of t ;
(6) document frequency of t (number of documents where t occurs at least once);
(7) t, UTF8 latin-coded token-string

Main output file name is '1 (n + 5).txt' and it is stored in the same directory as
the corpus itself, together with residual files on each input file with .txu and .txv ad hoc extensions.

Example:

    use Text::Statistics::Cyrillic;
    &cyrillic("4"); #3, i.e (4-1) texts will be analysed.

INSTALLATION

To install this module type the following:

   perl Makefile.PL
   make
   make test
   make install

DEPENDENCIES

This module requires these other modules and libraries:

	utf8
	Text::ParseWords

SEE ALSO

	http://search.cpan.org/~ambs/
	http://search.cpan.org/~tpederse/
	

REFERENCES

(1) BERBER-SARDINHA, Tony. Linguistica de Corpus. Manole, 2004
(2) http://www-csli.stanford.edu/~schuetze/information-retrieval-book.html

COPYRIGHT AND LICENCE

Copyright (C) 2007 by Rodrigo Panchiniak Fernandes
This code was written under CAPES BEX-09323-5

This library is free software; you can redistribute it and/or modify
it under the same terms as Perl itself, either Perl version 5.8.8 or,
at your option, any later version of Perl 5 you may have available.