Tokenize - Split up data on whitespace into tokens.
use Tokenize; my $t = Tokenize->new(); $t->tokenize($data);
This module tokenizes data, where a token is delimited by whitespace.
Reterns an instance of the class.
Tokenizes the data supplied in the array reference $data.
Iestyn Pryce, <firstname.lastname@example.org>
I'd like to thank the Ensemble project (www.ensemble.ac.uk) for funding me to work on this project in the summer of 2009.
Copyright (C) 2009 Iestyn Pryce <email@example.com>
This library is free software; you can redistribute it and/or modify it under the terms of the BSD license.