Tokenize - Split up data on whitespace into tokens.
use Tokenize;
my $t = Tokenize->new();
$t->tokenize($data);
This module tokenizes data, where a token is delimited by whitespace.
Reterns an instance of the class.
Tokenizes the data supplied in the array reference $data.
Iestyn Pryce, <imp25@cam.ac.uk>
I'd like to thank the Ensemble project (www.ensemble.ac.uk) for funding me to work on this project in the summer of 2009.
Copyright (C) 2009 Iestyn Pryce <imp25@cam.ac.uk>
This library is free software; you can redistribute it and/or modify it under the terms of the BSD license.
