NAME

Scheme::Tokenizer - The Scheme tokenizer

SYNOPSIS

  use Scheme:Tokenizer;

  my @code = Scheme::Tokenizer->new($file_name)->tokenize();

DESCRIPTION

The tokenizer takes a file and splits it into tokens.

AUTHOR

Jeffrey Goff, drforr@hargray.com

SEE ALSO

Scheme, Scheme::Parser, Scheme::Generator