allwords-scorer2.pl - perl script used to score allwords.
allwords-scorer2.pl --ansfile FILE --keyfile FILE
This perl script is similar to the scorer2 C program. Given an answer file and a key file, this program scores the answers against the key and gives the overall precision, recall and F-measure. It also gives results for different part of speech tags. At the end it displays the confusion matrix which presents the errors in identifying part of speech tags.
name of a file containing formatted answers
name of an answer-key file
specific instance to score
For example, allwords-scorer2.pl --ansfile FILE --keyfile FILE --word have
score allinstances except for these instances. Give a comma separated list of words if you want to use multiple words. For example,
./allwords-scorer2.pl --ansfile test.out --keyfile test.key --exceptword have, make, see
Score only specific instances. Valid options are
--score poly score only polysemes instances --score s1nc score only the instances where the most frequent sense is not correct --score polys1c Scoring only the instances where the most frequent sense is correct and the word is polysemes. --score n score only the instances having n number of sense
scorer2 is a C program used to score entries to Senseval. The source code is available for downloading:
Varada Kolhatkar, University of Minnesota, Duluth <kolha002 at d.umn.edu> Ted Pedersen, University of Minnesota, Duluth <tpederse at d.umn.edu>
This document last modified by : $Id: allwords-scorer2.pl,v 1.12 2009/05/24 14:50:37 kvarada Exp $
L<scorer2-format.pl> L<semcor-reformat.pl> L<wsd-experiments.pl> L<scorer2-sort.pl>
Copyright (C) 2005-2008 by Jason Michelizzi and Ted Pedersen
This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation; either version 2 of the License, or (at your option) any later version.
This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.