wsd.pl - automatically assign a meaning to every word in a text
wsd.pl --context FILE --format FORMAT [--scheme SCHEME] [--type MEASURE] [--config FILE] [--stoplist FILE] [--window INT] [--contextScore NUM] [--pairScore NUM] [--outfile FILE] [--trace INT] [--forcepos] [--nocompoundify] [--usemono][--backoff] | --help | --version
Disambiguates each word in the context file using the specified relatedness measure (or WordNet::Similarity::lesk if none is specified).
N.B., the = sign between the option name and the option parameter is optional.
The input file containing the text to be disambiguated. This "option" is required.
The format of the input file. For all formats there must be one sentence per line, one line per sentence. Valid values are:
The input is raw text. Compounds will be identified, punctuation is ignored.
The input has been part-of-speech tagged with Penn Treebank tags. Compounds are not identified, and untagged words are ignored.
The input has been part-of-speech tagged with WordNet tags (n, v, a, r). Compounds are not identified, and untagged words are ignored.
The disambiguation scheme to use. Valid values are "normal", "fixed", "sense1", and "random". The default is "normal". In fixed mode, once a word is assigned a sense number, other senses of that word won't be considered when disambiguating words to the right of that context word. For example, if the context is
dogs run very fast
and 'dogs' has been assigned sense number 1, only sense 1 of dogs will be used in computing relatedness values when disambiguating 'run', 'very', and 'fast'.
WordNet sense 1 disambiguation guesses that the correct sense for each word is the first sense in WordNet because the senses of words in WordNet are ranked according to frequency. The first sense is more likely than the second, the second is more likely than the third, etc. Random selects one of the possible senses of the target word randomly.
The relatedness measure to be used. The default is WordNet::Similarity::lesk.
The name of a configuration file for the specified relatedness measure.
A file containing regular expressions (as understood by Perl), surrounded by by slashes (e.g. /\d+/ removes any word containing a digit [0-9]). Any word in the text to be disambiguated that matches one of the regular expressions in the file is removed. Each regular expression must be on its own line, and any trailing whitespace is ignored.
Care must be taken when crafting a stoplist. For example, it is tempting to use /a/ to remove the word 'a', but that expression would result in all words containing the lowercase letter a to be removed. A better alternative would be /\ba\b/.
Defines the size of the window of context. The default is 4. A window size of N means that there will be a total of N words in the context window, including the target word. If N is a (positive) even number, then there will be one more word on the left side of the target word than on the right.
For example, if the window size is 4, then there will be two words on the left side of the target word and one on the right. If the window is 5, then there will be two words on each side of the target word.
The minimum window size is 2. A smaller window would mean that there were no context words in the window.
If no sense of the target word achieves this minimum score, then no winner will be projected (e.g., it is assumed that there is no best sense or that none of the senses are sufficiently related to the surrounding context). The default is zero.
The minimum pairwise score between a sense of the target word and the best sense of a context word that will be used in computing the overall score for that sense of the target word. Setting this to be greater than zero (but not too large) will reduce noise. The default is zero.
The name of a file to which output should be sent. This file will display one word and its sense per line.
Turn tracing on/off. A value of zero turns tracing off, a non-zero value turns tracing on. The different trace levels can be added together to see the combined traces. The trace levels are:
1 Show the context window for each pass through the algorithm. 2 Display winning score for each pass (i.e., for each target word). 4 Display the non-zero scores for each sense of each target word (overrides 2). 8 Display the non-zero values from the semantic relatedness measures. 16 Show the zero values as well when combined with either 4 or 8. When not used with 4 or 8, this has no effect. 32 Display traces from the semantic relatedness module.
Turn part of speech coercion on. POS coercion attempts to force other words in the context window to be of the same part of speech as the target word. If the text is POS tagged, the POS tags will be ignored. POS coercion may be useful when using a measure of semantic similarity that only works with noun-noun and verb-verb pairs.
Disable compoundifying. By default AllWords.pm compoundifes the input raw text. Using this option will disable this.
If this flag is on the only available sense is assignsed to the usemono words. By default this flag is off.
Use the most frequent sense if the measure can't assign sense because no relatedness is found with the surrounding words. This happens for path based measures and Info content based measures.
L<WordNet::SenseRelate::AllWords>
The main web page for SenseRelate is
L<http://senserelate.sourceforge.net/>
There are several mailing lists for SenseRelate:
L<http://lists.sourceforge.net/lists/listinfo/senserelate-users/> L<http://lists.sourceforge.net/lists/listinfo/senserelate-news/> L<http://lists.sourceforge.net/lists/listinfo/senserelate-developers/>
Jason Michelizzi Ted Pedersen, University of Minnesota, Duluth E<lt>tpederse at d.umn.eduE<gt>
Please report to senserelate-users mailing list.
Copyright (C) 2004-2008 Jason Michelizzi and Ted Pedersen
This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation; either version 2 of the License, or (at your option) any later version.
This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.
To install WordNet::SenseRelate::AllWords, copy and paste the appropriate command in to your terminal.
cpanm
cpanm WordNet::SenseRelate::AllWords
CPAN shell
perl -MCPAN -e shell install WordNet::SenseRelate::AllWords
For more information on module installation, please visit the detailed CPAN module installation guide.