View on
MetaCPAN is shutting down
For details read Perl NOC. After June 25th this page will redirect to
Ted Pedersen > WordNet-Similarity >


Annotate this POD


Open  6
View/Report Bugs

NAME ^ - Compute Information Content from SemCor sense-tagged corpus

SYNOPSIS ^ [{ --outfile FILE [--wnpath PATH] [--smooth SCHEME] 
        | --help | --version }]


This program is used to generate the default information content file (ic-semcor.dat) that is used by WordNet::Similarity in the Jiang Conrath, Resnik and Lin measures.

It uses the cntlist file as provided by WordNet as the source of frequency counts. These are derived from sense tagged corpora which include a portion of the Brown Corpus and the Red Badge of Courage. This collection of of sense tagged text is referred to as SemCor, and is not distributed by WordNet any longer. Also, note that the cntlist file is no longer officially supported by WordNet, so the information provided therein may not be reliable.

The SemCor data we use comes from Rada Mihalcea, who has mapped SemCor from its original version to each successive version of WordNet. In this program we ignore the SenseTags and simply treat SemCor as raw text. This is to allow for the comparison of the effect of counting from sense tags (as done in versus raw or plain word forms (as done here).



    The name of a file to which output should be written


    Location of the WordNet data files (e.g.,


    Smoothing should used on the probabilities computed.  SCHEME can
    only be ADD1 at this time


    Show a help message


    Display version information


Report to WordNet::Similarity mailing list :



SemCor Download (from Rada Mihalcea):

WordNet home page :

WordNet::Similarity home page :


 Ted Pedersen, University of Minnesota, Duluth
 tpederse at

 Siddharth Patwardhan, University of Utah, Salt Lake City
 sidd at


Copyright (c) 2005-2008, Ted Pedersen and Siddharth Patwardhan

This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation; either version 2 of the License, or (at your option) any later version. This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.

You should have received a copy of the GNU General Public License along with this program; if not, write to the Free Software Foundation, Inc., 59 Temple Place - Suite 330, Boston, MA 02111-1307, USA.

syntax highlighting: