sitemapper.pl - script for generating site maps
sitemapper.pl [ -verbose <debug level> ] [ -help ] [ -doc ] [ -depth <depth> ] [ -proxy <proxy URL> ] [ -[no]envproxy ] [ -agent <agent> ] [ -authen ] [ -format <html|text|js|xml> ] [ -summary <no. chars> ] [ -title <page title> ] [ -email <e-mail address> ] [ -gui ] -url <root URL>
sitemapper.pl generates site maps for a given site. It traverses a site from the root URL given as the -site option and generates an HTML page consisting of a bulleted list which reflects the structure of the site.
The structure reflects the distance from the home page of the pages listed; i.e. the first level bullets are pages accessible directly from the home page, the next level, pages accessible from those pages, etc. Obviously, pages that are linked from "higher" up pages may appear in the "wrong place" in the tree, than they "belong".
The -format option can be used to specify alternative options for formating the site map. Currently the options are html (as described above - the default), js, which uses Jef Pearlman's (jef@mit.edu) Javascript Tree class to display the site map as a collapsable tree, and text (plain text).
Option to specify the depth of the site map generated. If no specified, generates a sitemap of unlimited depth.
Option to specify the e-mail address which is reported by the robot to the site it gets pages from.
Option to specify a root URL to generate a site map for.
Specify an HTTP proxy to use.
If -envproxy is set, the proxy specified by the $http_proxy environment variable will be used (this is the default behaviour). Use -noenvproxy to suppress this. -proxy takes precedence over -envproxy.
Allows the user to specify an agent for the robot to pretend to be (e.g. 'Mozilla/4.5'). This can be necessary for sites that do browser sniff for serving particular content, etc.
Option for specifying the for the site map. Possible values are:
Plain old HTML bulleted list.
A collapsable DHTML tree, generated using Jef Pearlman's (jef@mit.edu) Javascript Tree class.
Plain text.
An XML graph of linkage between pages.
Automatically extract a summary to display with the title. This will be truncated at the specified number of characters.
Option to specify a page title for the site map.
Option to use LWP::AuthenAgent to get HTML pages. This allows the user to type username / password for pages that are access controlled.
Use a Tk GUI to run sitemapper.
Display a short help message to standard output, with a brief description of purpose, and supported command-line switches.
Display the full documentation for the script, generated from the embedded pod format doc.
Print out the current version number.
Turn on verbose error messages.
sitemapper.pl makes use of the $http_proxy environment variable, if it is set.
$http_proxy
Date::Format HTML::Entities Getopt::Long IO::File LWP::AuthenAgent LWP::UserAgent Pod::Usage URI::URL WWW::Sitemap
hpux 10 PA-RISC1.1 linux 2.2.1 ppc-linux linux 2.2.2 i686-linux MSWin32 4.0 MSWin32-x86 sunos 4.1.4 sun4-sunos sunos 5.6 sun4-solaris
Jef Pearlman's Javascript Tree class (http://developer.netscape.com/docs/examples/dynhtml/tree.html)
The Javascript sitemap has only been tested on Netscape 4.05.
Ave Wrigley <Ave.Wrigley@itn.co.uk>
Copyright (c) 1998 Canon Research Centre Europe. All rights reserved.
This script is free software; you can redistribute it and/or modify it under the same terms as Perl itself.
Web
To install WWW::Sitemap, copy and paste the appropriate command in to your terminal.
cpanm
cpanm WWW::Sitemap
CPAN shell
perl -MCPAN -e shell install WWW::Sitemap
For more information on module installation, please visit the detailed CPAN module installation guide.