Catmandu - a data toolkit
Importing, transforming, storing and indexing data should be easy.
Catmandu provides a suite of Perl modules to ease the import, storage, retrieval, export and transformation of metadata records. Combine Catmandu modules with web application frameworks such as PSGI/Plack, document stores such as MongoDB and full text indexes as Solr to create a rapid development environment for digital library services such as institutional repositories and search engines.
In the LibreCat project it is our goal to provide in open source a set of programming components to build up digital libraries services suited to your local needs.
Read an in depth introduction into Catmandu programming in Catmandu::Introduction.
Version 0.0302
use Catmandu; Catmandu->load; Catmandu->load('/config/path', '/another/config/path'); Catmandu->store->bag('projects')->count; Catmandu->config; Catmandu->config->{foo} = 'bar'; use Catmandu -all; use Catmandu qw(config store); use Catmandu -load; use Catmandu -all -load => [qw(/config/path' '/another/config/path)];
Catmandu configuration options can be stored in a file in the root directory of your programming project. The file can be YAML, JSON or Perl and is called catmandu.yml, catmandu.json or catmandu.pl. In this file you can set the default Catmandu stores and exporters to be used. Here is an example of a catmandu.yml file:
catmandu.yml
catmandu.json
catmandu.pl
store: default: package: ElasticSearch options: index_name: myrepository exporter: default: package: YAML
For large configs it's more convenient to split the config in several files. You can do so by including the config hash key in the file name.
catmandu.yaml catmandu.store.yaml catmandu.foo.bar.json
Config files are processed in alfabetical order. To keep things simple values are not merged. So the contents of catmandu.store.yml will overwrite Catmandu->config->{store} if it already exists.
catmandu.store.yml
Catmandu->config->{store}
Same as Catmandu->config.
Catmandu->config
Same as Catmandu->store.
Catmandu->store
Same as Catmandu->importer.
Catmandu->importer
Same as Catmandu->exporter.
Catmandu->exporter
Same as Catmandu->export.
Catmandu->export
Same as Catmandu->export_to_string.
Catmandu->export_to_string
Import everything.
use Catmandu -load; use Catmandu -load => []; # is the same as Catmandu->load; use Catmandu -load => ['/config/path']; # is the same as Catmandu->load('/config/path');
Return the path where Catmandu will (optionally) start searching for a catmandu.yml configuration file.
Set the location of the default configuration file to a new path.
Load all the configuration options in the catmanu.yml configuraton file.
Load all the configuration options stored at alternative paths.
Returns an ARRAYREF of paths where configuration was found. Note that this list is empty before load.
load
Returns the first path where configuration was found. Note that this is undef before load.
undef
Returns the current configuration as a HASHREF.
Return the name of the default store.
Return an instance of a store with name NAME or use the default store when no name is provided. The NAME is set in the configuration file. E.g.
store: default: package: ElasticSearch options: index_name: blog test: package: Mock
In your program:
# This will use ElasticSearch Catmandu->store->bag->each(sub { ... }); Catmandu->store('default')->bag->each(sub { ... }); # This will use Mock Catmandu->store('test')->bag->search(...);
Return an instance of a Catmandu::Importer with name NAME (or the default 'JSON' when no name is given). The NAME is set in the configuration file. E.g.
importer: oai: package: OAI options: url: http://www.instute.org/oai/ feed: package: Atom options: url: http://www.mysite.org/blog/atom
Catmandu->importer('oai')->each(sub { ... } ); Catmandu->importer('oai', url => 'http://override')->each(sub { ... } ); Catmandu->importer('feed')->each(sub { ... } );
Return an instance of Catmandu::Exporter with name NAME (or the default 'JSON' when no name is given). The NAME is set in the configuration file (see 'importer').
Export data using a default or named exporter.
Catmandu->export({ foo=>'bar'}); my $importer = Catmandu::Importer::Mock->new; Catmandu->export($importer, 'YAML', file => '/my/file'); Catmandu->export($importer, 'my_exporter'); Catmandu->export($importer, 'my_exporter', foo => $bar);
Export data using a default or named exporter to a string.
my $importer = Catmandu::Importer::Mock->new; my $yaml = Catmandu->export_to_string($importer, 'YAML'); # is the same as my $yaml = ""; Catmandu->export($importer, 'YAML', file => \$yaml);
Nicolas Steenlant, <nicolas.steenlant at ugent.be>
<nicolas.steenlant at ugent.be>
Catmandu::Introduction
This program is free software; you can redistribute it and/or modify it under the terms of either: the GNU General Public License as published by the Free Software Foundation; or the Artistic License.
See http://dev.perl.org/licenses/ for more information.
To install Catmandu, copy and paste the appropriate command in to your terminal.
cpanm
cpanm Catmandu
CPAN shell
perl -MCPAN -e shell install Catmandu
For more information on module installation, please visit the detailed CPAN module installation guide.