NAME
Hash::Ordered - A fast, pure-Perl ordered hash class
VERSION
version 0.009
SYNOPSIS
use Hash::Ordered;
my $oh = Hash::Ordered->new( a => 1 );
$oh->get( 'a' );
$oh->set( 'a' => 2 );
$oh->exists( 'a' );
$val = $oh->delete( 'a' );
@keys = $oh->keys;
@vals = $oh->values;
@pairs = $oh->as_list
$oh->push( c => 3, d => 4 );
$oh->unshift( e => 5, f => 6 );
( $k, $v ) = $oh->pop;
( $k, $v ) = $oh->shift;
$iter = $oh->iterator;
while( ( $k, $v ) = $iter->() ) { ... }
$copy = $oh->clone;
$subset = $oh->clone( qw/c d/ );
$reversed = $oh->clone( reverse $oh->keys );
@value_slice = $oh->values( qw/c f/ ); # qw/3 6/
@pairs_slice = $oh->as_list( qw/f e/ ); # qw/f 6 e 5/
$oh->postinc( 'a' ); # like $oh{a}++
$oh->add( 'a', 5 ); # like $oh{a} += 5
$oh->concat( 'a', 'hello' ); # like $oh{a} .= 'hello'
$oh->or_equals( 'g', '23' ); # like $oh{g} ||= 23
$oh->dor_equals( 'g', '23' ); # like $oh{g} //= 23
DESCRIPTION
This module implements an ordered hash, meaning that it associates keys
with values like a Perl hash, but keeps the keys in a consistent order.
Because it is implemented as an object and manipulated with method
calls, it is much slower than a Perl hash. This is the cost of keeping
order.
However, compared to other ordered hash implementations, Hash::Ordered
is optimized for getting and setting individual elements and is
generally faster at most other tasks as well. For specific details, see
Hash::Ordered::Benchmarks.
METHODS
new
$oh = Hash::Ordered->new;
$oh = Hash::Ordered->new( @pairs );
Constructs an object, with an optional list of key-value pairs.
The position of a key corresponds to the first occurrence in the list,
but the value will be updated if the key is seen more than once.
Current API available since 0.009.
clone
$oh2 = $oh->clone;
$oh2 = $oh->clone( @keys );
Creates a shallow copy of an ordered hash object. If no arguments are
given, it produces an exact copy. If a list of keys is given, the new
object includes only those keys in the given order. Keys that aren't in
the original will have the value "undef".
keys
@keys = $oh->keys;
$size = $oh->keys;
In list context, returns the ordered list of keys. In scalar context,
returns the number of elements.
Current API available since 0.005.
values
@values = $oh->values;
@values = $oh->values( @keys );
Returns an ordered list of values. If no arguments are given, returns
the ordered values of the entire hash. If a list of keys is given,
returns values in order corresponding to those keys. If a key does not
exist, "undef" will be returned for that value.
In scalar context, returns the number of elements.
Current API available since 0.006.
get
$value = $oh->get("some key");
Returns the value associated with the key, or "undef" if it does not
exist in the hash.
set
$oh->set("some key" => "some value");
Associates a value with a key and returns the value. If the key does not
already exist in the hash, it will be added at the end.
exists
if ( $oh->exists("some key") ) { ... }
Test if some key exists in the hash (without creating it).
delete
$value = $oh->delete("some key");
Removes a key-value pair from the hash and returns the value.
clear
$oh->clear;
Removes all key-value pairs from the hash. Returns undef in scalar
context or an empty list in list context.
Current API available since 0.003.
push
$oh->push( one => 1, two => 2);
Add a list of key-value pairs to the end of the ordered hash. If a key
already exists in the hash, it will be deleted and re-inserted at the
end with the new value.
Returns the number of keys after the push is complete.
pop
($key, $value) = $oh->pop;
Removes and returns the last key-value pair in the ordered hash.
unshift
$oh->unshift( one => 1, two => 2 );
Adds a list of key-value pairs to the beginning of the ordered hash. If
a key already exists, it will be deleted and re-inserted at the
beginning with the new value.
Returns the number of keys after the unshift is complete.
shift
($key, $value) = $oh->shift;
Removes and returns the first key-value pair in the ordered hash.
merge
$oh->merge( one => 1, two => 2 );
Merges a list of key-value pairs into the ordered hash. If a key already
exists, its value is replaced. Otherwise, the key-value pair is added at
the end of the hash.
as_list
@pairs = $oh->as_list;
@pairs = $oh->as_list( @keys );
Returns an ordered list of key-value pairs. If no arguments are given,
all pairs in the hash are returned. If a list of keys is given, the
returned list includes only those key-value pairs in the given order.
Keys that aren't in the original will have the value "undef".
iterator
$iter = $oh->iterator;
$iter = $oh->iterator( reverse $oh->keys ); # reverse
while ( my ($key,$value) = $iter->() ) { ... }
Returns a code reference that returns a single key-value pair (in order)
on each invocation, or the empty list if all keys are visited.
If no arguments are given, the iterator walks the entire hash in order.
If a list of keys is provided, the iterator walks the hash in that
order. Unknown keys will return "undef".
The list of keys to return is set when the iterator is generator. Keys
added later will not be returned. Subsequently deleted keys will return
"undef" for the value.
preinc
$oh->preinc($key); # like ++$hash{$key}
This method is sugar for incrementing a key without having to call "set"
and "get" explicitly. It returns the new value.
Current API available since 0.005.
postinc
$oh->postinc($key); # like $hash{$key}++
This method is sugar for incrementing a key without having to call "set"
and "get" explicitly. It returns the old value.
Current API available since 0.005.
predec
$oh->predec($key); # like --$hash{$key}
This method is sugar for decrementing a key without having to call "set"
and "get" explicitly. It returns the new value.
Current API available since 0.005.
postdec
$oh->postdec($key); # like $hash{$key}--
This method is sugar for decrementing a key without having to call "set"
and "get" explicitly. It returns the old value.
Current API available since 0.005.
add
$oh->add($key, $n); # like $hash{$key} += $n
This method is sugar for adding a value to a key without having to call
"set" and "get" explicitly. With no value to add, it is treated as "0".
It returns the new value.
Current API available since 0.005.
subtract
$oh->subtract($key, $n); # like $hash{$key} -= $n
This method is sugar for subtracting a value from a key without having
to call "set" and "get" explicitly. With no value to subtract, it is
treated as "0". It returns the new value.
Current API available since 0.005.
concat
$oh->concat($key, $str); # like $hash{$key} .= $str
This method is sugar for concatenating a string onto the value of a key
without having to call "set" and "get" explicitly. It returns the new
value. If the value to append is not defined, no concatenation is done
and no warning is given.
Current API available since 0.005.
or_equals
$oh->or_equals($key, $str); # like $hash{$key} ||= $str
This method is sugar for assigning to a key if the existing value is
false without having to call "set" and "get" explicitly. It returns the
new value.
Current API available since 0.005.
dor_equals
$oh->dor_equals($key, $str); # like $hash{$key} //= $str
This method is sugar for assigning to a key if the existing value is not
defined without having to call "set" and "get" explicitly. It returns
the new value.
Current API available since 0.005.
OVERLOADING
Boolean
if ( $oh ) { ... }
When used in boolean context, a Hash::Ordered object is true if it has
any entries and false otherwise.
String
say "$oh";
When used in string context, a Hash::Ordered object stringifies like
typical Perl objects. E.g. "Hash::Ordered=ARRAY(0x7f815302cac0)"
Current API available since 0.005.
Numeric
$count = 0 + $oh;
When used in numeric context, a Hash::Ordered object numifies as the
decimal representation of its memory address, just like typical Perl
objects. E.g. 140268162536552
For the number of keys, call the "keys" method in scalar context.
Current API available since 0.005.
Fallback
Other overload methods are derived from these three, if possible.
TIED INTERFACE
Using "tie" is slower than using method calls directly. But for
compatibility with libraries that can only take hashes, it's available
if you really need it:
tie my %hash, "Hash::Ordered", @pairs;
If you want to access the underlying object for method calls, use
"tied":
tied( %hash )->unshift( @data );
Tied hash API available since 0.005.
CAVEATS
Deletion and order modification with push, pop, etc.
This can be expensive, as the ordered list of keys has to be updated.
For small hashes with no more than 25 keys, keys are found and spliced
out with linear search. As an optimization for larger hashes, the first
change to the ordered list of keys will construct an index to the list
of keys. Thereafter, removed keys will be marked with a "tombstone"
record. Tombstones will be garbage collected whenever the number of
tombstones exceeds the number of valid keys.
These internal implementation details largely shouldn't concern you. The
important things to note are:
* The costs of efficient deletion are deferred until you need it
* Deleting lots of keys will temporarily appear to leak memory until
garbage collection occurs
MOTIVATION
For a long time, I used Tie::IxHash for ordered hashes, but I grew
frustrated with things it lacked, like a cheap way to copy an IxHash
object or a convenient iterator when not using the tied interface. As I
looked at its implementation, it seemed more complex than I though it
needed, with an extra level of indirection that slows data access.
Given that frustration, I started experimenting with the simplest thing
I thought could work for an ordered hash: a hash of key-value pairs and
an array with key order.
As I worked on this, I also started searching for other modules doing
similar things. What I found fell broadly into two camps: modules based
on tie (even if they offered an OO interface), and pure OO modules. They
all either lacked features I deemed necessary or else seemed
overly-complex in either implementation or API.
Hash::Ordered attempts to find the sweet spot with simple
implementation, reasonably good efficiency for most common operations,
and a rich, intuitive API.
After discussions with Mario Roy about the potential use of
Hash::Ordered with MCE, I optimized deletion of larger hashes and
provided a tied interface for compatibility. Mario's suggestions and
feedback about optimization were quite valuable. Thank you, Mario!
SEE ALSO
This section describes other ordered-hash modules I found on CPAN. For
benchmarking results, see Hash::Ordered::Benchmarks.
Tie modules
The following modules offer some sort of tie interface. I don't like
ties, in general, because of the extra indirection involved over a
direct method call. Still, you can make any tied interface into a faster
OO one with "tied":
tied( %tied_hash )->FETCH($key);
Tie::Hash::Indexed is implemented in XS and thus seems promising if
pure-Perl isn't a criterion; it generally fails tests on Perl 5.18 and
above due to the hash randomization change. Despite being XS, it is
slower than Hash::Ordered at everything exception creation and deletion.
Tie::IxHash is probably the most well known and includes an OO API.
Given the performance problems it has, "well known" is the only real
reason to use it.
These other modules below have very specific designs/limitations and I
didn't find any of them suitable for general purpose use:
* Tie::Array::AsHash — array elements split with separator; tie API
only
* Tie::Hash::Array — ordered alphabetically; tie API only
* Tie::InsertOrderHash — ordered by insertion; tie API only
* Tie::LLHash — linked-list implementation; quite slow
* Tie::StoredOrderHash — ordered by last update; tie API only
Other ordered hash modules
Other modules stick with an object-oriented API, with a wide variety of
implementation approaches.
Array::AsHash is essentially an inverse implementation from
Hash::Ordered. It keeps pairs in an array and uses a hash to index into
the array. This indirection would already make hash-like operations
slower, but the specific implementation makes it even worse, with
abstractions and function calls that make getting or setting individual
items up to 10x slower than Hash::Ordered.
However, "Array::AsHash" takes an arrayref to initialize, which is very
fast and can return the list of pairs faster, too. If you mostly create
and list out very large ordered hashes and very rarely touch individual
entries, I think this could be something to very cautiously consider.
These other modules below have restrictions or particularly complicated
implementations (often relying on "tie") and thus I didn't think any of
them really suitable for use:
* Array::Assign — arrays with named access; restricted keys
* Array::OrdHash — overloads array/hash deref and uses internal tied
data
* Data::Pairs — array of key-value hashrefs; allows duplicate keys
* Data::OMap — array of key-value hashrefs; no duplicate keys
* Data::XHash — blessed, tied hashref with doubly-linked-list
SUPPORT
Bugs / Feature Requests
Please report any bugs or feature requests through the issue tracker at
<https://github.com/dagolden/Hash-Ordered/issues>. You will be notified
automatically of any progress on your issue.
Source Code
This is open source software. The code repository is available for
public review and contribution under the terms of the license.
<https://github.com/dagolden/Hash-Ordered>
git clone https://github.com/dagolden/Hash-Ordered.git
AUTHOR
David Golden <dagolden@cpan.org>
CONTRIBUTORS
* Benct Philip Jonsson <bpjonsson@gmail.com>
* Mario Roy <marioeroy@gmail.com>
COPYRIGHT AND LICENSE
This software is Copyright (c) 2014 by David Golden.
This is free software, licensed under:
The Apache License, Version 2.0, January 2004