Hadoop::Streaming - Contains Mapper, Combiner and Reducer roles to simplify writing Hadoop Streaming jobs

++

++

Hadoop::Streaming::* provides a simple perl interface to the Streaming interface of Hadoop. Hadoop is a system "reliable, scalable, distributed computing." Hadoop was developed at Yahoo! and is now maintained by the Apache Software Foundation. Hadoop...

SPAZM/Hadoop-Streaming-0.143060 - 02 Nov 2014 03:51:16 UTC

Hadoop::Streaming::Mapper - Simplify writing Hadoop Streaming Mapper jobs. Write a map() function and let this role handle the Stream interface.

++

++

SPAZM/Hadoop-Streaming-0.143060 - 02 Nov 2014 03:51:16 UTC

Hadoop::Streaming::Reducer - Simplify writing Hadoop Streaming jobs. Write a reduce() function and let this role handle the Stream interface. This Reducer roll provides an iterator over the multiple values for a given key.

++

++

SPAZM/Hadoop-Streaming-0.143060 - 02 Nov 2014 03:51:16 UTC

Hadoop::Streaming::Combiner - Simplify writing Hadoop Streaming jobs. Combiner follows the same interface as Reducer. Requires a combine() function which will be called for each line of combiner data. Combiners are run on the same machine as the mapper as a pre-reduce reduction step.

++

++

SPAZM/Hadoop-Streaming-0.143060 - 02 Nov 2014 03:51:16 UTC

Hadoop::Streaming::Role::Emitter - Role to provide emit, counter, and status interaction with Hadoop::Streaming.

++

++

SPAZM/Hadoop-Streaming-0.143060 - 02 Nov 2014 03:51:16 UTC

Hadoop::Streaming::Role::Iterator - Role to require has_next and next

++

++

SPAZM/Hadoop-Streaming-0.143060 - 02 Nov 2014 03:51:16 UTC

Hadoop::Streaming::Reducer::Input - Parse input stream for reducer

++

++

SPAZM/Hadoop-Streaming-0.143060 - 02 Nov 2014 03:51:16 UTC

Hadoop::Streaming::Reducer::Input::Iterator - Collects values for each key together with an iterator interface

++

++

SPAZM/Hadoop-Streaming-0.143060 - 02 Nov 2014 03:51:16 UTC

Hadoop::Streaming::Reducer::Input::ValuesIterator - Role providing access to values for a given key.

++

++

SPAZM/Hadoop-Streaming-0.143060 - 02 Nov 2014 03:51:16 UTC