The Perl Toolchain Summit needs more sponsors. If your company depends on Perl, please support this very important event.
 / 
Kafka-1.001012
River stage one • 2 direct dependents • 2 total dependents
11 ++
/ Kafka::IO

NAME

Kafka::IO - Interface to network communication with the Apache Kafka server.

VERSION

This documentation refers to Kafka::IO version 1.001012 .

SYNOPSIS

    use 5.010;
    use strict;
    use warnings;

    use Scalar::Util qw(
        blessed
    );
    use Try::Tiny;

    use Kafka::IO;

    my $io;
    try {
        $io = Kafka::IO->new( host => 'localhost' );
    } catch {
        my $error = $_;
        if ( blessed( $error ) && $error->isa( 'Kafka::Exception' ) ) {
            warn 'Error: (', $error->code, ') ',  $error->message, "\n";
            exit;
        } else {
            die $error;
        }
    };

    # Closes and cleans up
    $io->close;
    undef $io;

DESCRIPTION

This module is private and should not be used directly.

In order to achieve better performance, methods of this module do not perform arguments validation.

The main features of the Kafka::IO class are:

  • Provides an object oriented API for communication with Kafka.

  • This class allows you to create Kafka 0.9+ clients.

CONSTRUCTOR

new

Establishes TCP connection to given host and port, creates and returns Kafka::IO IO object.

new() takes arguments in key-value pairs. The following arguments are currently recognized:

host => $host

$host is Kafka host to connect to. It can be a host name or an IP-address in IPv4 or IPv6 form (for example '127.0.0.1', '0:0:0:0:0:0:0:1' or '::1').

port => $port

Optional, default = $KAFKA_SERVER_PORT.

$port is integer attribute denoting the port number of to access Apache Kafka.

$KAFKA_SERVER_PORT is the default Apache Kafka server port that can be imported from the Kafka module.

timeout => $timeout

$REQUEST_TIMEOUT is the default timeout that can be imported from the Kafka module.

Special behavior when timeout is set to undef:

  • Alarms are not used internally (namely when performing gethostbyname).

  • Default $REQUEST_TIMEOUT is used for the rest of IO operations.

ip_version => $ip_version

Force version of IP protocol for resolving host name (or interpretation of passed address).

Optional, undefined by default, which works in the following way: version of IP address is detected automatically, host name is resolved into IPv4 address.

See description of $IP_V4, $IP_V6 in Kafka EXPORT.

METHODS

The following methods are provided by Kafka::IO class:

send( $message )

Sends a $message to Kafka.

The argument must be a bytes string.

Returns the number of characters sent.

receive( $length )

Receives a message up to $length size from Kafka.

$length argument must be a positive number.

Returns a reference to the received message.

close

Closes connection to Kafka server. Returns true if those operations succeed and if no error was reported by any PerlIO layer.

is_alive

The method verifies whether we are connected to Kafka server.

DIAGNOSTICS

When error is detected, an exception, represented by object of Kafka::Exception::Producer class, is thrown (see Kafka::Exceptions).

code and a more descriptive message provide information about thrown exception. Consult documentation of the Kafka::Exceptions for the list of all available methods.

Authors suggest using of Try::Tiny's try and catch to handle exceptions while working with Kafka package.

Here is the list of possible error messages that Kafka::IO may produce:

Invalid argument

Invalid arguments were passed to a method.

Can't send

Message can't be sent on a Kafka::IO object socket.

Can't recv

Message can't be received.

Can't bind

TCP connection can't be established on given host and port.

Debug mode

Debug output can be enabled by passing desired level via environment variable using one of the following ways:

PERL_KAFKA_DEBUG=1 - debug is enabled for the whole Kafka package.

PERL_KAFKA_DEBUG=IO:1 - enable debug for Kafka::IO only.

Kafka::IO supports two debug levels (level 2 includes debug output of 1):

  1. Additional information about processing events/alarms.

  2. Dump of binary messages exchange with Kafka server.

SEE ALSO

The basic operation of the Kafka package modules:

Kafka - constants and messages used by the Kafka package modules.

Kafka::Connection - interface to connect to a Kafka cluster.

Kafka::Producer - interface for producing client.

Kafka::Consumer - interface for consuming client.

Kafka::Message - interface to access Kafka message properties.

Kafka::Int64 - functions to work with 64 bit elements of the protocol on 32 bit systems.

Kafka::Protocol - functions to process messages in the Apache Kafka's Protocol.

Kafka::IO - low-level interface for communication with Kafka server.

Kafka::Exceptions - module designated to handle Kafka exceptions.

Kafka::Internals - internal constants and functions used by several package modules.

A wealth of detail about the Apache Kafka and the Kafka Protocol:

Main page at http://kafka.apache.org/

Kafka Protocol at https://cwiki.apache.org/confluence/display/KAFKA/A+Guide+To+The+Kafka+Protocol

SOURCE CODE

Kafka package is hosted on GitHub: https://github.com/TrackingSoft/Kafka

AUTHOR

Sergey Gladkov, <sgladkov@trackingsoft.com>

CONTRIBUTORS

Alexander Solovey

Jeremy Jordan

Sergiy Zuban

Vlad Marchenko

COPYRIGHT AND LICENSE

Copyright (C) 2012-2016 by TrackingSoft LLC.

This package is free software; you can redistribute it and/or modify it under the same terms as Perl itself. See perlartistic at http://dev.perl.org/licenses/artistic.html.

This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.