Sergey Gladkov > Kafka > Kafka::IO



Annotate this POD


Open  0
View/Report Bugs
Module Version: 0.8011   Source  


Kafka::IO - Interface to network communication with the Apache Kafka server.


This documentation refers to Kafka::IO version 0.8011 .


    use 5.010;
    use strict;
    use warnings;

    use Scalar::Util qw(
    use Try::Tiny;

    use Kafka::IO;

    my $io;
    try {
        $io = Kafka::IO->new( host => 'localhost' );
    } catch {
        my $error = $_;
        if ( blessed( $error ) && $error->isa( 'Kafka::Exception' ) ) {
            warn 'Error: (', $error->code, ') ',  $error->message, "\n";
        } else {
            die $error;

    # Closes and cleans up
    undef $io;


This module is private and should not be used directly.

In order to achieve better performance, methods of this module do not perform arguments validation.

The main features of the Kafka::IO class are:



Establishes TCP connection to given host and port, creates and returns Kafka::IO IO object.

new() takes arguments in key-value pairs. The following arguments are currently recognized:

host => $host

$host is an Apache Kafka host to connect to. It can be a hostname or the IP-address in the "xx.xx.xx.xx" form.

port => $port

Optional, default = $KAFKA_SERVER_PORT.

$port is integer attribute denoting the port number of to access Apache Kafka.

$KAFKA_SERVER_PORT is the default Apache Kafka server port that can be imported from the Kafka module.

timeout => $timeout

Optional, default = $REQUEST_TIMEOUT.

$timeout specifies how long we wait for remote server to respond before the IO object disconnects and throws internal exception. The $timeout is specified in seconds (could be any integer or floating-point type) and supported by gethostbyname(), connect, blocking receive and send calls.

$REQUEST_TIMEOUT is the default timeout that can be imported from the Kafka module.

Special behavior when timeout is set to undef:


The following methods are provided by Kafka::IO class:

send( $message )

Sends a $message to Kafka.

The argument must be a bytes string.

Returns the number of characters sent.

receive( $length )

Receives a message up to $length size from Kafka.

$length argument must be a positive number.

Returns a reference to the received message.


Closes connection to Kafka server.


The method verifies whether we are connected to Kafka server.


When error is detected, an exception, represented by object of Kafka::Exception::Producer class, is thrown (see Kafka::Exceptions).

code and a more descriptive message provide information about thrown exception. Consult documentation of the Kafka::Exceptions for the list of all available methods.

Authors suggest using of Try::Tiny's try and catch to handle exceptions while working with Kafka package.

Here is the list of possible error messages that Kafka::IO may produce:

Invalid argument

Invalid arguments were passed to a method.

Can't send

Message can't be sent on a Kafka::IO object socket.

Can't recv

Message can't be received.

Can't bind

TCP connection can't be established on given host and port.

Debug mode

Debug output can be enabled by passing desired level via environment variable using one of the following ways:

PERL_KAFKA_DEBUG=1 - debug is enabled for the whole Kafka package.

PERL_KAFKA_DEBUG=IO:1 - enable debug for Kafka::IO only.

Kafka::IO supports two debug levels (level 2 includes debug output of 1):

  1. Additional information about processing events/alarms.
  2. Dump of binary messages exchange with Kafka server.


The basic operation of the Kafka package modules:

Kafka - constants and messages used by the Kafka package modules.

Kafka::Connection - interface to connect to a Kafka cluster.

Kafka::Producer - interface for producing client.

Kafka::Consumer - interface for consuming client.

Kafka::Message - interface to access Kafka message properties.

Kafka::Int64 - functions to work with 64 bit elements of the protocol on 32 bit systems.

Kafka::Protocol - functions to process messages in the Apache Kafka's Protocol.

Kafka::IO - low-level interface for communication with Kafka server.

Kafka::Exceptions - module designated to handle Kafka exceptions.

Kafka::Internals - internal constants and functions used by several package modules.

A wealth of detail about the Apache Kafka and the Kafka Protocol:

Main page at

Kafka Protocol at


Kafka package is hosted on GitHub:


Sergey Gladkov, <>


Alexander Solovey

Jeremy Jordan

Sergiy Zuban

Vlad Marchenko


Copyright (C) 2012-2013 by TrackingSoft LLC.

This package is free software; you can redistribute it and/or modify it under the same terms as Perl itself. See perlartistic at

This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

syntax highlighting: