OSM: Kafka

This is a top-quality Ansible role to set up a Kafka and Zookeeper cluster.

Requirements

The only requirement for this role is Java.

You can find our Java role here.

Role Variables

We have divided the variables into two categories: Mandatory and Optional.

Mandatory Variables

Optional Variables

Inventory

Your inventory should look like this:

[zookeeper]                  # Zookeeper host and ID information
zookeeper1    zookeeper_id=1
zookeeper2    zookeeper_id=2
zookeeper3    zookeeper_id=3

[kafka]                      # Kafka host and broker ID information
kafka1   kafka_broker_id=1
kafka2   kafka_broker_id=2
kafka3   kafka_broker_id=3

[kafka_cluster:children]     # Parent group for Kafka and Zookeeper
zookeeper
kafka

[kafka_cluster:vars]         # Variables for kafka_cluster parent group
ansible_user=ubuntu

Example Playbook

Here’s a simple example of a playbook:

---
- hosts: kafka_cluster
  roles:
    - role: osm_kafka_cluster
      become: yes

Usage

To use this role, just run the playbook:

ansible-playbook -i hosts site.yml

Running Test Cases for Setup

To run test cases, we have a separate folder named inspec. You need to install Inspec (https://www.inspec.io/) to run the test cases.

Run the following command:

inspec exec . -t ssh://username@server_ip -i /path/to/keyfile

Author

Abhishek Dubey