confluent_connectors

Ansible Role Confluent Connectors

README Header

Ansible role to install / delete Confluent Connectors from json source files.


Usage

Requirements

Ensure that the validated json payload files ready and copied into the correct environment

Adding new replicator jobs

Add the new json payload files to location ansible-role-confluent-connectors/files/<env_name>/

can be

  • dev
  • prod

Removing existing replicatos jobs

Remove the respective JSON payload file for the job to be deleted from location ansible-role-confluent-connectors/files/<env_name>/

1. Choose an enviroment

Scope the inital enviroment where you want to submit/remove the replicator jobs. For the example below we consider the dev enviroment

2. Run ansible playbook for adding/deleting the connectors.

Create a playbook which uses the ansible-role-confluent-connectors

Examples

  • myenv should be passed an extra variable to ansible-playbook
  • hostlist should be passed an extra variable to ansible-playbook

HOW TO RUN:

CONFLUENT DEV CONNECT: ansible-playbook -i confluent_connect_inventory -kK -e hostlist="dev" -e myenv="dev" confluent_connectors.yml

CONFLUENT PROD CONNECT:

ansible-playbook -i confluent_connect_inventory  -kK -e hostlist="prod" -e myenv="prod" confluent_connectors.yml

where localinventory is a custom inventory with connect nodes.

- hosts: "{{ hostlist }}"
  become: yes
  gather_facts: yes 
  run_once: yes
  vars:
    env_name: "{{ myenv }}"
  roles:
    - sionsmith.confluent_connectors

Run below command which takes care of adding/removing the replicators based on available json payload files in ansible-role-confluent-connectors/files/dev/ location for dev

ansible-playbook -i localinventory -kK -e hostlist="dev" -e myenv="dev" example.yml

This will take care of connecting to one of the available connect node and manages the replicators.

Please note that above steps manages the jobs which have been defined in location ansible-role-confluent-connectors/files/<env_name>/

Where localinventory file will look like below.

[dev]
connect0.dev.local
connect1.dev.local

[prod]
connect0.prod
connect1.prod

Need some help

File a GitHub issue, send us an email or tweet us.

The legals

Copyright © 2017-2021 OSO | See LICENCE for full details.

OSO who we are

Who we are

We at OSO help teams to adopt emerging technologies and solutions to boost their competitiveness, operational excellence and introduce meaningful innovations that drive real business growth. Our developer-first culture, combined with our cross-industry experience and battle-tested delivery methods allow us to implement the most impactful solutions for your business.

Looking for support applying emerging technologies in your business? We’d love to hear from you, get in touch by email

Start adopting new technologies by checking out our other projects, follow us on twitter, join our team of leaders and challengers, or contact us to find the right technology to support your business.Beacon

Install
ansible-galaxy install osodevops/ansible-role-confluent-connectors
GitHub repository
License
apache-2.0
Downloads
53
Owner
Helping you to adopt Apache Kafka at scale