Hadoop Cluster Role

This role installs and configures Hadoop (version 2.X) on a group of computers (nodes).

Role Variables

Here are the variables you can use with this role, along with short descriptions:

• hadoop_type_of_node: Type of the node (can be slave, master, resource manager, node manager, data node, or name node). Default is "slave".
• hadoop_home: Directory where Hadoop will be installed (default is /opt/hadoop-2.X).
• hadoop_mirrors: List of server links to download Hadoop code.
• hadoop_version: The version of Hadoop to install (default is "latest").
• hdfs_props: Properties to set in the core-site.xml file (empty by default).
• yarn_props: Properties to set in the yarn-site.xml file (also empty by default).
• hadoop_slave_nodes: List of slave nodes (default is all hosts in the group).

Example Playbook

Here’s an example of how to set up the Cluster:

On the "Worker Nodes":

  roles:  
    - { role: 'grycap.hadoop', hadoop_master: 'MASTER_NODE_NAME_OR_IP' }  

On the "Manager Node":

  roles:  
    - { role: 'grycap.hadoop', hadoop_master: 'MASTER_NODE_NAME_OR_IP', hadoop_type_of_node: 'master'}  

Contributing to the Role

To keep the code organized, direct changes to the master branch are not allowed. If you want to help, create a new branch, make your changes, and then submit a pull request.
Thank you!