wtanaka.apache-flink

Build Status CircleCI

wtanaka.apache-flink

Installs Apache Flink

Requires that you have java installed already, e.g. using https://galaxy.ansible.com/wtanaka/oracle-java/

Example Playbook

- hosts: servers
  roles:
     - role: wtanaka.apache-flink
       # Optional flink version number
       flink_version: "1.1.4"
       # Optional other flink config
       flink_other_config:
         akka.ask.timeout: "30s"
         jobmanager.web.history: 100

These control the .tgz file that is downloaded from apache. The filename that is downloaded from apache looks like:

flink-{{flink_version}}-bin{{ '-hadoop' + flink_hadoop_version if flink_hadoop_version else '' }}-scala_{{flink_scala_version}}.tgz

  • Examples of flink_version: "1.1.2", "1.2.0"
  • Examples of flink_hadoop_version: "", "1", "2", "24", "26", "27", "28"
  • Examples of flink_version: "1.1.2", "1.2.0"

Browse http://archive.apache.org/dist/flink/ for possible values

The Apache mirror to use, defaults to http://archive.apache.org/dist/flink/

Set this directory to download and cache tarball onto local machine, for when the network connection between local and host is faster than between host and internet, and if role will be run for several hosts.

Example values:

  • .
  • /tmp

Root logger settings for user code and flink code

Default: "INFO, file"

Property value for log4j.logger.akka

Property value for log4j.logger.org.apache.kafka

Property value for log4j.logger.org.apache.hadoop

Property value for log4j.logger.org.apache.zookeeper

Property value for log4j.appender.file

Property value for log4j.appender.file.file

By default this gets set to the string "${log.file}" which flink startup scripts overwrite

Property value for log4j.appender.file.append

Property value for log4j.appender.file.layout

Property value for log4j.appender.file.layout.ConversionPattern

Property value for log4j.logger.org.jboss.netty.channel.DefaultChannelPipeline

This is set to ERROR, file by default to suppress the irrelevant and wrong warnings from Netty channel handler

This is a dictionary of extra key/value pairs to add into the log4j.properties file.

For example, to only change Flink's logging, you could use:

flink_log4j_extra:
  "log4j.logger.org.apache.flink": "INFO"

All variables

The full set of configuration options available are visible in defaults/main.yml

License

GPLv2

Author Information

http://wtanaka.com/

Install
ansible-galaxy install wtanaka.apache-flink
GitHub repository
License
Unknown
Downloads
4.8k