Apache Kafka 2.9.2-0.8.1.1 installation on ubuntu 14.04
Apache Kafka is an open-source message broker project developed by the Apache Software Foundation written in Scala. The project aims to provide a unified, high-throughput, low-latency platform for handling real-time data feeds. It is, in its essence, a "massively scalable pub/sub message queue architected as a distributed transaction log," making it highly valuable for enterprise infrastructures to process streaming data.
1) A machine with Ubuntu 14.04 LTS operating system installed.
2) Apache Kakfa 2.9.2-0.8.1.1 software (Download Here)
Apache Kafka Installation
The following steps to install Kafka on your machine.
Step 1 - Installing java 7. Open a terminal (CTRL + ALT + T) and type the following sudo command.
Check it installed properly or not.
Step 2 - Edit $HOME/.bashrc file by adding the java path.
Step 3 - Reload your changed $HOME/.bashrc settings
Step 4 - Creating kafka directory. Open a terminal (CTRL + ALT + T) and type the following $ sudo command.
Step 5 - Change the ownership and permissions of the directory /usr/local/kafka. Here 'hduser' is an Ubuntu username.
Step 6 - Change the directory to /home/hduser/Desktop , In my case the downloaded kafka_2.9.2-0.8.1.1.tgz file is in /home/hduser/Desktop folder. For you it might be in /downloads folder check it.
Step 7 - Untar the kafka_2.9.2-0.8.1.1.tgz file.
Step 8 - Move the contents of kafka_2.9.2-0.8.1.1 folder to /usr/local/kafka
Step 9 - Change the directory to /usr/local/kafka/config
Step 10 - Edit server.properties file.
Step 11 - Add this below line to server.properties file. Save and close.
Step 12 - Change the directory to /usr/local/kafka
Step 13 - Start the zookeeper
Step 14 - Open a new terminal (CTRL + ALT + T) and change the directory to /usr/local/kafka
Step 15 - Start the kafka server
Step 16 - Open a new terminal (CTRL + ALT + T) and just type 'jps' (without quotes). It shows all the java processes that are running.
Here Kafka is the kafka server and QuorumPeerMain is zookeeper process.
Step 17 - Stop zookeeper and kafka server. Just press 'CTRL + D' in the terminals of zookeeper and kafka server.
Please share this blog post and follow me for latest updates on
Previous Post Next Post