What is Kafka what is its importance in Big-Data

Question

I have currently setup a cluster. I've used Apache Kafka and zookeeper. But still, I still don't get its usage in the cluster. When are both required and for what requirement?

Answer 1

Apache Kafka is a tool used in Streaming Real-time data.

Kafka consists of:

• Producer
• Consumer
• Broker
• Zookeeper

Producer generates the topic.

Consumer subscribes to the topic.

The topics published are stored in Kafka Clusters or Brokers.

Zookeeper is the king in Kafka all the memory resource is managed and maintained by Zookeeper.

The image below depicts the working architecture of Zookeeper.

 You can get a better understanding with the Azure Data Engineering certification.

Hope this helps!

To know more about Kafka, I would recommend you to enroll with Kafka training online today.

Thanks.