From the course: Apache Kafka Essential Training: Getting Started
Join today to access over 25,500 courses taught by industry experts.
Kafka brokers - Kafka Tutorial
From the course: Apache Kafka Essential Training: Getting Started
Kafka brokers
- [Instructor] A Kafka broker is the central brain behind everything that Kafka does. Let's discuss more about brokers in this video. A broker is nothing but a running Kafka instance. It is a physical process that runs on the base operating system and executes all Kafka functions. A Kafka process listens on a specific port. Usually this is 9092, but it is configurable. The Kafka broker receives messages from producers and stores them locally in logs. Consumers subscribe to specific topics within the Kafka broker. The broker keeps track of all the active consumers. It knows about the last message that was sent to the consumer, so it only sends new messages in the subscribed topics to that consumer. It also keeps a heartbeat with every consumer so when a consumer dies, it can track and reset. Kafka brokers manage the lifecycle of topics. They track and manage topic partitions. They also manage the corresponding partition…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.