Every enterprise application creates data, whether it consists of log messages, metrics, user activity, or outgoing messages. Moving all this data is just as important as the data itself. With this updated edition, application architects, developers, and production engineers new to the Kafka streaming platform will learn how to handle data in motion. Additional chapters cover Kafka's AdminClient API, transactions, new security features, and tooling changes.
Engineers from Confluent and LinkedIn responsible for developing Kafka explain how to deploy production Kafka clusters, write reliable event-driven microservices, and build scalable stream processing applications with this platform. Through detailed examples, you'll learn Kafka's design principles, reliability guarantees, key APIs, and architecture details, including the replication protocol, the controller, and the storage layer.
This open book is licensed under a Open Publication License (OPL). You can download Kafka: The Definitive Guide ebook for free in PDF format (6.8 MB).
Table of Contents
Kafka Producers: Writing Messages to Kafka
Kafka Consumers: Reading Data from Kafka
Managing Apache Kafka Programmatically
Reliable Data Delivery
Building Data Pipelines
Cross-Cluster Data Mirroring