Kafka

Strimzi provides a way to run an Apache Kafka cluster on Kubernetes in various deployment configurations.

Strimzi provides a way to run an Apache Kafka cluster on Kubernetes in various deployment configurations.

Uber has one of the largest deployments of Apache Kafka in the world, processing trillions of messages and multiple petabytes of data per day. As Figure 1 shows, today we position Apache Kafka as a cornerstone to Uber’s technology stack and build a complex ecosystem on top of it to empower a large number of different workflows. These include a pub/sub message bus to pass event data from the rider and driver apps, enabling a streaming analytics platform (e.g. Apache Samza, Apache Flink), streaming database changelogs to the downstream subscribers, and ingesting all sorts of data into Uber’s Apache Hadoop data lake.

Learn how to take full advantage of Apache Kafka, understand how Kafka works and how it’s designed with this comprehensive book.

我忘了上下文是什么，我估计应该是这篇（官网上的文档）-《三台破机器扛2百万tps 》：https://engineering.linkedin.com/kafka/benchmarking-apache-kafka-2-million-writes-second-three-cheap-machines

http://notes.stephenholiday.com/Kafka.pdf 一篇关于kafka的论文，大家感兴趣的可以看看

October 8, 2019 Co-authors: Jon Lee and Wesley Wu Apache Kafka is a core part of our infrastructure at LinkedIn. It was originally developed in-house as a stream processing platform and was subsequently...