icon
Published on

Disaster recovery for multi-region Kafka at Uber | Uber Blog

Authors

Content

https://eng.uber.com/kafka/

  • https://eng.uber.com/kafka/
  • Disaster recovery for multi-region Kafka at Uber | Uber Blog
  • Uber has one of the largest deployments of Apache Kafka in the world, processing trillions of messages and multiple petabytes of data per day. As Figure 1 shows, today we position Apache Kafka as a cornerstone to Uber’s technology stack and build a complex ecosystem on top of it to empower a large number of different workflows. These include a pub/sub message bus to pass event data from the rider and driver apps, enabling a streaming analytics platform (e.g. Apache Samza, Apache Flink), streaming database changelogs to the downstream subscribers, and ingesting all sorts of data into Uber’s Apache Hadoop data lake.