Distributed, fault tolerant, high throughput pub-sub messaging system
Kafka is a distributed, partitioned, replicated commit log service. It provides the functionality of a messaging system, but with a unique design.
Why people like Kafka
Add a one-liner


Companies using Kafka
Kafka integrates with

Kafka's Features
  • Written at LinkedIn in Scala
  • Used by LinkedIn to offload processing of all page and other views
  • Defaults to using persistence, uses OS disk cache for hot data (has higher throughput then any of the above having persistence enabled)
  • Supports both on-line as off-line processing