Kafka vs Kafka Manager vs apache nifi

Kafka vs Kafka Manager: What are the differences?

Developers describe Kafka as "Distributed, fault tolerant, high throughput pub-sub messaging system". Kafka is a distributed, partitioned, replicated commit log service. It provides the functionality of a messaging system, but with a unique design. On the other hand, Kafka Manager is detailed as "A tool for managing Apache Kafka, developed by Yahoo". This interface makes it easier to identify topics which are unevenly distributed across the cluster or have partition leaders unevenly distributed across the cluster. It supports management of multiple clusters, preferred replica election, replica re-assignment, and topic creation. It is also great for getting a quick bird’s eye view of the cluster.

Kafka and Kafka Manager belong to "Message Queue" category of the tech stack.

Some of the features offered by Kafka are:

• Written at LinkedIn in Scala
• Used by LinkedIn to offload processing of all page and other views
• Defaults to using persistence, uses OS disk cache for hot data (has higher throughput then any of the above having persistence enabled)

On the other hand, Kafka Manager provides the following key features:

• Manage multiple clusters
• Easy inspection of cluster state (topics, brokers, replica distribution, partition distribution)
• Run preferred replica election

Kafka and Kafka Manager are both open source tools. Kafka with 13.1K GitHub stars and 6.99K forks on GitHub appears to be more popular than Kafka Manager with 7.72K GitHub stars and 1.88K GitHub forks.

Uber Technologies, Spotify, and Slack are some of the popular companies that use Kafka, whereas Kafka Manager is used by Yahoo!, IgnitionOne, and Ocado Technology. Kafka has a broader approval, being mentioned in 691 company stacks & 2398 developers stacks; compared to Kafka Manager, which is listed in 10 company stacks and 27 developer stacks.