DistributedLog vs Kafka Manager: What are the differences?
What is DistributedLog? High-performance replicated log service, by Twitter. DistributedLog (DL) is a high-performance, replicated log service, offering durability, replication and strong consistency as essentials for building reliable distributed systems.
What is Kafka Manager? A tool for managing Apache Kafka, developed by Yahoo. This interface makes it easier to identify topics which are unevenly distributed across the cluster or have partition leaders unevenly distributed across the cluster. It supports management of multiple clusters, preferred replica election, replica re-assignment, and topic creation. It is also great for getting a quick bird’s eye view of the cluster.
DistributedLog and Kafka Manager can be primarily classified as "Message Queue" tools.
Some of the features offered by DistributedLog are:
- High Performance
- Durable and Consistent
- Efficient Fan-in and Fan-out
On the other hand, Kafka Manager provides the following key features:
- Manage multiple clusters
- Easy inspection of cluster state (topics, brokers, replica distribution, partition distribution)
- Run preferred replica election
DistributedLog and Kafka Manager are both open source tools. It seems that Kafka Manager with 7.55K GitHub stars and 1.84K forks on GitHub has more adoption than DistributedLog with 2.25K GitHub stars and 283 GitHub forks.
What is DistributedLog?
What is Kafka Manager?
Need advice about which tool to choose?Ask the StackShare community!
Why do developers choose DistributedLog?
Why do developers choose Kafka Manager?
What are the cons of using DistributedLog?
What are the cons of using Kafka Manager?
Sign up to get full access to all the companiesMake informed product decisions
What tools integrate with DistributedLog?
Why we built Marmaray, an open source generic data ingestion and dispersal framework and library for Apache Hadoop :
Built and designed by our Hadoop Platform team, Marmaray is a plug-in-based framework built on top of the Hadoop ecosystem. Users can add support to ingest data from any source and disperse to any sink leveraging the use of Apache Spark . The name, Marmaray, comes from a tunnel in Turkey connecting Europe and Asia. Similarly, we envisioned Marmaray within Uber as a pipeline connecting data from any source to any sink depending on customer preference:
(Direct GitHub repo: https://github.com/uber/marmaray Kafka Kafka Manager )