Kafka Manager vs RabbitMQ

Overview

RabbitMQ

Stacks21.8K

Followers18.9K

Votes558

GitHub Stars13.2K

Forks4.0K

Kafka Manager

Stacks70

Followers173

Votes1

Kafka Manager vs RabbitMQ: What are the differences?

What is Kafka Manager? A tool for managing Apache Kafka, developed by Yahoo. This interface makes it easier to identify topics which are unevenly distributed across the cluster or have partition leaders unevenly distributed across the cluster. It supports management of multiple clusters, preferred replica election, replica re-assignment, and topic creation. It is also great for getting a quick bird’s eye view of the cluster.

What is RabbitMQ? A messaging broker - an intermediary for messaging. RabbitMQ gives your applications a common platform to send and receive messages, and your messages a safe place to live until received.

Kafka Manager and RabbitMQ can be categorized as "Message Queue" tools.

Some of the features offered by Kafka Manager are:

Manage multiple clusters
Easy inspection of cluster state (topics, brokers, replica distribution, partition distribution)
Run preferred replica election

On the other hand, RabbitMQ provides the following key features:

Robust messaging for applications
Easy to use
Runs on all major operating systems

Kafka Manager and RabbitMQ are both open source tools. Kafka Manager with 7.55K GitHub stars and 1.84K forks on GitHub appears to be more popular than RabbitMQ with 5.94K GitHub stars and 1.78K GitHub forks.

reddit, 9GAG, and Rainist are some of the popular companies that use RabbitMQ, whereas Kafka Manager is used by Yahoo!, IgnitionOne, and Ocado Technology. RabbitMQ has a broader approval, being mentioned in 940 company stacks & 548 developers stacks; compared to Kafka Manager, which is listed in 8 company stacks and 5 developer stacks.

Share your Stack

Help developers discover the tools you use. Get visibility for your team's tech choices and contribute to the community's knowledge.

View Docs

CLI (Node.js)

Manual

Advice on RabbitMQ, Kafka Manager

viradiya

Apr 12, 2020

Needs adviceon

AngularJS

ASP.NET Core

MSSQL

We are going to develop a microservices-based application. It consists of AngularJS, ASP.NET Core, and MSSQL.

We have 3 types of microservices. Emailservice, Filemanagementservice, Filevalidationservice

I am a beginner in microservices. But I have read about RabbitMQ, but come to know that there are Redis and Kafka also in the market. So, I want to know which is best.

933k views933k

Comments

Pulkit

Software Engineer

Oct 30, 2020

Needs adviceon

Django

Amazon SQS

RabbitMQ

Hi! I am creating a scraping system in Django, which involves long running tasks between 1 minute & 1 Day. As I am new to Message Brokers and Task Queues, I need advice on which architecture to use for my system. ( Amazon SQS, RabbitMQ, or Celery). The system should be autoscalable using Kubernetes(K8) based on the number of pending tasks in the queue.

474k views474k

Comments

Kirill

GO/C developer at Duckling Sales

Feb 16, 2021

Decided

Maybe not an obvious comparison with Kafka, since Kafka is pretty different from rabbitmq. But for small service, Rabbit as a pubsub platform is super easy to use and pretty powerful. Kafka as an alternative was the original choice, but its really a kind of overkill for a small-medium service. Especially if you are not planning to use k8s, since pure docker deployment can be a pain because of networking setup. Google PubSub was another alternative, its actually pretty cheap, but I never tested it since Rabbit was matching really good for mailing/notification services.

266k views266k

Comments

Detailed Comparison

RabbitMQ	Kafka Manager
RabbitMQ gives your applications a common platform to send and receive messages, and your messages a safe place to live until received.	This interface makes it easier to identify topics which are unevenly distributed across the cluster or have partition leaders unevenly distributed across the cluster. It supports management of multiple clusters, preferred replica election, replica re-assignment, and topic creation. It is also great for getting a quick bird’s eye view of the cluster.
Robust messaging for applications;Easy to use;Runs on all major operating systems;Supports a huge number of developer platforms;Open source and commercially supported	Manage multiple clusters;Easy inspection of cluster state (topics, brokers, replica distribution, partition distribution);Run preferred replica election;Generate partition assignments (based on current state of cluster);Run reassignment of partition (based on generated assignments)
Statistics
GitHub Stars 13.2K	GitHub Stars -
GitHub Forks 4.0K	GitHub Forks -
Stacks 21.8K	Stacks 70
Followers 18.9K	Followers 173
Votes 558	Votes 1
Pros & Cons
Pros 235 It's fast and it works with good metrics/monitoring 80 Ease of configuration 60 I like the admin interface 52 Easy to set-up and start with 22 Durable Cons 9 Too complicated cluster/HA config and management 6 Needs Erlang runtime. Need ops good with Erlang runtime 5 Configuration must be done first, not by your code 4 Slow	Pros 1 Better Insights for Kafka cluster
Integrations
No integrations available	Kafka

What are some alternatives to RabbitMQ, Kafka Manager?

Kafka

Kafka is a distributed, partitioned, replicated commit log service. It provides the functionality of a messaging system, but with a unique design.

Celery

Celery is an asynchronous task queue/job queue based on distributed message passing. It is focused on real-time operation, but supports scheduling as well.

Amazon SQS

Transmit any volume of data, at any level of throughput, without losing messages or requiring other services to be always available. With SQS, you can offload the administrative burden of operating and scaling a highly available messaging cluster, while paying a low price for only what you use.

NSQ

NSQ is a realtime distributed messaging platform designed to operate at scale, handling billions of messages per day. It promotes distributed and decentralized topologies without single points of failure, enabling fault tolerance and high availability coupled with a reliable message delivery guarantee. See features & guarantees.

ActiveMQ

Apache ActiveMQ is fast, supports many Cross Language Clients and Protocols, comes with easy to use Enterprise Integration Patterns and many advanced features while fully supporting JMS 1.1 and J2EE 1.4. Apache ActiveMQ is released under the Apache 2.0 License.

ZeroMQ

The 0MQ lightweight messaging kernel is a library which extends the standard socket interfaces with features traditionally provided by specialised messaging middleware products. 0MQ sockets provide an abstraction of asynchronous message queues, multiple messaging patterns, message filtering (subscriptions), seamless access to multiple transport protocols and more.

Apache NiFi

An easy to use, powerful, and reliable system to process and distribute data. It supports powerful and scalable directed graphs of data routing, transformation, and system mediation logic.

Gearman

Gearman allows you to do work in parallel, to load balance processing, and to call functions between languages. It can be used in a variety of applications, from high-availability web sites to the transport of database replication events.

Memphis

Highly scalable and effortless data streaming platform. Made to enable developers and data teams to collaborate and build real-time and streaming apps fast.

IronMQ

An easy-to-use highly available message queuing service. Built for distributed cloud applications with critical messaging needs. Provides on-demand message queuing with advanced features and cloud-optimized performance.

Related Comparisons

Some of the features offered by Kafka Manager are:

Manage multiple clusters
Easy inspection of cluster state (topics, brokers, replica distribution, partition distribution)
Run preferred replica election

On the other hand, RabbitMQ provides the following key features:

Robust messaging for applications
Easy to use
Runs on all major operating systems

Kafka Manager vs RabbitMQ