ActiveMQ vs Kafka vs RabbitMQ

ActiveMQ
ActiveMQ

161
130
39
Kafka
Kafka

3.1K
4.6K
455
RabbitMQ
RabbitMQ

4.1K
1.9K
445

RabbitMQ vs Kafka vs ActiveMQ: What are the differences?

RabbitMQ, Kafka, and ActiveMQ are all messaging technologies used to provide asynchronous communication and decouple processes (detaching the sender and receiver of a message). They are called message queues, message brokers, or messaging tools. RabbitMQ, Kafka, and ActiveMQ all serve the same basic purpose, but can go about their jobs differently. Kafka is a high-throughput distributed messaging system. RabbitMQ is an AMQP based reliable message broker. ActiveMQ and Kafka are both Apache products, and both written in Java; RabbitMQ is written in Erlang.

What is ActiveMQ?

Apache ActiveMQ is fast, supports many Cross Language Clients and Protocols, comes with easy to use Enterprise Integration Patterns and many advanced features while fully supporting JMS 1.1 and J2EE 1.4. Apache ActiveMQ is released under the Apache 2.0 License.

What is Kafka?

Kafka is a distributed, partitioned, replicated commit log service. It provides the functionality of a messaging system, but with a unique design.

What is RabbitMQ?

RabbitMQ gives your applications a common platform to send and receive messages, and your messages a safe place to live until received.

Want advice about which of these to choose?Ask the StackShare community!

Why do developers choose ActiveMQ?
Why do developers choose Kafka?
Why do developers choose RabbitMQ?
What are the cons of using ActiveMQ?
What are the cons of using Kafka?
What are the cons of using RabbitMQ?
    Be the first to leave a con

    Why do developers choose RabbitMQ vs Kafka vs ActiveMQ?

    • Users of RabbitMQ say it’s fast, easy to configure, and intuitive.
    • Fans of Kafka cite its scalability, high performance, and high-throughput abilities.
    • ActiveMQ users call it efficient and easy to use, and celebrate its open source roots.
    What companies use ActiveMQ?
    What companies use Kafka?
    What companies use RabbitMQ?
    What are some alternatives to ActiveMQ, Kafka, and RabbitMQ?
    Apollo
    Build a universal GraphQL API on top of your existing REST APIs, so you can ship new application features fast without waiting on backend changes.
    Amazon SQS
    Transmit any volume of data, at any level of throughput, without losing messages or requiring other services to be always available. With SQS, you can offload the administrative burden of operating and scaling a highly available messaging cluster, while paying a low price for only what you use.
    Celery
    Celery is an asynchronous task queue/job queue based on distributed message passing. It is focused on real-time operation, but supports scheduling as well.
    ZeroMQ
    The 0MQ lightweight messaging kernel is a library which extends the standard socket interfaces with features traditionally provided by specialised messaging middleware products. 0MQ sockets provide an abstraction of asynchronous message queues, multiple messaging patterns, message filtering (subscriptions), seamless access to multiple transport protocols and more.
    NSQ
    NSQ is a realtime distributed messaging platform designed to operate at scale, handling billions of messages per day. It promotes distributed and decentralized topologies without single points of failure, enabling fault tolerance and high availability coupled with a reliable message delivery guarantee. See features & guarantees.
    See all alternatives
    What tools integrate with ActiveMQ?
    What tools integrate with Kafka?
    What tools integrate with RabbitMQ?
      No integrations found
        No integrations found
          No integrations found
          Decisions about ActiveMQ, Kafka, and RabbitMQ
          Adam Rabinovitch
          Adam Rabinovitch
          Global Technical Recruiting Lead & Engineering Evangelist at Beamery · | 3 upvotes · 151.5K views
          atBeameryBeamery
          Kafka
          Redis
          Elasticsearch
          MongoDB
          RabbitMQ
          Go
          Node.js
          Kubernetes
          #Microservices

          Beamery runs a #microservices architecture in the backend on top of Google Cloud with Kubernetes There are a 100+ different microservice split between Node.js and Go . Data flows between the microservices over REST and gRPC and passes through Kafka RabbitMQ as a message bus. Beamery stores data in MongoDB with near-realtime replication to Elasticsearch . In addition, Beamery uses Redis for various memory-optimized tasks.

          See more
          RabbitMQ
          Kafka

          The question for which Message Queue to use mentioned "availability, distributed, scalability, and monitoring". I don't think that this excludes many options already. I does not sound like you would take advantage of Kafka's strengths (replayability, based on an even sourcing architecture). You could pick one of the AMQP options.

          I would recommend the RabbitMQ message broker, which not only implements the AMQP standard 0.9.1 (it can support 1.x or other protocols as well) but has also several very useful extensions built in. It ticks the boxes you mentioned and on top you will get a very flexible system, that allows you to build the architecture, pick the options and trade-offs that suite your case best.

          For more information about RabbitMQ, please have a look at the linked markdown I assembled. The second half explains many configuration options. It also contains links to managed hosting and to libraries (though it is missing Python's - which should be Puka, I assume).

          See more
          Frédéric MARAND
          Frédéric MARAND
          Core Developer at OSInet · | 2 upvotes · 84.4K views
          atOSInetOSInet
          RabbitMQ
          Beanstalkd
          Kafka

          I used Kafka originally because it was mandated as part of the top-level IT requirements at a Fortune 500 client. What I found was that it was orders of magnitude more complex ...and powerful than my daily Beanstalkd , and far more flexible, resilient, and manageable than RabbitMQ.

          So for any case where utmost flexibility and resilience are part of the deal, I would use Kafka again. But due to the complexities involved, for any time where this level of scalability is not required, I would probably just use Beanstalkd for its simplicity.

          I tend to find RabbitMQ to be in an uncomfortable middle place between these two extremities.

          See more
          Interest over time
          Reviews of ActiveMQ, Kafka, and RabbitMQ
          Review ofRabbitMQRabbitMQ

          I developed one of the largest queue based medical results delivery systems in the world, 18,000+ queues and still growing over a decade later all using MQSeries, later called Websphere MQ. When I left that company I started using RabbitMQ after doing some research on free offerings.. it works brilliantly and is incredibly flexible from small scale single instance use to large scale multi-server - multi-site architectures.

          If you can think in queues then RabbitMQ should be a viable solution for integrating disparate systems.

          How developers use ActiveMQ, Kafka, and RabbitMQ
          Avatar of Pinterest
          Pinterest uses KafkaKafka

          http://media.tumblr.com/d319bd2624d20c8a81f77127d3c878d0/tumblr_inline_nanyv6GCKl1s1gqll.png

          Front-end messages are logged to Kafka by our API and application servers. We have batch processing (on the middle-left) and real-time processing (on the middle-right) pipelines to process the experiment data. For batch processing, after daily raw log get to s3, we start our nightly experiment workflow to figure out experiment users groups and experiment metrics. We use our in-house workflow management system Pinball to manage the dependencies of all these MapReduce jobs.

          Avatar of Cloudify
          Cloudify uses RabbitMQRabbitMQ

          The poster child for scalable messaging systems, RabbitMQ has been used in countless large scale systems as the messaging backbone of any large cluster, and has proven itself time and again in many production settings.

          Avatar of Chris Saylor
          Chris Saylor uses RabbitMQRabbitMQ

          Rabbit acts as our coordinator for all actions that happen during game time. All worker containers connect to rabbit in order to receive game events and emit their own events when applicable.

          Avatar of Clarabridge Engage
          Clarabridge Engage uses RabbitMQRabbitMQ

          Used as central Message Broker; off-loading tasks to be executed asynchronous, used as communication tool between different microservices, used as tool to handle peaks in incoming data, etc.

          Avatar of Analytical Informatics
          Analytical Informatics uses RabbitMQRabbitMQ

          RabbitMQ is the enterprise message bus for our platform, providing infrastructure for managing our ETL queues, real-time event notifications for applications, and audit logging.

          Avatar of Packet
          Packet uses RabbitMQRabbitMQ

          RabbitMQ is an all purpose queuing service for our stack. We use it for user facing jobs as well as keeping track of behind the scenes jobs.

          Avatar of Coolfront Technologies
          Coolfront Technologies uses KafkaKafka

          Building out real-time streaming server to present data insights to Coolfront Mobile customers and internal sales and marketing teams.

          Avatar of Casey Smith
          Casey Smith uses ActiveMQActiveMQ

          Remote broker and local client for incoming data feeds. Local broker for republishing data feeds to other systems.

          Avatar of ShareThis
          ShareThis uses KafkaKafka

          We are using Kafka as a message queue to process our widget logs.

          Avatar of Christopher Davison
          Christopher Davison uses KafkaKafka

          Used for communications and triggering jobs across ETL systems

          Avatar of theskyinflames
          theskyinflames uses KafkaKafka

          Used as a integration middleware by messaging interchanging.

          How much does ActiveMQ cost?
          How much does Kafka cost?
          How much does RabbitMQ cost?
          Pricing unavailable
          Pricing unavailable
          Pricing unavailable
          News about ActiveMQ
          More news
          News about RabbitMQ
          More news