Kafka vs NSQ vs RabbitMQ

Need advice about which tool to choose?Ask the StackShare community!

Kafka

12.6K
11.7K
+ 1
541
NSQ

115
238
+ 1
143
RabbitMQ

12.2K
10.3K
+ 1
505
Decisions about Kafka, NSQ, and RabbitMQ
Kirill Mikhailov

Maybe not an obvious comparison with Kafka, since Kafka is pretty different from rabbitmq. But for small service, Rabbit as a pubsub platform is super easy to use and pretty powerful. Kafka as an alternative was the original choice, but its really a kind of overkill for a small-medium service. Especially if you are not planning to use k8s, since pure docker deployment can be a pain because of networking setup. Google PubSub was another alternative, its actually pretty cheap, but I never tested it since Rabbit was matching really good for mailing/notification services.

See more
Mickael Alliel
DevOps Engineer at Rookout · | 3 upvotes · 126.1K views

In addition to being a lot cheaper, Google Cloud Pub/Sub allowed us to not worry about maintaining any more infrastructure that needed.

We moved from a self-hosted RabbitMQ over to CloudAMQP and decided that since we use GCP anyway, why not try their managed PubSub?

It is one of the better decisions that we made, and we can just focus about building more important stuff!

See more
Pros of Kafka
Pros of NSQ
Pros of RabbitMQ
  • 116
    High-throughput
  • 110
    Distributed
  • 83
    Scalable
  • 77
    High-Performance
  • 62
    Durable
  • 34
    Publish-Subscribe
  • 17
    Simple-to-use
  • 13
    Open source
  • 9
    Written in Scala and java. Runs on JVM
  • 6
    Message broker + Streaming system
  • 4
    Avro schema integration
  • 2
    Suport Multiple clients
  • 2
    KSQL
  • 2
    Partioned, replayable log
  • 1
    Robust
  • 1
    Extremely good parallelism constructs
  • 1
    Simple publisher / multi-subscriber model
  • 1
    Fun
  • 29
    It's in golang
  • 20
    Lightweight
  • 19
    Distributed
  • 18
    Easy setup
  • 16
    High throughput
  • 10
    Publish-Subscribe
  • 7
    Save data if no subscribers are found
  • 7
    Scalable
  • 6
    Open source
  • 5
    Temporarily kept on disk
  • 2
    Simple-to use
  • 1
    Free
  • 1
    Topics and channels concept
  • 1
    Load balanced
  • 1
    Primarily in-memory
  • 224
    It's fast and it works with good metrics/monitoring
  • 77
    Ease of configuration
  • 56
    I like the admin interface
  • 49
    Easy to set-up and start with
  • 20
    Durable
  • 18
    Standard protocols
  • 18
    Intuitive work through python
  • 10
    Written primarily in Erlang
  • 7
    Simply superb
  • 6
    Completeness of messaging patterns
  • 3
    Scales to 1 million messages per second
  • 3
    Reliable
  • 2
    Better than most traditional queue based message broker
  • 2
    Distributed
  • 2
    Supports AMQP
  • 1
    Great ui
  • 1
    Better routing system
  • 1
    Inubit Integration
  • 1
    Reliability
  • 1
    High performance
  • 1
    Runs on Open Telecom Platform
  • 1
    Clusterable
  • 1
    Clear documentation with different scripting language

Sign up to add or upvote prosMake informed product decisions

Cons of Kafka
Cons of NSQ
Cons of RabbitMQ
  • 25
    Needs Zookeeper
  • 24
    Non-Java clients are second-class citizens
  • 6
    Operational difficulties
  • 1
    Terrible Packaging
  • 1
    Long term persistence
  • 1
    HA
  • 1
    Get NSQ behavior out of Kafka but not inverse
  • 8
    Too complicated cluster/HA config and management
  • 6
    Needs Erlang runtime. Need ops good with Erlang runtime
  • 5
    Configuration must be done first, not by your code
  • 4
    Slow

Sign up to add or upvote consMake informed product decisions

What is Kafka?

Kafka is a distributed, partitioned, replicated commit log service. It provides the functionality of a messaging system, but with a unique design.

What is NSQ?

NSQ is a realtime distributed messaging platform designed to operate at scale, handling billions of messages per day. It promotes distributed and decentralized topologies without single points of failure, enabling fault tolerance and high availability coupled with a reliable message delivery guarantee. See features & guarantees.

What is RabbitMQ?

RabbitMQ gives your applications a common platform to send and receive messages, and your messages a safe place to live until received.

Need advice about which tool to choose?Ask the StackShare community!

What companies use Kafka?
What companies use NSQ?
What companies use RabbitMQ?

Sign up to get full access to all the companiesMake informed product decisions

What tools integrate with Kafka?
What tools integrate with NSQ?
What tools integrate with RabbitMQ?
    No integrations found

    Sign up to get full access to all the tool integrationsMake informed product decisions

    Blog Posts

    Jun 24 2020 at 4:42PM
    https://img.stackshare.io/stack/673323/default_9dbdf311e98bc0550cc0b928a4f7144ba95c89fc.png logo

    Pinterest

    Amazon S3KafkaHBase+4
    4
    937
    MySQLKafkaApache Spark+6
    2
    1336
    Jan 7 2020 at 5:09PM
    https://img.stackshare.io/stack/527058/default_0abbbd50e9a4e209c9b9b328d003c8cdbce2e9b3.png logo

    Ably Realtime

    KafkaAbly+2
    7
    1675
    Jun 6 2019 at 5:11PM
    https://img.stackshare.io/stack/372376/default_573a26a621134fbcbde85e58b2c8544189ae0fba.jpg logo

    AppSignal

    RedisRubyKafka+9
    15
    1040
    What are some alternatives to Kafka, NSQ, and RabbitMQ?
    ActiveMQ
    Apache ActiveMQ is fast, supports many Cross Language Clients and Protocols, comes with easy to use Enterprise Integration Patterns and many advanced features while fully supporting JMS 1.1 and J2EE 1.4. Apache ActiveMQ is released under the Apache 2.0 License.
    Amazon Kinesis
    Amazon Kinesis can collect and process hundreds of gigabytes of data per second from hundreds of thousands of sources, allowing you to easily write applications that process information in real-time, from sources such as web site click-streams, marketing and financial information, manufacturing instrumentation and social media, and operational logs and metering data.
    Apache Spark
    Spark is a fast and general processing engine compatible with Hadoop data. It can run in Hadoop clusters through YARN or Spark's standalone mode, and it can process data in HDFS, HBase, Cassandra, Hive, and any Hadoop InputFormat. It is designed to perform both batch processing (similar to MapReduce) and new workloads like streaming, interactive queries, and machine learning.
    Akka
    Akka is a toolkit and runtime for building highly concurrent, distributed, and resilient message-driven applications on the JVM.
    Apache Storm
    Apache Storm is a free and open source distributed realtime computation system. Storm makes it easy to reliably process unbounded streams of data, doing for realtime processing what Hadoop did for batch processing. Storm has many use cases: realtime analytics, online machine learning, continuous computation, distributed RPC, ETL, and more. Storm is fast: a benchmark clocked it at over a million tuples processed per second per node. It is scalable, fault-tolerant, guarantees your data will be processed, and is easy to set up and operate.
    See all alternatives
    Interest over time
    News about NSQ
    More news
    News about RabbitMQ
    More news