I want to choose Message Queue with the following features - Highly Available, Distributed, Scalable, Monitoring. I have RabbbitMQ, ActiveMQ, Kafka and RocketMQ in mind. But I am confused which one to choose.

3 upvotes306 views
Replies (16)
Avatar of dikderoy
Senior Back-End Developer, Software Architect at Chemondis GmbH

I use Kafka because it has almost infinite scaleability in terms of processing events (could be scaled to process hundreds of thousands of events), great monitoring (all sorts of metrics are exposed via JMX).

Downsides of using Kafka are: - you have to deal with Zookeeper - you have to implement advanced routing yourself (compared to RabbitMQ it has no advanced routing)

3 upvotes10.5K views

The question for which Message Queue to use mentioned "availability, distributed, scalability, and monitoring". I don't think that this excludes many options already. I does not sound like you would take advantage of Kafka's strengths (replayability, based on an even sourcing architecture). You could pick one of the AMQP options.

I would recommend the RabbitMQ message broker, which not only implements the AMQP standard 0.9.1 (it can support 1.x or other protocols as well) but has also several very useful extensions built in. It ticks the boxes you mentioned and on top you will get a very flexible system, that allows you to build the architecture, pick the options and trade-offs that suite your case best.

For more information about RabbitMQ, please have a look at the linked markdown I assembled. The second half explains many configuration options. It also contains links to managed hosting and to libraries (though it is missing Python's - which should be Puka, I assume).

rabbitmq_presentation/README.markdown at master 路 mediafinger/rabbitmq_presentation 路 GitHub (github.com)
4 upvotes131K views
View all (16)
Avatar of Roman Bulgakov

Roman Bulgakov

Senior Back-End Developer, Software Architect at Chemondis GmbH