CloudKarafka vs Kafka vs Apache RocketMQ

Get Advice Icon

Need advice about which tool to choose?Ask the StackShare community!

CloudKarafka
CloudKarafka

2
7
+ 1
0
Kafka
Kafka

4.9K
4.4K
+ 1
488
Apache RocketMQ
Apache RocketMQ

14
32
+ 1
4
- No public GitHub repository available -

What is CloudKarafka?

CloudKarafka automates every part of setup, running and scaling of Apache Kafka. CloudKarafka offers hosted publish-subscribe messaging systems in the cloud. With the ease of CloudKarafka you have a fully managed Kafka cluster up and running within two minutes, including a managed internal Zookeeper cluster on all nodes.

What is Kafka?

Kafka is a distributed, partitioned, replicated commit log service. It provides the functionality of a messaging system, but with a unique design.

What is Apache RocketMQ?

Apache RocketMQ is a distributed messaging and streaming platform with low latency, high performance and reliability, trillion-level capacity and flexible scalability.
Get Advice Icon

Need advice about which tool to choose?Ask the StackShare community!

Why do developers choose CloudKarafka?
Why do developers choose Kafka?
Why do developers choose Apache RocketMQ?
    Be the first to leave a pro

    Sign up to add, upvote and see more prosMake informed product decisions

      Be the first to leave a con
        Be the first to leave a con
        What companies use CloudKarafka?
        What companies use Kafka?
        What companies use Apache RocketMQ?
          No companies found

          Sign up to get full access to all the companiesMake informed product decisions

          What tools integrate with CloudKarafka?
          What tools integrate with Kafka?
          What tools integrate with Apache RocketMQ?

          Sign up to get full access to all the tool integrationsMake informed product decisions

          What are some alternatives to CloudKarafka, Kafka, and Apache RocketMQ?
          Apache Kafka on Heroku
          Apache Kafka is a distributed commit log for fast, fault-tolerant communication between producers and consumers using message based topics. Kafka provides the messaging backbone for building a new generation of distributed applications capable of handling billions of events and millions of transactions.
          Amazon Managed Streaming for Kafka
          With Amazon MSK, you can use Apache Kafka APIs to populate data lakes, stream changes to and from databases, and power machine learning and analytics applications. Amazon Managed Streaming for Kafka makes it easy for you to build and run production applications on Apache Kafka without needing Apache Kafka infrastructure management expertise.
          See all alternatives
          Decisions about CloudKarafka, Kafka, and Apache RocketMQ
          Roman Bulgakov
          Roman Bulgakov
          Senior Back-End Developer, Software Architect at Chemondis GmbH · | 3 upvotes · 10.5K views
          Kafka
          Kafka

          I use Kafka because it has almost infinite scaleability in terms of processing events (could be scaled to process hundreds of thousands of events), great monitoring (all sorts of metrics are exposed via JMX).

          Downsides of using Kafka are: - you have to deal with Zookeeper - you have to implement advanced routing yourself (compared to RabbitMQ it has no advanced routing)

          See more
          Kafka
          Kafka
          RabbitMQ
          RabbitMQ

          The question for which Message Queue to use mentioned "availability, distributed, scalability, and monitoring". I don't think that this excludes many options already. I does not sound like you would take advantage of Kafka's strengths (replayability, based on an even sourcing architecture). You could pick one of the AMQP options.

          I would recommend the RabbitMQ message broker, which not only implements the AMQP standard 0.9.1 (it can support 1.x or other protocols as well) but has also several very useful extensions built in. It ticks the boxes you mentioned and on top you will get a very flexible system, that allows you to build the architecture, pick the options and trade-offs that suite your case best.

          For more information about RabbitMQ, please have a look at the linked markdown I assembled. The second half explains many configuration options. It also contains links to managed hosting and to libraries (though it is missing Python's - which should be Puka, I assume).

          See more
          Frédéric MARAND
          Frédéric MARAND
          Core Developer at OSInet · | 2 upvotes · 121.6K views
          atOSInetOSInet
          Beanstalkd
          Beanstalkd
          RabbitMQ
          RabbitMQ
          Kafka
          Kafka

          I used Kafka originally because it was mandated as part of the top-level IT requirements at a Fortune 500 client. What I found was that it was orders of magnitude more complex ...and powerful than my daily Beanstalkd , and far more flexible, resilient, and manageable than RabbitMQ.

          So for any case where utmost flexibility and resilience are part of the deal, I would use Kafka again. But due to the complexities involved, for any time where this level of scalability is not required, I would probably just use Beanstalkd for its simplicity.

          I tend to find RabbitMQ to be in an uncomfortable middle place between these two extremities.

          See more
          Interest over time
          Reviews of CloudKarafka, Kafka, and Apache RocketMQ
          No reviews found
          How developers use CloudKarafka, Kafka, and Apache RocketMQ
          Avatar of Pinterest
          Pinterest uses KafkaKafka

          http://media.tumblr.com/d319bd2624d20c8a81f77127d3c878d0/tumblr_inline_nanyv6GCKl1s1gqll.png

          Front-end messages are logged to Kafka by our API and application servers. We have batch processing (on the middle-left) and real-time processing (on the middle-right) pipelines to process the experiment data. For batch processing, after daily raw log get to s3, we start our nightly experiment workflow to figure out experiment users groups and experiment metrics. We use our in-house workflow management system Pinball to manage the dependencies of all these MapReduce jobs.

          Avatar of Coolfront Technologies
          Coolfront Technologies uses KafkaKafka

          Building out real-time streaming server to present data insights to Coolfront Mobile customers and internal sales and marketing teams.

          Avatar of ShareThis
          ShareThis uses KafkaKafka

          We are using Kafka as a message queue to process our widget logs.

          Avatar of Christopher Davison
          Christopher Davison uses KafkaKafka

          Used for communications and triggering jobs across ETL systems

          Avatar of theskyinflames
          theskyinflames uses KafkaKafka

          Used as a integration middleware by messaging interchanging.

          How much does CloudKarafka cost?
          How much does Kafka cost?
          How much does Apache RocketMQ cost?
          Pricing unavailable
          Pricing unavailable
          Pricing unavailable
          News about CloudKarafka
          More news
          News about Apache RocketMQ
          More news