Disque
Disque

8
17
0
Kafka
Kafka

3.2K
2.5K
459
Add tool

Disque vs Kafka: What are the differences?

What is Disque? In-memory, distributed job queue. Disque is an ongoing experiment to build a distributed, in-memory, message broker. Its goal is to capture the essence of the "Redis as a jobs queue" use case, which is usually implemented using blocking list operations, and move it into an ad-hoc, self-contained, scalable, and fault tolerant design, with simple to understand properties and guarantees, but still resembling Redis in terms of simplicity, performance, and implementation as a C non-blocking networked server.

What is Kafka? Distributed, fault tolerant, high throughput pub-sub messaging system. Kafka is a distributed, partitioned, replicated commit log service. It provides the functionality of a messaging system, but with a unique design.

Disque and Kafka belong to "Message Queue" category of the tech stack.

Disque and Kafka are both open source tools. It seems that Kafka with 12.5K GitHub stars and 6.7K forks on GitHub has more adoption than Disque with 7.35K GitHub stars and 516 GitHub forks.

What is Disque?

Disque is an ongoing experiment to build a distributed, in-memory, message broker. Its goal is to capture the essence of the "Redis as a jobs queue" use case, which is usually implemented using blocking list operations, and move it into an ad-hoc, self-contained, scalable, and fault tolerant design, with simple to understand properties and guarantees, but still resembling Redis in terms of simplicity, performance, and implementation as a C non-blocking networked server.

What is Kafka?

Kafka is a distributed, partitioned, replicated commit log service. It provides the functionality of a messaging system, but with a unique design.

Want advice about which of these to choose?Ask the StackShare community!

Why do developers choose Disque?
Why do developers choose Kafka?
    Be the first to leave a pro

    Sign up to add, upvote and see more prosMake informed product decisions

    What are the cons of using Disque?
    What are the cons of using Kafka?
      Be the first to leave a con
      What companies use Disque?
      What companies use Kafka?

      Sign up to get full access to all the companiesMake informed product decisions

      What tools integrate with Disque?
      What tools integrate with Kafka?
        No integrations found

        Sign up to get full access to all the tool integrationsMake informed product decisions

        What are some alternatives to Disque and Kafka?
        RabbitMQ
        RabbitMQ gives your applications a common platform to send and receive messages, and your messages a safe place to live until received.
        Amazon SQS
        Transmit any volume of data, at any level of throughput, without losing messages or requiring other services to be always available. With SQS, you can offload the administrative burden of operating and scaling a highly available messaging cluster, while paying a low price for only what you use.
        Celery
        Celery is an asynchronous task queue/job queue based on distributed message passing. It is focused on real-time operation, but supports scheduling as well.
        ActiveMQ
        Apache ActiveMQ is fast, supports many Cross Language Clients and Protocols, comes with easy to use Enterprise Integration Patterns and many advanced features while fully supporting JMS 1.1 and J2EE 1.4. Apache ActiveMQ is released under the Apache 2.0 License.
        ZeroMQ
        The 0MQ lightweight messaging kernel is a library which extends the standard socket interfaces with features traditionally provided by specialised messaging middleware products. 0MQ sockets provide an abstraction of asynchronous message queues, multiple messaging patterns, message filtering (subscriptions), seamless access to multiple transport protocols and more.
        See all alternatives
        Decisions about Disque and Kafka
        No stack decisions found
        Interest over time
        Reviews of Disque and Kafka
        No reviews found
        How developers use Disque and Kafka
        Avatar of Pinterest
        Pinterest uses KafkaKafka

        http://media.tumblr.com/d319bd2624d20c8a81f77127d3c878d0/tumblr_inline_nanyv6GCKl1s1gqll.png

        Front-end messages are logged to Kafka by our API and application servers. We have batch processing (on the middle-left) and real-time processing (on the middle-right) pipelines to process the experiment data. For batch processing, after daily raw log get to s3, we start our nightly experiment workflow to figure out experiment users groups and experiment metrics. We use our in-house workflow management system Pinball to manage the dependencies of all these MapReduce jobs.

        Avatar of Coolfront Technologies
        Coolfront Technologies uses KafkaKafka

        Building out real-time streaming server to present data insights to Coolfront Mobile customers and internal sales and marketing teams.

        Avatar of ShareThis
        ShareThis uses KafkaKafka

        We are using Kafka as a message queue to process our widget logs.

        Avatar of Christopher Davison
        Christopher Davison uses KafkaKafka

        Used for communications and triggering jobs across ETL systems

        Avatar of theskyinflames
        theskyinflames uses KafkaKafka

        Used as a integration middleware by messaging interchanging.

        How much does Disque cost?
        How much does Kafka cost?
        Pricing unavailable
        Pricing unavailable
        News about Disque
        More news