Zookeeper logo

Zookeeper

Because coordinating distributed systems is a Zoo
501
541
+ 1
39

What is Zookeeper?

A centralized service for maintaining configuration information, naming, providing distributed synchronization, and providing group services. All of these kinds of services are used in some form or another by distributed applications.
Zookeeper is a tool in the Open Source Service Discovery category of a tech stack.

Who uses Zookeeper?

Companies
173 companies reportedly use Zookeeper in their tech stacks, including Uber, Pinterest, and Shopify.

Developers
310 developers on StackShare have stated that they use Zookeeper.

Zookeeper Integrations

Datadog, Druid, StackStorm, Kubeless, and SignalFx are some of the popular tools that integrate with Zookeeper. Here's a list of all 11 tools that integrate with Zookeeper.
Private Decisions at about Zookeeper

Here are some stack decisions, common use cases and reviews by members of with Zookeeper in their tech stack.

Christopher Davison
Christopher Davison
DevOps Engineer at Soulmates.ai · | 1 upvotes · 0 views
Shared insights
on
ZookeeperZookeeper

Used for service discovery of ETL systems Zookeeper

See more
Mehdi TAZI
Mehdi TAZI
Java/BigData Architect - Scrum Master · | 1 upvotes · 0 views
Shared insights
on
ZookeeperZookeeper

Coordination and High availability Zookeeper

See more
Shared insights
on
ZookeeperZookeeper

Used Zookeeper as the resource management system for Mesos/Marathon services. Zookeeper

See more
Nurul Ferdous
Nurul Ferdous
CTO at Ferabb Labs · | 1 upvotes · 0 views
Shared insights
on
ZookeeperZookeeper

Maintain a distributed cluster for search index Zookeeper

See more
Nough You
Nough You
Senior Research Engineer at Prattle · | 1 upvotes · 2 views
Shared insights
on
ZookeeperZookeeper

Use it with Kafka Zookeeper

See more
Shared insights
on
ZookeeperZookeeper

共享配置、高可用 Zookeeper

See more
Public Decisions about Zookeeper

Here are some stack decisions, common use cases and reviews by companies and developers who chose Zookeeper in their tech stack.

Shared insights
on
ZookeeperZookeeperHAProxyHAProxy
at

Early 2013

In early 2013, Airbnb tackled the problem of service discovery and load balancing in the context of a service oriented architecture (SOA) by building and releasing an open source tool called SmartStack. SmartStack is built on two other open source tools created by Airbnb called Nerve and Synapse.

Nerve is a service registration daemon that performs health checks that “creates ephemeral nodes in Zookeeper which contain information about the address/port combos for a backend available to serve requests for a particular service.”

Synapse is a transparent service discovery framework for connecting an SOA that reads the information in Zookeeper for available backends, and then uses that information to configure a local HAProxy process, which then routes requests between clients and services.

See more
Shared insights
on
ZookeeperZookeeper
at

Initially, Stitch only supported real-time updates and addressed this problem with a MapReduce job named The Restorator that performed the following actions:

  • Calculated the expected totals
  • Queried Cassandra to get the values it had for each counter
  • Calculated the increments needed to apply to fix the counters
  • Applied the increments

Meanwhile, to stop the sand shifting under its feet, The Restorator needed to coordinate a locking system between itself and the real-time processors, so that the processors did not try to simultaneously apply increments to the same counter, resulting in a race-condition. It used ZooKeeper for this. Zookeeper

See more
Shared insights
on
ZookeeperZookeeper

Used Zookeeper as the resource management system for Mesos/Marathon services. Zookeeper

See more

Zookeeper Alternatives & Comparisons

What are some alternatives to Zookeeper?
Consul
Consul is a tool for service discovery and configuration. Consul is distributed, highly available, and extremely scalable.
etcd
etcd is a distributed key value store that provides a reliable way to store data across a cluster of machines. It’s open-source and available on GitHub. etcd gracefully handles master elections during network partitions and will tolerate machine failure, including the master.
Yarn
Yarn caches every package it downloads so it never needs to again. It also parallelizes operations to maximize resource utilization so install times are faster than ever.
Eureka
Eureka is a REST (Representational State Transfer) based service that is primarily used in the AWS cloud for locating services for the purpose of load balancing and failover of middle-tier servers.
Ambari
This project is aimed at making Hadoop management simpler by developing software for provisioning, managing, and monitoring Apache Hadoop clusters. It provides an intuitive, easy-to-use Hadoop management web UI backed by its RESTful APIs.
See all alternatives

Zookeeper's Followers
541 developers follow Zookeeper to keep up with related blogs and decisions.
MIGUEL DE LA HOZ
Kanav Goel
John Anderson
Filip Ilavský
Nagamani R
Craig Lynch
Dav Fa
KDV Prasad
Sunil Chaudhari
kathirvelcse4