Consul vs. Zookeeper vs. Eureka

All our services use Consul for discovery, configuration and cluster management (auto scaling, health monitoring, dynamic reconfiguration, leader elections)

How else do you discover microservices? ;)

I used Consul as config center & service discoverer.

Discovery service. Some configuration is stored in consul.

For service discovery.

Like many large scale web sites, Pinterest’s infrastructure consists of servers that communicate with backend services composed of a number of individual servers for managing load and fault tolerance. Ideally, we’d like the configuration to reflect only the active hosts, so clients don’t need to deal with bad hosts as often. ZooKeeper provides a well known pattern to solve this problem.

Initially, Stitch only supported real-time updates and addressed this problem with a MapReduce job named The Restorator that performed the following actions:

• Calculated the expected totals
• Queried Cassandra to get the values it had for each counter
• Calculated the increments needed to apply to fix the counters
• Applied the increments

Meanwhile, to stop the sand shifting under its feet, The Restorator needed to coordinate a locking system between itself and the real-time processors, so that the processors did not try to simultaneously apply increments to the same counter, resulting in a race-condition. It used ZooKeeper for this.

Zookeeper manages our state, and tells each node what version of code it should be running.

Coordination and High availability

Used Zookeeper as the resource management system for Mesos/Marathon services.

Maintain a distributed cluster for search index

Use it with Kafka

共享配置、高可用

Distributed service discovery