As we've evolved or added additional infrastructure to our stack, we've biased towards managed services. Most new backing stores are Amazon RDS instances now. We do use self-managed PostgreSQL with TimescaleDB for time-series data—this is made HA with the use of Patroni and Consul.
We also use managed Amazon ElastiCache instances instead of spinning up Amazon EC2 instances to run Redis workloads, as well as shifting to Amazon Kinesis instead of Kafka.
17 upvotes·1 comment·3.7M views
Thanks John!
Did you consider Confluent Cloud in your decision to switch from Kafka (I assume you were managing your own Kafka deployment) to Kinesis?