What is Heap?
Who uses Heap?
Why developers like Heap?
Here are some stack decisions, common use cases and reviews by companies and developers who chose Heap in their tech stack.
At Heap, we searched for an existing tool that would allow us to express the full range of analyses we needed, index the event definitions that made up the analyses, and was a mature, natively distributed system.
After coming up empty on this search, we decided to compromise on the “maturity” requirement and build our own distributed system around Citus and sharded PostgreSQL. It was at this point that we also introduced Kafka as a queueing layer between the Node.js application servers and Postgres.
If we could go back in time, we probably would have started using Kafka on day one. One of the biggest benefits in adopting Kafka has been the peace of mind that it brings. In an analytics infrastructure, it’s often possible to make data ingestion idempotent.
In Heap’s case, that means that, if anything downstream from Kafka goes down, we won’t lose any data – it’s just going to take a bit longer to get to its destination. We also learned that you want the path between data hitting your servers and your initial persistence layer (in this case, Kafka) to be as short and simple as possible, since that is the surface area where a failure means you can lose customer data. We learned that it’s a very good fit for an analytics tool, since you can handle a huge number of incoming writes with relatively low latency. Kafka also gives you the ability to “replay” the data flow: it’s like a commit log for your whole infrastructure.
#MessageQueue #Databases #FrameworksFullStack
- Define analytics events using a simple, point 'n' click interface. People with zero coding knowledge can start tracking events and generating important metrics instantly
- Automatically capture every user action in your iOS or web app and measure it all. Clicks, taps, swipes, form submissions, page views, and more
- All analysis is automatically retroactive, so there's no need to wait days for data to accumulate. You can rely on each report to include everything from day one.
- Define meaningful user segments in seconds, without writing code. Or pick a single user and display every single action they performed in your app.
- Define active users and plot their growth, or list users who hit the sign up page but never registered.