What is Delta Lake?
Who uses Delta Lake?
Delta Lake Integrations
Here are some stack decisions, common use cases and reviews by companies and developers who chose Delta Lake in their tech stack.
We are building cloud based analytical app and most of the data for UI is supplied from SQL server to Delta lake and then from Delta Lake to Azure Cosmos DB as JSON using Databricks. So that API can send it to front-end. Sometimes we get larger documents while transforming table rows into JSONs and it exceeds 2mb limit of cosmos size. What is the best solution for replacing Cosmos DB?
Delta Lake's Features
- ACID Transactions
- Scalable Metadata Handling
- Time Travel (data versioning)
- Open Format
- Unified Batch and Streaming Source and Sink
- Schema Enforcement
- Schema Evolution
- 100% Compatible with Apache Spark API