lakeFSWhat is lakeFS?
It is an open-source data version control system for data lakes. It provides a “Git for data” platform enabling you to implement best practices from software engineering on your data lake, including branching and merging, CI/CD, and production-like dev/test environments.
lakeFS is a tool in the Databases category of a tech stack.
Key Features
Zero copy version managementAny data formats: structured, unstructured, open table, etcScales to Petabytes and millions of objects with negligible performance impactSeamless integration with all your data stack
lakeFS Pros & Cons
Pros of lakeFS
- ✓Available On prem
- ✓Big Data Scale
- ✓Cloud agnostic
- ✓Cloud agnostics
- ✓Doesn't require local copies of the data
- ✓Easy integration with other tools
- ✓Easy to use
- ✓Format agnostic
- ✓Full reproducibility
- ✓Highly Scalable
Cons of lakeFS
No cons listed yet.
lakeFS Alternatives & Comparisons
What are some alternatives to lakeFS?
Apache Spark
Spark is a fast and general processing engine compatible with Hadoop data. It can run in Hadoop clusters through YARN or Spark's standalone mode, and it can process data in HDFS, HBase, Cassandra, Hive, and any Hadoop InputFormat. It is designed to perform both batch processing (similar to MapReduce) and new workloads like streaming, interactive queries, and machine learning.
Splunk
It provides the leading platform for Operational Intelligence. Customers use it to search, monitor, analyze and visualize machine data.
Apache Flink
Apache Flink is an open source system for fast and versatile data analytics in clusters. Flink supports batch and streaming analytics, in one system. Analytical programs can be written in concise and elegant APIs in Java and Scala.
