DVC

What is DVC?

It is an open-source Version Control System for data science and machine learning projects. It is designed to handle large files, data sets, machine learning models, and metrics as well as code.

DVC is a tool in the Version Control category of a tech stack.

Key Features

Git-compatibleStorage agnosticReproducibleLow friction branchingMetric trackingML pipeline frameworkLanguage- & framework-agnosticHDFS, Hive & Apache SparkTrack failures

DVC Pros & Cons

Pros of DVC

✓Full reproducibility

Cons of DVC

✗Coupling between orchestration and version control
✗Doesn't scale for big data
✗Requires working locally with the data

DVC Integrations

Google Cloud Storage, Amazon S3, Google Drive, PyTorch, Git and 7 more are some of the popular tools that integrate with DVC. Here's a list of all 12 tools that integrate with DVC.

Git

Continuous Machine Learning

DAGsHub

DVC Discussions

Discover why developers choose DVC. Read real-world technical decisions and stack choices from the StackShare community.

Hamid Ghader

Jun 17, 2021

Needs adviceon

DVC

MLflow

I already use DVC to keep track and store my datasets in my machine learning pipeline. I have also started to use MLflow to keep track of my experiments. However, I still don't know whether to use DVC for my model files or I use the MLflow artifact store for this purpose. Or maybe these two serve different purposes, and it may be good to do both! Can anyone help, please?

0 views0

Comments

DVC Alternatives & Comparisons

What are some alternatives to DVC?

Git

Git is a free and open source distributed version control system designed to handle everything from small to very large projects with speed and efficiency.

SourceTree

Use the full capability of Git and Mercurial in the SourceTree desktop app. Manage all your repositories, hosted or local, through SourceTree's simple interface.

SVN (Subversion)

Subversion exists to be universally recognized and adopted as an open-source, centralized version control system characterized by its reliability as a safe haven for valuable data; the simplicity of its model and usage; and its ability to support the needs of a wide variety of users and projects, from individuals to large-scale enterprise operations.

What is DVC?

Key Features

DVC Pros & Cons

Pros of DVC

Cons of DVC

DVC Integrations

DVC Discussions

DVC Alternatives & Comparisons

Git

SourceTree

SVN (Subversion)

GitKraken

Try It

Adoption

On StackShare

pre-commit

hub

DVC Integrations

DVC Discussions

Try It

Adoption

On StackShare