Why developers like Kubeflow

What is Kubeflow?

The Kubeflow project is dedicated to making Machine Learning on Kubernetes easy, portable and scalable by providing a straightforward way for spinning up best of breed OSS solutions.

Kubeflow is a tool in the Machine Learning Tools category of a tech stack.

Kubeflow is an open source tool with GitHub stars and GitHub forks. Here’s a link to Kubeflow's open source repository on GitHub

Who uses Kubeflow?

Companies

36 companies reportedly use Kubeflow in their tech stacks, including Hepsiburada, BlaBlaCar, and Beat.

Hepsiburada

BlaBlaCar

Beat

bigin

Labs

Data-Driven Services

QualityMinds GmbH

KeepTruckin

OneFit

Developers

161 developers on StackShare have stated that they use Kubeflow.

Wishlist

devstack

My Stack

ml

My Stack

Data science

Kubeflow Integrations

Kubernetes, TensorFlow, Jupyter, Google AI Platform, and Pipelines are some of the popular tools that integrate with Kubeflow. Here's a list of all 9 tools that integrate with Kubeflow.

Kubernetes

TensorFlow

Jupyter

Google AI Platform

Pipelines

Kedro

lakeFS

Couler

Tecton

Pros of Kubeflow

System designer

Google backed

Customisation

Kfp dsl

Azure

Decisions about Kubeflow

Here are some stack decisions, common use cases and reviews by companies and developers who chose Kubeflow in their tech stack.

Murali Nagaraj

Jan 11, 2024 | 5 upvotes · 51.8K views

Needs advice

Kubeflow

Kubernetes

and

MLflow

We are trying to standardise DevOps across both ML (model selection and deployment) and regular software. Want to minimise the number of tools we have to learn. Also want a scalable solution which is easy enough to start small - eg. on a powerful laptop and eventually be deployed at scale. MLflow vs Kubernetes (Kubeflow)?

Biswajit Pathak

Project Manager at Sony · Sep 13, 2021 | 6 upvotes · 850.4K views

Needs advice

FastText

and

Gensim

Can you please advise which one to choose FastText Or Gensim, in terms of:

Operability with ML Ops tools such as MLflow, Kubeflow, etc.
Performance
Customization of Intermediate steps
FastText and Gensim both have the same underlying libraries
Use cases each one tries to solve
Unsupervised Vs Supervised dimensions
Ease of Use.

Please mention any other points that I may have missed here.

Ruju Alurkar

Dec 5, 2020 | 2 upvotes · 559K views

Needs advice

Amazon SageMaker

and

Kubeflow

Amazon SageMaker constricts the use of their own mxnet package and does not offer a strong Kubernetes backbone. At the same time, Kubeflow is still quite buggy and cumbersome to use. Which tool is a better pick for MLOps pipelines (both from the perspective of scalability and depth)?

See all decisions

Blog Posts

AI/ML Pipelines Using Open Data Hub and Kubeflow on Red Hat Op...

Jan 29 2020 at 2:08PM

Red Hat, Inc.

+14

2644

Kubeflow Alternatives & Comparisons

What are some alternatives to Kubeflow?

TensorFlow

TensorFlow is an open source software library for numerical computation using data flow graphs. Nodes in the graph represent mathematical operations, while the graph edges represent the multidimensional data arrays (tensors) communicated between them. The flexible architecture allows you to deploy computation to one or more CPUs or GPUs in a desktop, server, or mobile device with a single API.

Apache Spark

Spark is a fast and general processing engine compatible with Hadoop data. It can run in Hadoop clusters through YARN or Spark's standalone mode, and it can process data in HDFS, HBase, Cassandra, Hive, and any Hadoop InputFormat. It is designed to perform both batch processing (similar to MapReduce) and new workloads like streaming, interactive queries, and machine learning.

MLflow

MLflow is an open source platform for managing the end-to-end machine learning lifecycle.

Airflow

Use Airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The Airflow scheduler executes your tasks on an array of workers while following the specified dependencies. Rich command lines utilities makes performing complex surgeries on DAGs a snap. The rich user interface makes it easy to visualize pipelines running in production, monitor progress and troubleshoot issues when needed.

Polyaxon

An enterprise-grade open source platform for building, training, and monitoring large scale deep learning applications.

See all alternatives

Related Comparisons