DeepSpeed vs Xcessiv
Overview
Share your Stack
Help developers discover the tools you use. Get visibility for your team's tech choices and contribute to the community's knowledge.
CLI (Node.js)
Manual
Detailed Comparison
A web-based application for quick, scalable, and automated hyperparameter tuning and stacked ensembling in Python. | It is a deep learning optimization library that makes distributed training easy, efficient, and effective. It can train DL models with over a hundred billion parameters on the current generation of GPU clusters while achieving over 5x in system performance compared to the state-of-art. Early adopters of DeepSpeed have already produced a language model (LM) with over 17B parameters called Turing-NLG, establishing a new SOTA in the LM category. |
Fully define your data source, cross-validation process, relevant metrics, and base learners with Python code;Any model following the Scikit-learn API can be used as a base learner;Task queue based architecture lets you take full advantage of multiple cores and embarrassingly parallel hyperparameter searches;Direct integration with TPOT for automated pipeline construction;Automated hyperparameter search through Bayesian optimization;Easy management and comparison of hundreds of different model-hyperparameter combinations;Automatic saving of generated secondary meta-features;Stacked ensemble creation in a few clicks;Automated ensemble construction through greedy forward model selection;Export your stacked ensemble as a standalone Python file to support multiple levels of stacking | Distributed Training with Mixed Precision; Model Parallelism; Memory and Bandwidth Optimizations; Simplified training API;
Gradient Clipping;
Automatic loss scaling with mixed precision; Simplified Data Loader; Performance Analysis and Debugging |
Statistics | |
GitHub Stars 1.3K | GitHub Stars - |
GitHub Forks 105 | GitHub Forks - |
Stacks 0 | Stacks 11 |
Followers 7 | Followers 16 |
Votes 0 | Votes 0 |
Integrations | |
What are some alternatives to Xcessiv, DeepSpeed?
TensorFlow
TensorFlow is an open source software library for numerical computation using data flow graphs. Nodes in the graph represent mathematical operations, while the graph edges represent the multidimensional data arrays (tensors) communicated between them. The flexible architecture allows you to deploy computation to one or more CPUs or GPUs in a desktop, server, or mobile device with a single API.
scikit-learn
scikit-learn is a Python module for machine learning built on top of SciPy and distributed under the 3-Clause BSD license.
PyTorch
PyTorch is not a Python binding into a monolothic C++ framework. It is built to be deeply integrated into Python. You can use it naturally like you would use numpy / scipy / scikit-learn etc.
Keras
Deep Learning library for Python. Convnets, recurrent neural networks, and more. Runs on TensorFlow or Theano. https://keras.io/
Kubeflow
The Kubeflow project is dedicated to making Machine Learning on Kubernetes easy, portable and scalable by providing a straightforward way for spinning up best of breed OSS solutions.
TensorFlow.js
Use flexible and intuitive APIs to build and train models from scratch using the low-level JavaScript linear algebra library or the high-level layers API
Polyaxon
An enterprise-grade open source platform for building, training, and monitoring large scale deep learning applications.
Streamlit
It is the app framework specifically for Machine Learning and Data Science teams. You can rapidly build the tools you need. Build apps in a dozen lines of Python with a simple API.
MLflow
MLflow is an open source platform for managing the end-to-end machine learning lifecycle.
H2O
H2O.ai is the maker behind H2O, the leading open source machine learning platform for smarter applications and data products. H2O operationalizes data science by developing and deploying algorithms and models for R, Python and the Sparkling Water API for Spark.
