TensorFlow vs .NET for Apache Spark

Overview

TensorFlow

Stacks3.9K

Followers3.5K

Votes106

GitHub Stars192.3K

Forks74.9K

.NET for Apache Spark

Stacks31

Followers46

Votes0

GitHub Stars2.1K

Forks329

.NET for Apache Spark vs TensorFlow: What are the differences?

.NET for Apache Spark: Makes Apache Spark™ Easily Accessible to .NET Developers. With these .NET APIs, you can access the most popular Dataframe and SparkSQL aspects of Apache Spark, for working with structured data, and Spark Structured Streaming, for working with streaming data; TensorFlow: Open Source Software Library for Machine Intelligence. TensorFlow is an open source software library for numerical computation using data flow graphs. Nodes in the graph represent mathematical operations, while the graph edges represent the multidimensional data arrays (tensors) communicated between them. The flexible architecture allows you to deploy computation to one or more CPUs or GPUs in a desktop, server, or mobile device with a single API.

.NET for Apache Spark and TensorFlow can be primarily classified as "Machine Learning" tools.

.NET for Apache Spark is an open source tool with 1.11K GitHub stars and 108 GitHub forks. Here's a link to .NET for Apache Spark's open source repository on GitHub.

🔥 Trending in Development & Training Tools on StackShare

Tinker AI Development Training Tools

Tinker

Try it View Docs Alternatives

Try

0

1

Advice on TensorFlow, .NET for Apache Spark

Adithya

Student at PES UNIVERSITY

May 11, 2020

Needs advice

I have just started learning some basic machine learning concepts. So which of the following frameworks is better to use: Keras / TensorFlow/PyTorch. I have prior knowledge in python(and even pandas), java, js and C. It would be nice if something could point out the advantages of one over the other especially in terms of resources, documentation and flexibility. Also, could someone tell me where to find the right resources or tutorials for the above frameworks? Thanks in advance, hope you are doing well!!

107k views107k

Comments

Detailed Comparison

TensorFlow	.NET for Apache Spark
TensorFlow is an open source software library for numerical computation using data flow graphs. Nodes in the graph represent mathematical operations, while the graph edges represent the multidimensional data arrays (tensors) communicated between them. The flexible architecture allows you to deploy computation to one or more CPUs or GPUs in a desktop, server, or mobile device with a single API.	With these .NET APIs, you can access the most popular Dataframe and SparkSQL aspects of Apache Spark, for working with structured data, and Spark Structured Streaming, for working with streaming data.
Statistics
GitHub Stars 192.3K	GitHub Stars 2.1K
GitHub Forks 74.9K	GitHub Forks 329
Stacks 3.9K	Stacks 31
Followers 3.5K	Followers 46
Votes 106	Votes 0
Pros & Cons
Pros 32 High Performance 19 Connect Research and Production 16 Deep Flexibility 12 Auto-Differentiation 11 True Portability Cons 9 Hard 6 Hard to debug 2 Documentation not very helpful	No community feedback yet
Integrations
JavaScript	Apache Spark .NET F# C# Ubuntu

What are some alternatives to TensorFlow, .NET for Apache Spark?

scikit-learn

scikit-learn is a Python module for machine learning built on top of SciPy and distributed under the 3-Clause BSD license.

PyTorch

PyTorch is not a Python binding into a monolothic C++ framework. It is built to be deeply integrated into Python. You can use it naturally like you would use numpy / scipy / scikit-learn etc.

Keras

Deep Learning library for Python. Convnets, recurrent neural networks, and more. Runs on TensorFlow or Theano. https://keras.io/

Kubeflow

The Kubeflow project is dedicated to making Machine Learning on Kubernetes easy, portable and scalable by providing a straightforward way for spinning up best of breed OSS solutions.

TensorFlow.js

Use flexible and intuitive APIs to build and train models from scratch using the low-level JavaScript linear algebra library or the high-level layers API

Polyaxon

An enterprise-grade open source platform for building, training, and monitoring large scale deep learning applications.

Streamlit

It is the app framework specifically for Machine Learning and Data Science teams. You can rapidly build the tools you need. Build apps in a dozen lines of Python with a simple API.

MLflow

MLflow is an open source platform for managing the end-to-end machine learning lifecycle.

H2O

H2O.ai is the maker behind H2O, the leading open source machine learning platform for smarter applications and data products. H2O operationalizes data science by developing and deploying algorithms and models for R, Python and the Sparkling Water API for Spark.

PredictionIO

PredictionIO is an open source machine learning server for software developers to create predictive features, such as personalization, recommendation and content discovery.