Apache Spark

A Story by
Fast and general engine for large-scale data processing

What is Apache Spark?

Spark is a fast and general processing engine compatible with Hadoop data. It can run in Hadoop clusters through YARN or Spark's standalone mode, and it can process data in HDFS, HBase, Cassandra, Hive, and any Hadoop InputFormat. It is designed to perform both batch processing (similar to MapReduce) and new workloads like streaming, interactive queries, and machine learning.
Apache Spark is a tool in the Big Data Tools category of a tech stack.

Who is using it?

502 companies use Apache Spark in their tech stacks, including Uber, Shopify, and Slack.

Uber

Shopify

Slack

Delivery Hero

CRED

Hepsiburada

technology

Walmart

Hubspot

ViaVarejo

Fiverr

Yelp

Why developers like Apache Spark

Open-source
Fast and Flexible
One platform for every big data problem
Great for distributed SQL like applications
Easy to install and to use
Works well for most Datascience usecases
Interactive Query
In memory Computation
Machine learning libratimery, Streaming in real