Amazon EMR logo

Amazon EMR

Distribute your data and processing across a Amazon EC2 instances using Hadoop

What is Amazon EMR?

It is used in a variety of applications, including log analysis, data warehousing, machine learning, financial analysis, scientific simulation, and bioinformatics.
Amazon EMR is a tool in the Big Data as a Service category of a tech stack.

Who uses Amazon EMR?

Companies
161 companies reportedly use Amazon EMR in their tech stacks, including Netflix, Amazon, and Tokopedia.

Developers
362 developers on StackShare have stated that they use Amazon EMR.

Amazon EMR Integrations

AWS Glue, SignalFx, Eucalyptus, AWS Outposts, and Amazon Managed Workflows for Apache Airflow are some of the popular tools that integrate with Amazon EMR. Here's a list of all 5 tools that integrate with Amazon EMR.
Pros of Amazon EMR
15
On demand processing power
12
Don't need to maintain Hadoop Cluster yourself
7
Hadoop Tools
6
Elastic
4
Backed by Amazon
3
Flexible
3
Economic - pay as you go, easy to use CLI and SDKs
2
Don't need a dedicated Ops group
1
Massive data handling
1
Great support
Decisions about Amazon EMR

Here are some stack decisions, common use cases and reviews by companies and developers who chose Amazon EMR in their tech stack.

I have to build a data processing application with an Apache Beam stack and Apache Flink runner on an Amazon EMR cluster. I saw some instability with the process and EMR clusters that keep going down. Here, the Apache Beam application gets inputs from Kafka and sends the accumulative data streams to another Kafka topic. Any advice on how to make the process more stable?

See more

Blog Posts

Aug 28 2019 at 3:10AM

Segment

PythonJavaAmazon S3+16
7
2628
GitHubMySQLSlack+44
109
50772

Amazon EMR's Features

  • Elastic- Amazon EMR enables you to quickly and easily provision as much capacity as you need and add or remove capacity at any time. Deploy multiple clusters or resize a running cluster
  • Low Cost- Amazon EMR is designed to reduce the cost of processing large amounts of data. Some of the features that make it low cost include low hourly pricing, Amazon EC2 Spot integration, Amazon EC2 Reserved Instance integration, elasticity, and Amazon S3 integration.
  • Flexible Data Stores- With Amazon EMR, you can leverage multiple data stores, including Amazon S3, the Hadoop Distributed File System (HDFS), and Amazon DynamoDB.
  • Hadoop Tools- EMR supports powerful and proven Hadoop tools such as Hive, Pig, and HBase.

Amazon EMR Alternatives & Comparisons

What are some alternatives to Amazon EMR?
Amazon EC2
It is a web service that provides resizable compute capacity in the cloud. It is designed to make web-scale computing easier for developers.
Hadoop
The Apache Hadoop software library is a framework that allows for the distributed processing of large data sets across clusters of computers using simple programming models. It is designed to scale up from single servers to thousands of machines, each offering local computation and storage.
Amazon DynamoDB
With it , you can offload the administrative burden of operating and scaling a highly available distributed database cluster, while paying a low price for only what you use.
Amazon Redshift
It is optimized for data sets ranging from a few hundred gigabytes to a petabyte or more and costs less than $1,000 per terabyte per year, a tenth the cost of most traditional data warehousing solutions.
Azure HDInsight
It is a cloud-based service from Microsoft for big data analytics that helps organizations process large amounts of streaming or historical data.
See all alternatives

Amazon EMR's Followers
682 developers follow Amazon EMR to keep up with related blogs and decisions.