Amazon EC2 vs s3-lambda

Overview

Amazon EC2

Stacks48.6K

Followers36.0K

Votes2.5K

s3-lambda

Stacks4

Followers64

Votes0

GitHub Stars1.1K

Forks47

Amazon EC2 vs s3-lambda: What are the differences?

What is Amazon EC2? Scalable, pay-as-you-go compute capacity in the cloud. Amazon Elastic Compute Cloud (Amazon EC2) is a web service that provides resizable compute capacity in the cloud. It is designed to make web-scale computing easier for developers.

What is s3-lambda? Lambda functions over S3 objects: each, map, reduce, filter. s3-lambda enables you to run lambda functions over a context of S3 objects. It has a stateless architecture with concurrency control, allowing you to process a large number of files very quickly. This is useful for quickly prototyping complex data jobs without an infrastructure like Hadoop or Spark.

Amazon EC2 belongs to "Cloud Hosting" category of the tech stack, while s3-lambda can be primarily classified under "Big Data Tools".

s3-lambda is an open source tool with 1.06K GitHub stars and 43 GitHub forks. Here's a link to s3-lambda's open source repository on GitHub.

Share your Stack

Help developers discover the tools you use. Get visibility for your team's tech choices and contribute to the community's knowledge.

View Docs

CLI (Node.js)

Manual

Advice on Amazon EC2, s3-lambda

Craig

Principal Consultant at Rootwork InfoTech LLC

Jul 16, 2020

Decided

We first selected Google Cloud Platform about five years ago, because HIPAA compliance was significantly cheaper and easier on Google compared to AWS. We have stayed with Google Cloud because it provides an excellent command line tool for managing resources, and every resource has a well-designed, well-documented API. SDKs for most of these APIs are available for many popular languages. I have never worked with a cloud platform that's so amenable to automation. Google is also ahead of its competitors in Kubernetes support.

200k views200k

Comments

Jerome/Zen

Software Engineer

Aug 2, 2020

Needs advice

DigitalOcean was where I began; its USD5/month is extremely competitive and the overall experience as highly user-friendly.

However, their offerings were lacking and integrating with other resources I had on AWS was getting more costly (due to transfer costs on AWS). Eventually I moved the entire project off DO's Droplets and onto AWS's EC2.

One may initially find the cost (w/o free tier) and interface of AWS daunting however with good planning you can achieve highly cost-efficient systems with savings plans, spot instances, etcetera.

Do not dive into AWS head-first! Seriously, don't. Stand back and read pricing documentation thoroughly. You can, not to the fault of AWS, easily go way overbudget. Your first action upon getting your AWS account should be to set up billing alarms for estimated and current bill totals.

264k views264k

Comments

Abigail

Dec 10, 2019

Decided

Most bioinformatics shops nowadays are hosting on AWS or Azure, since they have HIPAA tiers and offer enterprise SLA contracts. Meanwhile Heroku hasn't historically supported HIPAA. Rackspace and Google Cloud would be other hosting providers we would consider, but we just don't get requests for them. So, we mostly focus on AWS and Azure support.

156k views156k

Comments

Detailed Comparison

Amazon EC2	s3-lambda
It is a web service that provides resizable compute capacity in the cloud. It is designed to make web-scale computing easier for developers.	s3-lambda enables you to run lambda functions over a context of S3 objects. It has a stateless architecture with concurrency control, allowing you to process a large number of files very quickly. This is useful for quickly prototyping complex data jobs without an infrastructure like Hadoop or Spark.
Elastic – Amazon EC2 enables you to increase or decrease capacity within minutes, not hours or days. You can commission one, hundreds or even thousands of server instances simultaneously.;Completely Controlled – You have complete control of your instances. You have root access to each one, and you can interact with them as you would any machine.;Flexible – You have the choice of multiple instance types, operating systems, and software packages. Amazon EC2 allows you to select a configuration of memory, CPU, instance storage, and the boot partition size that is optimal for your choice of operating system and application.;Designed for use with other Amazon Web Services – Amazon EC2 works in conjunction with Amazon Simple Storage Service (Amazon S3), Amazon Relational Database Service (Amazon RDS), Amazon SimpleDB and Amazon Simple Queue Service (Amazon SQS) to provide a complete solution for computing, query processing and storage across a wide range of applications.;Reliable – Amazon EC2 offers a highly reliable environment where replacement instances can be rapidly and predictably commissioned. The Amazon EC2 Service Level Agreement commitment is 99.95% availability for each Amazon EC2 Region.;Secure – Amazon EC2 works in conjunction with Amazon VPC to provide security and robust networking functionality for your compute resources.;Inexpensive – Amazon EC2 passes on to you the financial benefits of Amazon’s scale. You pay a very low rate for the compute capacity you actually consume.;Easy to Start – Quickly get started with Amazon EC2 by visiting AWS Marketplace to choose preconfigured software on Amazon Machine Images (AMIs). You can quickly deploy this software to EC2 via 1-Click launch or with the EC2 console.	-
Statistics
GitHub Stars -	GitHub Stars 1.1K
GitHub Forks -	GitHub Forks 47
Stacks 48.6K	Stacks 4
Followers 36.0K	Followers 64
Votes 2.5K	Votes 0
Pros & Cons
Pros 647 Quick and reliable cloud servers 515 Scalability 393 Easy management 277 Low cost 271 Auto-scaling Cons 14 Ui could use a lot of work 6 High learning curve when compared to PaaS 3 Extremely poor CPU performance	No community feedback yet
Integrations
No integrations available	Amazon S3 AWS Lambda

What are some alternatives to Amazon EC2, s3-lambda?

DigitalOcean

We take the complexities out of cloud hosting by offering blazing fast, on-demand SSD cloud servers, straightforward pricing, a simple API, and an easy-to-use control panel.

Microsoft Azure

Azure is an open and flexible cloud platform that enables you to quickly build, deploy and manage applications across a global network of Microsoft-managed datacenters. You can build applications using any language, tool or framework. And you can integrate your public cloud applications with your existing IT environment.

Google Compute Engine

Google Compute Engine is a service that provides virtual machines that run on Google infrastructure. Google Compute Engine offers scale, performance, and value that allows you to easily launch large compute clusters on Google's infrastructure. There are no upfront investments and you can run up to thousands of virtual CPUs on a system that has been designed from the ground up to be fast, and to offer strong consistency of performance.

Linode

Get a server running in minutes with your choice of Linux distro, resources, and node location.

Scaleway

European cloud computing company proposing a complete & simple public cloud ecosystem, bare-metal servers & private datacenter infrastructures.

Apache Spark

Spark is a fast and general processing engine compatible with Hadoop data. It can run in Hadoop clusters through YARN or Spark's standalone mode, and it can process data in HDFS, HBase, Cassandra, Hive, and any Hadoop InputFormat. It is designed to perform both batch processing (similar to MapReduce) and new workloads like streaming, interactive queries, and machine learning.

Rackspace Cloud Servers

Cloud Servers is based on OpenStack, the open and scalable operating system for building public and private clouds. With the open cloud, you get reliable cloud hosting, without locking your data into one proprietary platform.

Presto

Distributed SQL Query Engine for Big Data

Amazon Athena

Amazon Athena is an interactive query service that makes it easy to analyze data in Amazon S3 using standard SQL. Athena is serverless, so there is no infrastructure to manage, and you pay only for the queries that you run.

Apache Flink

Apache Flink is an open source system for fast and versatile data analytics in clusters. Flink supports batch and streaming analytics, in one system. Analytical programs can be written in concise and elegant APIs in Java and Scala.