Get Advice Icon

Need advice about which tool to choose?Ask the StackShare community!

AWS Lambda
AWS Lambda

4.8K
3.3K
+ 1
377
Hadoop
Hadoop

1K
861
+ 1
48
Add tool

AWS Lambda vs Hadoop: What are the differences?

Developers describe AWS Lambda as "Automatically run code in response to modifications to objects in Amazon S3 buckets, messages in Kinesis streams, or updates in DynamoDB". AWS Lambda is a compute service that runs your code in response to events and automatically manages the underlying compute resources for you. You can use AWS Lambda to extend other AWS services with custom logic, or create your own back-end services that operate at AWS scale, performance, and security. On the other hand, Hadoop is detailed as "Open-source software for reliable, scalable, distributed computing". The Apache Hadoop software library is a framework that allows for the distributed processing of large data sets across clusters of computers using simple programming models. It is designed to scale up from single servers to thousands of machines, each offering local computation and storage.

AWS Lambda and Hadoop are primarily classified as "Serverless / Task Processing" and "Databases" tools respectively.

"No infrastructure" is the primary reason why developers consider AWS Lambda over the competitors, whereas "Great ecosystem" was stated as the key factor in picking Hadoop.

Hadoop is an open source tool with 9.27K GitHub stars and 5.78K GitHub forks. Here's a link to Hadoop's open source repository on GitHub.

According to the StackShare community, AWS Lambda has a broader approval, being mentioned in 1022 company stacks & 612 developers stacks; compared to Hadoop, which is listed in 237 company stacks and 127 developer stacks.

- No public GitHub repository available -

What is AWS Lambda?

AWS Lambda is a compute service that runs your code in response to events and automatically manages the underlying compute resources for you. You can use AWS Lambda to extend other AWS services with custom logic, or create your own back-end services that operate at AWS scale, performance, and security.

What is Hadoop?

The Apache Hadoop software library is a framework that allows for the distributed processing of large data sets across clusters of computers using simple programming models. It is designed to scale up from single servers to thousands of machines, each offering local computation and storage.
Get Advice Icon

Need advice about which tool to choose?Ask the StackShare community!

Why do developers choose AWS Lambda?
Why do developers choose Hadoop?

Sign up to add, upvote and see more prosMake informed product decisions

    Be the first to leave a con
    What companies use AWS Lambda?
    What companies use Hadoop?

    Sign up to get full access to all the companiesMake informed product decisions

    What tools integrate with AWS Lambda?
    What tools integrate with Hadoop?

    Sign up to get full access to all the tool integrationsMake informed product decisions

    What are some alternatives to AWS Lambda and Hadoop?
    Serverless
    Build applications comprised of microservices that run in response to events, auto-scale for you, and only charge you when they run. This lowers the total cost of maintaining your apps, enabling you to build more logic, faster. The Framework uses new event-driven compute services, like AWS Lambda, Google CloudFunctions, and more.
    AWS Elastic Beanstalk
    Once you upload your application, Elastic Beanstalk automatically handles the deployment details of capacity provisioning, load balancing, auto-scaling, and application health monitoring.
    Azure Functions
    Azure Functions is an event driven, compute-on-demand experience that extends the existing Azure application platform with capabilities to implement code triggered by events occurring in virtually any Azure or 3rd party service as well as on-premises systems.
    AWS Step Functions
    AWS Step Functions makes it easy to coordinate the components of distributed applications and microservices using visual workflows. Building applications from individual components that each perform a discrete function lets you scale and change applications quickly.
    Google App Engine
    Google has a reputation for highly reliable, high performance infrastructure. With App Engine you can take advantage of the 10 years of knowledge Google has in running massively scalable, performance driven systems. App Engine applications are easy to build, easy to maintain, and easy to scale as your traffic and data storage needs grow.
    See all alternatives
    Decisions about AWS Lambda and Hadoop
    No stack decisions found
    Interest over time
    Reviews of AWS Lambda and Hadoop
    Review ofAWS LambdaAWS Lambda

    I switched my auto chatbot to run in lambda and it was peace !

    How developers use AWS Lambda and Hadoop
    Avatar of Nathan Heffley
    Nathan Heffley uses AWS LambdaAWS Lambda

    To use Pusher's presence channel each client must be connected through a backend authentication system. While Pointer doesn't actually have any login based authentication it still needed a backend system to connect users to the proper channel.

    A small function was built that only gets called when a user first joins a session. After the user is authenticated they can communicate directly with other clients on the same channel. This made the authentication code the perfect candidate for a serverless function. Using AWS Lambda through Netlify's Functions feature made it a breeze to host.

    Avatar of Pinterest
    Pinterest uses HadoopHadoop

    The MapReduce workflow starts to process experiment data nightly when data of the previous day is copied over from Kafka. At this time, all the raw log requests are transformed into meaningful experiment results and in-depth analysis. To populate experiment data for the dashboard, we have around 50 jobs running to do all the calculations and transforms of data.

    Avatar of Simple Merchant
    Simple Merchant uses AWS LambdaAWS Lambda

    We're moving almost the entirety of our backend processes into Lambda. This has given us vast cost savings in terms of pure infrastructure billing - and time worrying about platform and scale. This move has also made our architecture almost entirely event-driven - another huge benefit as our business itself is inherently event-driven.

    Avatar of Volkan Özçelik
    Volkan Özçelik uses AWS LambdaAWS Lambda

    I mostly use AWS Lambda for triggering DevOps-related actions, like triggering an alarm or a deployment, or scheduling a backup.

    I haven’t gone totally “serverless” and I’m not planning to go 100% serverless anytime soon.

    But when I do, AWS Lambda will be an important element in my serverless setup.

    Avatar of Yelp
    Yelp uses HadoopHadoop

    in 2009 we open sourced mrjob, which allows any engineer to write a MapReduce job without contending for resources. We’re only limited by the amount of machines in an Amazon data center (which is an issue we’ve rarely encountered).

    Avatar of Promethean TV
    Promethean TV uses AWS LambdaAWS Lambda

    PrometheanTV uses various Lambda functions to provide back-end capabilities to the platform without the need of deploying servers. Examples include, geo lookup services, and data aggregation services.

    Avatar of Pinterest
    Pinterest uses HadoopHadoop

    The massive volume of discovery data that powers Pinterest and enables people to save Pins, create boards and follow other users, is generated through daily Hadoop jobs...

    Avatar of Flux Work
    Flux Work uses AWS LambdaAWS Lambda

    Serverless is the future. And AWS Lambda is the most mature FaaS out there. AWS SAM makes it easy to package Lambda as micro-apps.

    Avatar of Robert Brown
    Robert Brown uses HadoopHadoop

    Importing/Exporting data, interpreting results. Possible integration with SAS

    Avatar of Rohith Nandakumar
    Rohith Nandakumar uses HadoopHadoop

    TBD. Good to have I think. Analytics on loads of data, recommendations?

    How much does AWS Lambda cost?
    How much does Hadoop cost?
    Pricing unavailable