Pig vs s3-lambda: What are the differences?
Pig: Platform for analyzing large data sets. Pig is a dataflow programming environment for processing very large files. Pig's language is called Pig Latin. A Pig Latin program consists of a directed acyclic graph where each node represents an operation that transforms data Operations are of two flavors: (1) relational-algebra style operations such as join, filter, project; (2) functional-programming style operators such as map, reduce. ; s3-lambda: Lambda functions over S3 objects: each, map, reduce, filter. s3-lambda enables you to run lambda functions over a context of S3 objects. It has a stateless architecture with concurrency control, allowing you to process a large number of files very quickly. This is useful for quickly prototyping complex data jobs without an infrastructure like Hadoop or Spark.
Pig and s3-lambda can be categorized as "Big Data" tools.
Pig and s3-lambda are both open source tools. It seems that s3-lambda with 1.06K GitHub stars and 43 forks on GitHub has more adoption than Pig with 583 GitHub stars and 449 GitHub forks.