Pig vs. Pachyderm



Hacker News, Reddit, Stack Overflow Stats

  • -
  • -
  • 0
  • 18
  • 15
  • 5

GitHub Stats

Description

What is Pig?

Pig is a dataflow programming environment for processing very large files. Pig's language is called Pig Latin. A Pig Latin program consists of a directed acyclic graph where each node represents an operation that transforms data. Operations are of two flavors: (1) relational-algebra style operations such as join, filter, project; (2) functional-programming style operators such as map, reduce.

What is Pachyderm?

Pachyderm is an open source MapReduce engine that uses Docker containers for distributed computations.

Want advice about which of these to choose?Ask the StackShare community!

Pros

Why do developers choose Pig?
Why do you like Pig?

Why do developers choose Pachyderm?
Why do you like Pachyderm?

Cons

What are the cons of using Pig?
No Cons submitted yet for Pig
Downsides of Pig?

What are the cons of using Pachyderm?
No Cons submitted yet for Pachyderm
Downsides of Pachyderm?

Companies

What companies use Pig?
10 companies on StackShare use Pig
What companies use Pachyderm?
2 companies on StackShare use Pachyderm

Integrations

What tools integrate with Pig?
1 tools on StackShare integrate with Pig
What tools integrate with Pachyderm?
4 tools on StackShare integrate with Pachyderm

What are some alternatives to Pig and Pachyderm?

  • Apache Spark - Fast and general engine for large-scale data processing
  • Apache Flink - Fast and reliable large-scale data processing engine
  • Druid - Fast column-oriented distributed data store
  • Presto - Distributed SQL Query Engine for Big Data (by Facebook)

See all alternatives to Pig



Interest Over Time