Get Advice Icon

Need advice about which tool to choose?Ask the StackShare community!

Hadoop
Hadoop

1.1K
882
+ 1
48
HBase
HBase

193
156
+ 1
12
Add tool

Hadoop vs HBase: What are the differences?

Hadoop: Open-source software for reliable, scalable, distributed computing. The Apache Hadoop software library is a framework that allows for the distributed processing of large data sets across clusters of computers using simple programming models. It is designed to scale up from single servers to thousands of machines, each offering local computation and storage; HBase: The Hadoop database, a distributed, scalable, big data store. Apache HBase is an open-source, distributed, versioned, column-oriented store modeled after Google' Bigtable: A Distributed Storage System for Structured Data by Chang et al. Just as Bigtable leverages the distributed data storage provided by the Google File System, HBase provides Bigtable-like capabilities on top of Apache Hadoop.

Hadoop and HBase belong to "Databases" category of the tech stack.

"Great ecosystem" is the primary reason why developers consider Hadoop over the competitors, whereas "Performance" was stated as the key factor in picking HBase.

Hadoop and HBase are both open source tools. Hadoop with 9.26K GitHub stars and 5.78K forks on GitHub appears to be more popular than HBase with 2.91K GitHub stars and 2.01K GitHub forks.

Airbnb, Uber Technologies, and Spotify are some of the popular companies that use Hadoop, whereas HBase is used by Pinterest, HubSpot, and Yammer. Hadoop has a broader approval, being mentioned in 237 company stacks & 127 developers stacks; compared to HBase, which is listed in 54 company stacks and 18 developer stacks.

What is Hadoop?

The Apache Hadoop software library is a framework that allows for the distributed processing of large data sets across clusters of computers using simple programming models. It is designed to scale up from single servers to thousands of machines, each offering local computation and storage.

What is HBase?

Apache HBase is an open-source, distributed, versioned, column-oriented store modeled after Google' Bigtable: A Distributed Storage System for Structured Data by Chang et al. Just as Bigtable leverages the distributed data storage provided by the Google File System, HBase provides Bigtable-like capabilities on top of Apache Hadoop.
Get Advice Icon

Need advice about which tool to choose?Ask the StackShare community!

Why do developers choose Hadoop?
Why do developers choose HBase?
    Be the first to leave a con
      Be the first to leave a con
      What companies use Hadoop?
      What companies use HBase?

      Sign up to get full access to all the companiesMake informed product decisions

      What tools integrate with Hadoop?
      What tools integrate with HBase?

      Sign up to get full access to all the tool integrationsMake informed product decisions

      What are some alternatives to Hadoop and HBase?
      Cassandra
      Partitioning means that Cassandra can distribute your data across multiple machines in an application-transparent matter. Cassandra will automatically repartition as machines are added and removed from the cluster. Row store means that like relational databases, Cassandra organizes data by rows and columns. The Cassandra Query Language (CQL) is a close relative of SQL.
      MongoDB
      MongoDB stores data in JSON-like documents that can vary in structure, offering a dynamic, flexible schema. MongoDB was also designed for high availability and scalability, with built-in replication and auto-sharding.
      Elasticsearch
      Elasticsearch is a distributed, RESTful search and analytics engine capable of storing data and searching it in near real time. Elasticsearch, Kibana, Beats and Logstash are the Elastic Stack (sometimes called the ELK Stack).
      Splunk
      Splunk Inc. provides the leading platform for Operational Intelligence. Customers use Splunk to search, monitor, analyze and visualize machine data.
      MySQL
      The MySQL software delivers a very fast, multi-threaded, multi-user, and robust SQL (Structured Query Language) database server. MySQL Server is intended for mission-critical, heavy-load production systems as well as for embedding into mass-deployed software.
      See all alternatives
      Decisions about Hadoop and HBase
      StackShare Editors
      StackShare Editors
      Apache Thrift
      Apache Thrift
      Kotlin
      Kotlin
      Presto
      Presto
      HHVM (HipHop Virtual Machine)
      HHVM (HipHop Virtual Machine)
      gRPC
      gRPC
      Kubernetes
      Kubernetes
      Apache Spark
      Apache Spark
      Airflow
      Airflow
      Terraform
      Terraform
      Hadoop
      Hadoop
      Swift
      Swift
      Hack
      Hack
      Memcached
      Memcached
      Consul
      Consul
      Chef
      Chef
      Prometheus
      Prometheus

      Since the beginning, Cal Henderson has been the CTO of Slack. Earlier this year, he commented on a Quora question summarizing their current stack.

      Apps
      • Web: a mix of JavaScript/ES6 and React.
      • Desktop: And Electron to ship it as a desktop application.
      • Android: a mix of Java and Kotlin.
      • iOS: written in a mix of Objective C and Swift.
      Backend
      • The core application and the API written in PHP/Hack that runs on HHVM.
      • The data is stored in MySQL using Vitess.
      • Caching is done using Memcached and MCRouter.
      • The search service takes help from SolrCloud, with various Java services.
      • The messaging system uses WebSockets with many services in Java and Go.
      • Load balancing is done using HAproxy with Consul for configuration.
      • Most services talk to each other over gRPC,
      • Some Thrift and JSON-over-HTTP
      • Voice and video calling service was built in Elixir.
      Data warehouse
      • Built using open source tools including Presto, Spark, Airflow, Hadoop and Kafka.
      Etc
      See more
      Interest over time
      Reviews of Hadoop and HBase
      No reviews found
      How developers use Hadoop and HBase
      Avatar of Pinterest
      Pinterest uses HadoopHadoop

      The MapReduce workflow starts to process experiment data nightly when data of the previous day is copied over from Kafka. At this time, all the raw log requests are transformed into meaningful experiment results and in-depth analysis. To populate experiment data for the dashboard, we have around 50 jobs running to do all the calculations and transforms of data.

      Avatar of Pinterest
      Pinterest uses HBaseHBase

      The final output is inserted into HBase to serve the experiment dashboard. We also load the output data to Redshift for ad-hoc analysis. For real-time experiment data processing, we use Storm to tail Kafka and process data in real-time and insert metrics into MySQL, so we could identify group allocation problems and send out real-time alerts and metrics.

      Avatar of Yelp
      Yelp uses HadoopHadoop

      in 2009 we open sourced mrjob, which allows any engineer to write a MapReduce job without contending for resources. We’re only limited by the amount of machines in an Amazon data center (which is an issue we’ve rarely encountered).

      Avatar of Pinterest
      Pinterest uses HadoopHadoop

      The massive volume of discovery data that powers Pinterest and enables people to save Pins, create boards and follow other users, is generated through daily Hadoop jobs...

      Avatar of Robert Brown
      Robert Brown uses HadoopHadoop

      Importing/Exporting data, interpreting results. Possible integration with SAS

      Avatar of Rohith Nandakumar
      Rohith Nandakumar uses HadoopHadoop

      TBD. Good to have I think. Analytics on loads of data, recommendations?

      Avatar of Axibase
      Axibase uses HBaseHBase
      • Raw storage engine
      • Replication
      • Fault-tolerance
      Avatar of Mehdi TAZI
      Mehdi TAZI uses HBaseHBase

      Range scan and HDFS Buffering system

      Avatar of anerudhbalaji
      anerudhbalaji uses HBaseHBase

      Primary datastore

      How much does Hadoop cost?
      How much does HBase cost?
      Pricing unavailable
      Pricing unavailable
      News about HBase
      More news