Get Advice Icon

Need advice about which tool to choose?Ask the StackShare community!

Hadoop
Hadoop

1.3K
1.1K
+ 1
48
InfluxDB
InfluxDB

523
384
+ 1
121
Add tool

Hadoop vs InfluxDB: What are the differences?

What is Hadoop? Open-source software for reliable, scalable, distributed computing. The Apache Hadoop software library is a framework that allows for the distributed processing of large data sets across clusters of computers using simple programming models. It is designed to scale up from single servers to thousands of machines, each offering local computation and storage.

What is InfluxDB? An open-source distributed time series database with no external dependencies. InfluxDB is a scalable datastore for metrics, events, and real-time analytics. It has a built-in HTTP API so you don't have to write any server side code to get up and running InfluxDB is designed to be scalable, simple to install and manage, and fast to get data in and out..

Hadoop and InfluxDB can be categorized as "Databases" tools.

"Great ecosystem" is the primary reason why developers consider Hadoop over the competitors, whereas "Time-series data analysis" was stated as the key factor in picking InfluxDB.

Hadoop and InfluxDB are both open source tools. InfluxDB with 16.6K GitHub stars and 2.37K forks on GitHub appears to be more popular than Hadoop with 9.18K GitHub stars and 5.74K GitHub forks.

According to the StackShare community, Hadoop has a broader approval, being mentioned in 237 company stacks & 116 developers stacks; compared to InfluxDB, which is listed in 116 company stacks and 38 developer stacks.

What is Hadoop?

The Apache Hadoop software library is a framework that allows for the distributed processing of large data sets across clusters of computers using simple programming models. It is designed to scale up from single servers to thousands of machines, each offering local computation and storage.

What is InfluxDB?

InfluxDB is a scalable datastore for metrics, events, and real-time analytics. It has a built-in HTTP API so you don't have to write any server side code to get up and running. InfluxDB is designed to be scalable, simple to install and manage, and fast to get data in and out.
Get Advice Icon

Need advice about which tool to choose?Ask the StackShare community!

Why do developers choose Hadoop?
Why do developers choose InfluxDB?

Sign up to add, upvote and see more prosMake informed product decisions

    Be the first to leave a con
    What companies use Hadoop?
    What companies use InfluxDB?

    Sign up to get full access to all the companiesMake informed product decisions

    What tools integrate with Hadoop?
    What tools integrate with InfluxDB?

    Sign up to get full access to all the tool integrationsMake informed product decisions

    What are some alternatives to Hadoop and InfluxDB?
    Cassandra
    Partitioning means that Cassandra can distribute your data across multiple machines in an application-transparent matter. Cassandra will automatically repartition as machines are added and removed from the cluster. Row store means that like relational databases, Cassandra organizes data by rows and columns. The Cassandra Query Language (CQL) is a close relative of SQL.
    MongoDB
    MongoDB stores data in JSON-like documents that can vary in structure, offering a dynamic, flexible schema. MongoDB was also designed for high availability and scalability, with built-in replication and auto-sharding.
    Elasticsearch
    Elasticsearch is a distributed, RESTful search and analytics engine capable of storing data and searching it in near real time. Elasticsearch, Kibana, Beats and Logstash are the Elastic Stack (sometimes called the ELK Stack).
    Splunk
    Splunk Inc. provides the leading platform for Operational Intelligence. Customers use Splunk to search, monitor, analyze and visualize machine data.
    Snowflake
    Snowflake eliminates the administration and management demands of traditional data warehouses and big data platforms. Snowflake is a true data warehouse as a service running on Amazon Web Services (AWS)—no infrastructure to manage and no knobs to turn.
    See all alternatives
    Decisions about Hadoop and InfluxDB
    StackShare Editors
    StackShare Editors
    Prometheus
    Prometheus
    Chef
    Chef
    Consul
    Consul
    Memcached
    Memcached
    Hack
    Hack
    Swift
    Swift
    Hadoop
    Hadoop
    Terraform
    Terraform
    Airflow
    Airflow
    Apache Spark
    Apache Spark
    Kubernetes
    Kubernetes
    gRPC
    gRPC
    HHVM (HipHop Virtual Machine)
    HHVM (HipHop Virtual Machine)
    Presto
    Presto
    Kotlin
    Kotlin
    Apache Thrift
    Apache Thrift

    Since the beginning, Cal Henderson has been the CTO of Slack. Earlier this year, he commented on a Quora question summarizing their current stack.

    Apps
    • Web: a mix of JavaScript/ES6 and React.
    • Desktop: And Electron to ship it as a desktop application.
    • Android: a mix of Java and Kotlin.
    • iOS: written in a mix of Objective C and Swift.
    Backend
    • The core application and the API written in PHP/Hack that runs on HHVM.
    • The data is stored in MySQL using Vitess.
    • Caching is done using Memcached and MCRouter.
    • The search service takes help from SolrCloud, with various Java services.
    • The messaging system uses WebSockets with many services in Java and Go.
    • Load balancing is done using HAproxy with Consul for configuration.
    • Most services talk to each other over gRPC,
    • Some Thrift and JSON-over-HTTP
    • Voice and video calling service was built in Elixir.
    Data warehouse
    • Built using open source tools including Presto, Spark, Airflow, Hadoop and Kafka.
    Etc
    See more
    Interest over time
    Reviews of Hadoop and InfluxDB
    Review ofInfluxDBInfluxDB

    Influx doesn't currently natively support horizontal distribution. Hard to recommend it until they implement that.

    Avatar of YaronWittenstein
    Computer Science
    Review ofInfluxDBInfluxDB

    InfluxDB is a game changer

    How developers use Hadoop and InfluxDB
    Avatar of Pinterest
    Pinterest uses HadoopHadoop

    The MapReduce workflow starts to process experiment data nightly when data of the previous day is copied over from Kafka. At this time, all the raw log requests are transformed into meaningful experiment results and in-depth analysis. To populate experiment data for the dashboard, we have around 50 jobs running to do all the calculations and transforms of data.

    Avatar of ShadowICT
    ShadowICT uses InfluxDBInfluxDB

    We use InfluxDB as a store for our data that gets fed into Grafana. It's ideal for this as it's a lightweight storage engine that can be modified on the fly by scripts without having to log into the server itself and manage tables. The HTTP API also makes it ideal for integrating with frontend services.

    Avatar of Yelp
    Yelp uses HadoopHadoop

    in 2009 we open sourced mrjob, which allows any engineer to write a MapReduce job without contending for resources. We’re only limited by the amount of machines in an Amazon data center (which is an issue we’ve rarely encountered).

    Avatar of Pinterest
    Pinterest uses HadoopHadoop

    The massive volume of discovery data that powers Pinterest and enables people to save Pins, create boards and follow other users, is generated through daily Hadoop jobs...

    Avatar of Goyoboard
    Goyoboard uses InfluxDBInfluxDB

    To track time-series of course, utilizing few retention rules and continuous queries to keep time-series data fast and maintanable

    Avatar of sapslaj
    sapslaj uses InfluxDBInfluxDB

    InfluxDB ingests information from various sources (mostly Telegraf instances) into one place for monitoring purposes.

    Avatar of Robert Brown
    Robert Brown uses HadoopHadoop

    Importing/Exporting data, interpreting results. Possible integration with SAS

    Avatar of Rohith Nandakumar
    Rohith Nandakumar uses HadoopHadoop

    TBD. Good to have I think. Analytics on loads of data, recommendations?

    Avatar of Chris Hartwig
    Chris Hartwig uses InfluxDBInfluxDB

    All our metrics go through InfluxDB, both applicative and system

    How much does Hadoop cost?
    How much does InfluxDB cost?
    Pricing unavailable
    Pricing unavailable