Alternatives to Presto logo

Alternatives to Presto

Apache Spark, Stan, Apache Impala, Snowflake, and Apache Drill are the most popular alternatives and competitors to Presto.
243
633
+ 1
54

What is Presto and what are its top alternatives?

Presto is an open source distributed SQL query engine for running interactive analytic queries against data sources of all sizes ranging from gigabytes to petabytes.
Presto is a tool in the Big Data Tools category of a tech stack.
Presto is an open source tool with 11.4K GitHub stars and 3.9K GitHub forks. Here’s a link to Presto's open source repository on GitHub

Top Alternatives to Presto

  • Apache Spark

    Apache Spark

    Spark is a fast and general processing engine compatible with Hadoop data. It can run in Hadoop clusters through YARN or Spark's standalone mode, and it can process data in HDFS, HBase, Cassandra, Hive, and any Hadoop InputFormat. It is designed to perform both batch processing (similar to MapReduce) and new workloads like streaming, interactive queries, and machine learning. ...

  • Stan

    Stan

    A state-of-the-art platform for statistical modeling and high-performance statistical computation. Used for statistical modeling, data analysis, and prediction in the social, biological, and physical sciences, engineering, and business. ...

  • Apache Impala

    Apache Impala

    Impala is a modern, open source, MPP SQL query engine for Apache Hadoop. Impala is shipped by Cloudera, MapR, and Amazon. With Impala, you can query data, whether stored in HDFS or Apache HBase – including SELECT, JOIN, and aggregate functions – in real time. ...

  • Snowflake

    Snowflake

    Snowflake eliminates the administration and management demands of traditional data warehouses and big data platforms. Snowflake is a true data warehouse as a service running on Amazon Web Services (AWS)—no infrastructure to manage and no knobs to turn. ...

  • Apache Drill

    Apache Drill

    Apache Drill is a distributed MPP query layer that supports SQL and alternative query languages against NoSQL and Hadoop data storage systems. It was inspired in part by Google's Dremel. ...

  • Druid

    Druid

    Druid is a distributed, column-oriented, real-time analytics data store that is commonly used to power exploratory dashboards in multi-tenant environments. Druid excels as a data warehousing solution for fast aggregate queries on petabyte sized data sets. Druid supports a variety of flexible filters, exact calculations, approximate algorithms, and other useful calculations. ...

  • Splunk

    Splunk

    It provides the leading platform for Operational Intelligence. Customers use it to search, monitor, analyze and visualize machine data. ...

  • Apache Flink

    Apache Flink

    Apache Flink is an open source system for fast and versatile data analytics in clusters. Flink supports batch and streaming analytics, in one system. Analytical programs can be written in concise and elegant APIs in Java and Scala. ...

Presto alternatives & related posts

Apache Spark logo

Apache Spark

2K
2.1K
127
Fast and general engine for large-scale data processing
2K
2.1K
+ 1
127

related Apache Spark posts

Eric Colson
Chief Algorithms Officer at Stitch Fix · | 20 upvotes · 1.6M views

The algorithms and data infrastructure at Stitch Fix is housed in #AWS. Data acquisition is split between events flowing through Kafka, and periodic snapshots of PostgreSQL DBs. We store data in an Amazon S3 based data warehouse. Apache Spark on Yarn is our tool of choice for data movement and #ETL. Because our storage layer (s3) is decoupled from our processing layer, we are able to scale our compute environment very elastically. We have several semi-permanent, autoscaling Yarn clusters running to serve our data processing needs. While the bulk of our compute infrastructure is dedicated to algorithmic processing, we also implemented Presto for adhoc queries and dashboards.

Beyond data movement and ETL, most #ML centric jobs (e.g. model training and execution) run in a similarly elastic environment as containers running Python and R code on Amazon EC2 Container Service clusters. The execution of batch jobs on top of ECS is managed by Flotilla, a service we built in house and open sourced (see https://github.com/stitchfix/flotilla-os).

At Stitch Fix, algorithmic integrations are pervasive across the business. We have dozens of data products actively integrated systems. That requires serving layer that is robust, agile, flexible, and allows for self-service. Models produced on Flotilla are packaged for deployment in production using Khan, another framework we've developed internally. Khan provides our data scientists the ability to quickly productionize those models they've developed with open source frameworks in Python 3 (e.g. PyTorch, sklearn), by automatically packaging them as Docker containers and deploying to Amazon ECS. This provides our data scientist a one-click method of getting from their algorithms to production. We then integrate those deployments into a service mesh, which allows us to A/B test various implementations in our product.

For more info:

#DataScience #DataStack #Data

See more
Conor Myhrvold
Tech Brand Mgr, Office of CTO at Uber · | 7 upvotes · 815.6K views

Why we built Marmaray, an open source generic data ingestion and dispersal framework and library for Apache Hadoop :

Built and designed by our Hadoop Platform team, Marmaray is a plug-in-based framework built on top of the Hadoop ecosystem. Users can add support to ingest data from any source and disperse to any sink leveraging the use of Apache Spark . The name, Marmaray, comes from a tunnel in Turkey connecting Europe and Asia. Similarly, we envisioned Marmaray within Uber as a pipeline connecting data from any source to any sink depending on customer preference:

https://eng.uber.com/marmaray-hadoop-ingestion-open-source/

(Direct GitHub repo: https://github.com/uber/marmaray Kafka Kafka Manager )

See more
Stan logo

Stan

36
22
0
A Probabilistic Programming Language
36
22
+ 1
0
PROS OF STAN
    No pros available
    CONS OF STAN
      No cons available

      related Stan posts

      Apache Impala logo

      Apache Impala

      96
      175
      9
      Real-time Query for Hadoop
      96
      175
      + 1
      9
      PROS OF APACHE IMPALA
      CONS OF APACHE IMPALA
        No cons available

        related Apache Impala posts

        Snowflake logo

        Snowflake

        396
        453
        5
        The data warehouse built for the cloud
        396
        453
        + 1
        5

        related Snowflake posts

        Shared insights
        on
        Google BigQuery
        Snowflake

        I use Google BigQuery because it makes is super easy to query and store data for analytics workloads. If you're using GCP, you're likely using BigQuery. However, running data viz tools directly connected to BigQuery will run pretty slow. They recently announced BI Engine which will hopefully compete well against big players like Snowflake when it comes to concurrency.

        What's nice too is that it has SQL-based ML tools, and it has great GIS support!

        See more
        Apache Drill logo

        Apache Drill

        53
        110
        14
        Schema-Free SQL Query Engine for Hadoop and NoSQL
        53
        110
        + 1
        14

        related Apache Drill posts

        Druid logo

        Druid

        246
        499
        25
        Fast column-oriented distributed data store
        246
        499
        + 1
        25

        related Druid posts

        Splunk logo

        Splunk

        346
        506
        0
        Search, monitor, analyze and visualize machine data
        346
        506
        + 1
        0
        PROS OF SPLUNK
          No pros available
          CONS OF SPLUNK
            No cons available

            related Splunk posts

            Shared insights
            on
            Kibana
            Splunk
            Grafana

            I use Kibana because it ships with the ELK stack. I don't find it as powerful as Splunk however it is light years above grepping through log files. We previously used Grafana but found it to be annoying to maintain a separate tool outside of the ELK stack. We were able to get everything we needed from Kibana.

            See more
            Apache Flink logo

            Apache Flink

            313
            448
            28
            Fast and reliable large-scale data processing engine
            313
            448
            + 1
            28

            related Apache Flink posts

            Surabhi Bhawsar
            Technical Architect at Pepcus · | 7 upvotes · 453.3K views
            Shared insights
            on
            Kafka
            Apache Flink

            I need to build the Alert & Notification framework with the use of a scheduled program. We will analyze the events from the database table and filter events that are falling under a day timespan and send these event messages over email. Currently, we are using Kafka Pub/Sub for messaging. The customer wants us to move on Apache Flink, I am trying to understand how Apache Flink could be fit better for us.

            See more

            I have to build a data processing application with an Apache Beam stack and Apache Flink runner on an Amazon EMR cluster. I saw some instability with the process and EMR clusters that keep going down. Here, the Apache Beam application gets inputs from Kafka and sends the accumulative data streams to another Kafka topic. Any advice on how to make the process more stable?

            See more