Alternatives to Databricks logo

Alternatives to Databricks

Snowflake, Azure Databricks, Domino, Confluent, and Apache Spark are the most popular alternatives and competitors to Databricks.
19
10
+ 1
0

What is Databricks and what are its top alternatives?

Databricks Unified Analytics Platform, from the original creators of Apache Spark™, unifies data science and engineering across the Machine Learning lifecycle from data preparation to experimentation and deployment of ML applications.
Databricks is a tool in the General Analytics category of a tech stack.

Databricks alternatives & related posts

Snowflake logo

Snowflake

97
70
0
97
70
+ 1
0
The data warehouse built for the cloud
    Be the first to leave a pro
    Snowflake logo
    Snowflake
    VS
    Databricks logo
    Databricks

    related Snowflake posts

    Snowflake
    Snowflake
    Google BigQuery
    Google BigQuery

    I use Google BigQuery because it makes is super easy to query and store data for analytics workloads. If you're using GCP, you're likely using BigQuery. However, running data viz tools directly connected to BigQuery will run pretty slow. They recently announced BI Engine which will hopefully compete well against big players like Snowflake when it comes to concurrency.

    What's nice too is that it has SQL-based ML tools, and it has great GIS support!

    See more
    Azure Databricks logo

    Azure Databricks

    6
    4
    0
    6
    4
    + 1
    0
    Fast, easy, and collaborative Apache Spark–based analytics service
      Be the first to leave a pro
      Azure Databricks logo
      Azure Databricks
      VS
      Databricks logo
      Databricks
      Domino logo

      Domino

      4
      5
      0
      4
      5
      + 1
      0
      A PaaS for data science - easily run R, Python or Matlab code in the cloud with automatic...
        Be the first to leave a pro
        Domino logo
        Domino
        VS
        Databricks logo
        Databricks
        Confluent logo

        Confluent

        13
        6
        0
        13
        6
        + 1
        0
        A stream data platform to help companies harness their high volume real-time data streams
        Confluent logo
        Confluent
        VS
        Databricks logo
        Databricks

        related Apache Spark posts

        Eric Colson
        Eric Colson
        Chief Algorithms Officer at Stitch Fix · | 19 upvotes · 206.2K views
        atStitch FixStitch Fix
        Amazon EC2 Container Service
        Amazon EC2 Container Service
        Docker
        Docker
        PyTorch
        PyTorch
        R
        R
        Python
        Python
        Presto
        Presto
        Apache Spark
        Apache Spark
        Amazon S3
        Amazon S3
        PostgreSQL
        PostgreSQL
        Kafka
        Kafka
        #Data
        #DataStack
        #DataScience
        #ML
        #Etl
        #AWS

        The algorithms and data infrastructure at Stitch Fix is housed in #AWS. Data acquisition is split between events flowing through Kafka, and periodic snapshots of PostgreSQL DBs. We store data in an Amazon S3 based data warehouse. Apache Spark on Yarn is our tool of choice for data movement and #ETL. Because our storage layer (s3) is decoupled from our processing layer, we are able to scale our compute environment very elastically. We have several semi-permanent, autoscaling Yarn clusters running to serve our data processing needs. While the bulk of our compute infrastructure is dedicated to algorithmic processing, we also implemented Presto for adhoc queries and dashboards.

        Beyond data movement and ETL, most #ML centric jobs (e.g. model training and execution) run in a similarly elastic environment as containers running Python and R code on Amazon EC2 Container Service clusters. The execution of batch jobs on top of ECS is managed by Flotilla, a service we built in house and open sourced (see https://github.com/stitchfix/flotilla-os).

        At Stitch Fix, algorithmic integrations are pervasive across the business. We have dozens of data products actively integrated systems. That requires serving layer that is robust, agile, flexible, and allows for self-service. Models produced on Flotilla are packaged for deployment in production using Khan, another framework we've developed internally. Khan provides our data scientists the ability to quickly productionize those models they've developed with open source frameworks in Python 3 (e.g. PyTorch, sklearn), by automatically packaging them as Docker containers and deploying to Amazon ECS. This provides our data scientist a one-click method of getting from their algorithms to production. We then integrate those deployments into a service mesh, which allows us to A/B test various implementations in our product.

        For more info:

        #DataScience #DataStack #Data

        See more
        Conor Myhrvold
        Conor Myhrvold
        Tech Brand Mgr, Office of CTO at Uber · | 4 upvotes · 95.7K views
        atUber TechnologiesUber Technologies
        Kafka Manager
        Kafka Manager
        Kafka
        Kafka
        GitHub
        GitHub
        Apache Spark
        Apache Spark
        Hadoop
        Hadoop

        Why we built Marmaray, an open source generic data ingestion and dispersal framework and library for Apache Hadoop :

        Built and designed by our Hadoop Platform team, Marmaray is a plug-in-based framework built on top of the Hadoop ecosystem. Users can add support to ingest data from any source and disperse to any sink leveraging the use of Apache Spark . The name, Marmaray, comes from a tunnel in Turkey connecting Europe and Asia. Similarly, we envisioned Marmaray within Uber as a pipeline connecting data from any source to any sink depending on customer preference:

        https://eng.uber.com/marmaray-hadoop-ingestion-open-source/

        (Direct GitHub repo: https://github.com/uber/marmaray Kafka Kafka Manager )

        See more
        Azure HDInsight logo

        Azure HDInsight

        5
        2
        0
        5
        2
        + 1
        0
        A cloud-based service from Microsoft for big data analytics
          Be the first to leave a pro
          Azure HDInsight logo
          Azure HDInsight
          VS
          Databricks logo
          Databricks

          related Google Analytics posts

          Tassanai Singprom
          Tassanai Singprom
          Slack
          Slack
          BrowserStack
          BrowserStack
          Sentry
          Sentry
          Kibana
          Kibana
          Visual Studio Code
          Visual Studio Code
          npm
          npm
          GitLab
          GitLab
          GitHub
          GitHub
          Git
          Git
          Elasticsearch
          Elasticsearch
          Postman
          Postman
          Google Analytics
          Google Analytics
          MariaDB
          MariaDB
          GraphQL
          GraphQL
          Amazon RDS
          Amazon RDS
          Lumen
          Lumen
          Laravel
          Laravel
          Firebase
          Firebase
          Vue.js
          Vue.js
          Sass
          Sass
          Ubuntu
          Ubuntu
          Amazon EC2
          Amazon EC2
          Redis
          Redis
          jQuery
          jQuery
          HTML5
          HTML5
          PHP
          PHP
          JavaScript
          JavaScript

          This is my stack in Application & Data

          JavaScript PHP HTML5 jQuery Redis Amazon EC2 Ubuntu Sass Vue.js Firebase Laravel Lumen Amazon RDS GraphQL MariaDB

          My Utilities Tools

          Google Analytics Postman Elasticsearch

          My Devops Tools

          Git GitHub GitLab npm Visual Studio Code Kibana Sentry BrowserStack

          My Business Tools

          Slack

          See more
          Jack Graves
          Jack Graves
          Head of Product Development at Automation Consultants · | 5 upvotes · 8.2K views
          atAutomation ConsultantsAutomation Consultants
          Google Analytics
          Google Analytics
          Segment
          Segment

          We currently use Google Analytics in our stack to monitor page views across our Marketplace listings, Documentation site and primary website. We're currently also investigating using Segment to provide in-app analytics in our Cloud App offerings. We expect to use Segment to guide our App development efforts, by monitoring, anonymously which features our clients use the most - but this is in early stages and will involve an update to our privacy policy.

          See more
          Matomo logo

          Matomo

          1.7K
          10
          0
          1.7K
          10
          + 1
          0
          A free and open source web analytics application
            Be the first to leave a pro
            Matomo logo
            Matomo
            VS
            Databricks logo
            Databricks
            Piwik logo

            Piwik

            1.4K
            448
            74
            1.4K
            448
            + 1
            74
            The ultimate open source alternative to Google Analytics
            Piwik logo
            Piwik
            VS
            Databricks logo
            Databricks
            Clicky logo

            Clicky

            1.1K
            50
            19
            1.1K
            50
            + 1
            19
            Real time web analytics
            Clicky logo
            Clicky
            VS
            Databricks logo
            Databricks
            Autotrack logo

            Autotrack

            63
            97
            0
            63
            97
            + 1
            0
            Open source lib for automatic and enhanced Google Analytics tracking for common user interactions on the web (by...
              Be the first to leave a pro
              Autotrack logo
              Autotrack
              VS
              Databricks logo
              Databricks
              Facebook Pixel logo

              Facebook Pixel

              48
              17
              0
              48
              17
              + 1
              0
              A piece of code for your website that lets you measure, optimise and build audiences for your advertising...
                Be the first to leave a pro
                Facebook Pixel logo
                Facebook Pixel
                VS
                Databricks logo
                Databricks
                PowerBI logo

                PowerBI

                44
                20
                0
                44
                20
                + 1
                0
                It is a business analytics service by Microsoft
                  Be the first to leave a pro
                  PowerBI logo
                  PowerBI
                  VS
                  Databricks logo
                  Databricks
                  Google Search Console logo

                  Google Search Console

                  44
                  28
                  0
                  44
                  28
                  + 1
                  0
                  A web service, provided free of charge for webmasters
                    Be the first to leave a pro
                    Google Search Console logo
                    Google Search Console
                    VS
                    Databricks logo
                    Databricks
                    Facebook Analytics logo

                    Facebook Analytics

                    23
                    10
                    0
                    23
                    10
                    + 1
                    0
                    Measure behavior across your owned channels and discover valuable insights
                      Be the first to leave a pro
                      Facebook Analytics logo
                      Facebook Analytics
                      VS
                      Databricks logo
                      Databricks
                      Yandex Metrica logo

                      Yandex Metrica

                      18
                      1
                      0
                      18
                      1
                      + 1
                      0
                      A free web analytics service
                        Be the first to leave a pro
                        Yandex Metrica logo
                        Yandex Metrica
                        VS
                        Databricks logo
                        Databricks
                        Adobe Analytics logo

                        Adobe Analytics

                        17
                        8
                        0
                        17
                        8
                        + 1
                        0
                        A marketing analytics and reporting platform
                          Be the first to leave a pro
                          Adobe Analytics logo
                          Adobe Analytics
                          VS
                          Databricks logo
                          Databricks
                          Maze logo

                          Maze

                          11
                          18
                          1
                          11
                          18
                          + 1
                          1
                          Beautiful & actionable analytics for InVision prototypes
                          Maze logo
                          Maze
                          VS
                          Databricks logo
                          Databricks
                          Webtrekk  logo

                          Webtrekk

                          5
                          0
                          0
                          5
                          0
                          + 1
                          0
                          Marketing Analytics & Customer Intelligence
                            Be the first to leave a pro
                            Webtrekk  logo
                            Webtrekk
                            VS
                            Databricks logo
                            Databricks
                            Parse.ly logo

                            Parse.ly

                            3
                            2
                            0
                            3
                            2
                            + 1
                            0
                            Audience attention is precious, we help you make it valuable
                              Be the first to leave a pro
                              Parse.ly logo
                              Parse.ly
                              VS
                              Databricks logo
                              Databricks