Amazon Redshift Spectrum vs AWS Glue vs Apache Spark

Need advice about which tool to choose?Ask the StackShare community!

Amazon Redshift Spectrum

101
146
+ 1
3
AWS Glue

448
804
+ 1
9
Apache Spark

2.9K
3.5K
+ 1
140
Get Advice from developers at your company using StackShare Enterprise. Sign up for StackShare Enterprise.
Learn More
Pros of Amazon Redshift Spectrum
Pros of AWS Glue
Pros of Apache Spark
  • 1
    Good Performance
  • 1
    Great Documentation
  • 1
    Economical
  • 9
    Managed Hive Metastore
  • 61
    Open-source
  • 48
    Fast and Flexible
  • 8
    One platform for every big data problem
  • 8
    Great for distributed SQL like applications
  • 6
    Easy to install and to use
  • 3
    Works well for most Datascience usecases
  • 2
    Interactive Query
  • 2
    Machine learning libratimery, Streaming in real
  • 2
    In memory Computation

Sign up to add or upvote prosMake informed product decisions

Cons of Amazon Redshift Spectrum
Cons of AWS Glue
Cons of Apache Spark
    Be the first to leave a con
      Be the first to leave a con
      • 4
        Speed

      Sign up to add or upvote consMake informed product decisions

      - No public GitHub repository available -
      - No public GitHub repository available -

      What is Amazon Redshift Spectrum?

      With Redshift Spectrum, you can extend the analytic power of Amazon Redshift beyond data stored on local disks in your data warehouse to query vast amounts of unstructured data in your Amazon S3 “data lake” -- without having to load or transform any data.

      What is AWS Glue?

      A fully managed extract, transform, and load (ETL) service that makes it easy for customers to prepare and load their data for analytics.

      What is Apache Spark?

      Spark is a fast and general processing engine compatible with Hadoop data. It can run in Hadoop clusters through YARN or Spark's standalone mode, and it can process data in HDFS, HBase, Cassandra, Hive, and any Hadoop InputFormat. It is designed to perform both batch processing (similar to MapReduce) and new workloads like streaming, interactive queries, and machine learning.

      Need advice about which tool to choose?Ask the StackShare community!

      What companies use Amazon Redshift Spectrum?
      What companies use AWS Glue?
      What companies use Apache Spark?

      Sign up to get full access to all the companiesMake informed product decisions

      What tools integrate with Amazon Redshift Spectrum?
      What tools integrate with AWS Glue?
      What tools integrate with Apache Spark?

      Sign up to get full access to all the tool integrationsMake informed product decisions

      Blog Posts

      Mar 24 2021 at 12:57PM

      Pinterest

      GitJenkinsKafka+7
      3
      2137
      MySQLKafkaApache Spark+6
      2
      2003
      Aug 28 2019 at 3:10AM

      Segment

      PythonJavaAmazon S3+16
      7
      2555
      What are some alternatives to Amazon Redshift Spectrum, AWS Glue, and Apache Spark?
      Amazon Athena
      Amazon Athena is an interactive query service that makes it easy to analyze data in Amazon S3 using standard SQL. Athena is serverless, so there is no infrastructure to manage, and you pay only for the queries that you run.
      Amazon Redshift
      It is optimized for data sets ranging from a few hundred gigabytes to a petabyte or more and costs less than $1,000 per terabyte per year, a tenth the cost of most traditional data warehousing solutions.
      Splunk
      It provides the leading platform for Operational Intelligence. Customers use it to search, monitor, analyze and visualize machine data.
      Apache Flink
      Apache Flink is an open source system for fast and versatile data analytics in clusters. Flink supports batch and streaming analytics, in one system. Analytical programs can be written in concise and elegant APIs in Java and Scala.
      Apache Hive
      Hive facilitates reading, writing, and managing large datasets residing in distributed storage using SQL. Structure can be projected onto data already in storage.
      See all alternatives