Need advice about which tool to choose?Ask the StackShare community!
Manage your open source components, licenses, and vulnerabilities
Learn MorePros of AWS Glue
Pros of Delta Lake
Pros of Apache Spark
Pros of AWS Glue
- Managed Hive Metastore9
Pros of Delta Lake
Be the first to leave a pro
Pros of Apache Spark
- Open-source61
- Fast and Flexible48
- One platform for every big data problem8
- Great for distributed SQL like applications8
- Easy to install and to use6
- Works well for most Datascience usecases3
- Interactive Query2
- Machine learning libratimery, Streaming in real2
- In memory Computation2
Sign up to add or upvote prosMake informed product decisions
Cons of AWS Glue
Cons of Delta Lake
Cons of Apache Spark
Cons of AWS Glue
Be the first to leave a con
Cons of Delta Lake
Be the first to leave a con
Cons of Apache Spark
- Speed4
Sign up to add or upvote consMake informed product decisions
270
4.1K
114
1.3K
982
132
- No public GitHub repository available -
What is AWS Glue?
A fully managed extract, transform, and load (ETL) service that makes it easy for customers to prepare and load their data for analytics.
What is Delta Lake?
An open-source storage layer that brings ACID
transactions to Apache Spark™ and big data workloads.
What is Apache Spark?
Spark is a fast and general processing engine compatible with Hadoop data. It can run in Hadoop clusters through YARN or Spark's standalone mode, and it can process data in HDFS, HBase, Cassandra, Hive, and any Hadoop InputFormat. It is designed to perform both batch processing (similar to MapReduce) and new workloads like streaming, interactive queries, and machine learning.
Need advice about which tool to choose?Ask the StackShare community!
Jobs that mention AWS Glue, Delta Lake, and Apache Spark as a desired skillset
What companies use AWS Glue?
What companies use Delta Lake?
What companies use Apache Spark?
What companies use AWS Glue?
What companies use Delta Lake?
What companies use Apache Spark?
Sign up to get full access to all the companiesMake informed product decisions
What tools integrate with AWS Glue?
What tools integrate with Delta Lake?
What tools integrate with Apache Spark?
What tools integrate with AWS Glue?
What tools integrate with Delta Lake?
What tools integrate with Apache Spark?
Sign up to get full access to all the tool integrationsMake informed product decisions
Blog Posts
What are some alternatives to AWS Glue, Delta Lake, and Apache Spark?
AWS Data Pipeline
AWS Data Pipeline is a web service that provides a simple management system for data-driven workflows. Using AWS Data Pipeline, you define a pipeline composed of the “data sources” that contain your data, the “activities” or business logic such as EMR jobs or SQL queries, and the “schedule” on which your business logic executes. For example, you could define a job that, every hour, runs an Amazon Elastic MapReduce (Amazon EMR)–based analysis on that hour’s Amazon Simple Storage Service (Amazon S3) log data, loads the results into a relational database for future lookup, and then automatically sends you a daily summary email.
Airflow
Use Airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The Airflow scheduler executes your tasks on an array of workers while following the specified dependencies. Rich command lines utilities makes performing complex surgeries on DAGs a snap. The rich user interface makes it easy to visualize pipelines running in production, monitor progress and troubleshoot issues when needed.
Talend
It is an open source software integration platform helps you in effortlessly turning data into business insights. It uses native code generation that lets you run your data pipelines seamlessly across all cloud providers and get optimized performance on all platforms.
Alooma
Get the power of big data in minutes with Alooma and Amazon Redshift. Simply build your pipelines and map your events using Alooma’s friendly mapping interface. Query, analyze, visualize, and predict now.
Databricks
Databricks Unified Analytics Platform, from the original creators of Apache Spark™, unifies data science and engineering across the Machine Learning lifecycle from data preparation to experimentation and deployment of ML applications.