Apache Kylin vs AWS Glue vs Apache Spark

Need advice about which tool to choose?Ask the StackShare community!

Apache Kylin

61
236
+ 1
24
AWS Glue

447
804
+ 1
9
Apache Spark

2.9K
3.5K
+ 1
140
Get Advice from developers at your company using StackShare Enterprise. Sign up for StackShare Enterprise.
Learn More
Pros of Apache Kylin
Pros of AWS Glue
Pros of Apache Spark
  • 7
    Star schema and snowflake schema support
  • 5
    Seamless BI integration
  • 4
    OLAP on Hadoop
  • 3
    Easy install
  • 3
    Sub-second latency on extreme large dataset
  • 2
    ANSI-SQL
  • 9
    Managed Hive Metastore
  • 61
    Open-source
  • 48
    Fast and Flexible
  • 8
    One platform for every big data problem
  • 8
    Great for distributed SQL like applications
  • 6
    Easy to install and to use
  • 3
    Works well for most Datascience usecases
  • 2
    Interactive Query
  • 2
    Machine learning libratimery, Streaming in real
  • 2
    In memory Computation

Sign up to add or upvote prosMake informed product decisions

Cons of Apache Kylin
Cons of AWS Glue
Cons of Apache Spark
    Be the first to leave a con
      Be the first to leave a con
      • 4
        Speed

      Sign up to add or upvote consMake informed product decisions

      - No public GitHub repository available -

      What is Apache Kylin?

      Apache Kylin™ is an open source Distributed Analytics Engine designed to provide SQL interface and multi-dimensional analysis (OLAP) on Hadoop/Spark supporting extremely large datasets, originally contributed from eBay Inc.

      What is AWS Glue?

      A fully managed extract, transform, and load (ETL) service that makes it easy for customers to prepare and load their data for analytics.

      What is Apache Spark?

      Spark is a fast and general processing engine compatible with Hadoop data. It can run in Hadoop clusters through YARN or Spark's standalone mode, and it can process data in HDFS, HBase, Cassandra, Hive, and any Hadoop InputFormat. It is designed to perform both batch processing (similar to MapReduce) and new workloads like streaming, interactive queries, and machine learning.

      Need advice about which tool to choose?Ask the StackShare community!

      Jobs that mention Apache Kylin, AWS Glue, and Apache Spark as a desired skillset
      What companies use Apache Kylin?
      What companies use AWS Glue?
      What companies use Apache Spark?

      Sign up to get full access to all the companiesMake informed product decisions

      What tools integrate with Apache Kylin?
      What tools integrate with AWS Glue?
      What tools integrate with Apache Spark?

      Sign up to get full access to all the tool integrationsMake informed product decisions

      Blog Posts

      Mar 24 2021 at 12:57PM

      Pinterest

      GitJenkinsKafka+7
      3
      2127
      MySQLKafkaApache Spark+6
      2
      2000
      Aug 28 2019 at 3:10AM

      Segment

      PythonJavaAmazon S3+16
      7
      2551
      What are some alternatives to Apache Kylin, AWS Glue, and Apache Spark?
      Presto
      Distributed SQL Query Engine for Big Data
      Druid
      Druid is a distributed, column-oriented, real-time analytics data store that is commonly used to power exploratory dashboards in multi-tenant environments. Druid excels as a data warehousing solution for fast aggregate queries on petabyte sized data sets. Druid supports a variety of flexible filters, exact calculations, approximate algorithms, and other useful calculations.
      Apache Impala
      Impala is a modern, open source, MPP SQL query engine for Apache Hadoop. Impala is shipped by Cloudera, MapR, and Amazon. With Impala, you can query data, whether stored in HDFS or Apache HBase – including SELECT, JOIN, and aggregate functions – in real time.
      AtScale
      Its Virtual Data Warehouse delivers performance, security and agility to exceed the demands of modern-day operational analytics.
      Clickhouse
      It allows analysis of data that is updated in real time. It offers instant results in most cases: the data is processed faster than it takes to create a query.
      See all alternatives