Apache Kylin
Apache Kylin

34
99
+ 1
17
Apache Spark
Apache Spark

1.6K
1.7K
+ 1
112
Add tool

Apache Kylin vs Apache Spark: What are the differences?

What is Apache Kylin? OLAP Engine for Big Data. Apache Kylin™ is an open source Distributed Analytics Engine designed to provide SQL interface and multi-dimensional analysis (OLAP) on Hadoop/Spark supporting extremely large datasets, originally contributed from eBay Inc.

What is Apache Spark? Fast and general engine for large-scale data processing. Spark is a fast and general processing engine compatible with Hadoop data. It can run in Hadoop clusters through YARN or Spark's standalone mode, and it can process data in HDFS, HBase, Cassandra, Hive, and any Hadoop InputFormat. It is designed to perform both batch processing (similar to MapReduce) and new workloads like streaming, interactive queries, and machine learning.

Apache Kylin and Apache Spark can be categorized as "Big Data" tools.

Some of the features offered by Apache Kylin are:

  • Extremely Fast OLAP Engine at Scale
  • ANSI SQL Interface on Hadoop
  • Interactive Query Capability

On the other hand, Apache Spark provides the following key features:

  • Run programs up to 100x faster than Hadoop MapReduce in memory, or 10x faster on disk
  • Write applications quickly in Java, Scala or Python
  • Combine SQL, streaming, and complex analytics

Apache Kylin and Apache Spark are both open source tools. Apache Spark with 22.5K GitHub stars and 19.4K forks on GitHub appears to be more popular than Apache Kylin with 2.23K GitHub stars and 992 GitHub forks.

Pros of Apache Kylin
Pros of Apache Spark

Sign up to add or upvote prosMake informed product decisions

Cons of Apache Kylin
Cons of Apache Spark
    Be the first to leave a con

    Sign up to add or upvote consMake informed product decisions

    What is Apache Kylin?

    Apache Kylin™ is an open source Distributed Analytics Engine designed to provide SQL interface and multi-dimensional analysis (OLAP) on Hadoop/Spark supporting extremely large datasets, originally contributed from eBay Inc.

    What is Apache Spark?

    Spark is a fast and general processing engine compatible with Hadoop data. It can run in Hadoop clusters through YARN or Spark's standalone mode, and it can process data in HDFS, HBase, Cassandra, Hive, and any Hadoop InputFormat. It is designed to perform both batch processing (similar to MapReduce) and new workloads like streaming, interactive queries, and machine learning.
    What companies use Apache Kylin?
    What companies use Apache Spark?

    Sign up to get full access to all the companiesMake informed product decisions

    What tools integrate with Apache Kylin?
    What tools integrate with Apache Spark?

    Sign up to get full access to all the tool integrationsMake informed product decisions

    What are some alternatives to Apache Kylin and Apache Spark?
    Presto
    Presto is an open source distributed SQL query engine for running interactive analytic queries against data sources of all sizes ranging from gigabytes to petabytes.
    Apache Impala
    Impala is a modern, open source, MPP SQL query engine for Apache Hadoop. Impala is shipped by Cloudera, MapR, and Amazon. With Impala, you can query data, whether stored in HDFS or Apache HBase – including SELECT, JOIN, and aggregate functions – in real time.
    Druid
    Druid is a distributed, column-oriented, real-time analytics data store that is commonly used to power exploratory dashboards in multi-tenant environments. Druid excels as a data warehousing solution for fast aggregate queries on petabyte sized data sets. Druid supports a variety of flexible filters, exact calculations, approximate algorithms, and other useful calculations.
    AtScale
    Its Virtual Data Warehouse delivers performance, security and agility to exceed the demands of modern-day operational analytics.
    Clickhouse
    It allows analysis of data that is updated in real time. It offers instant results in most cases: the data is processed faster than it takes to create a query.
    See all alternatives
    Interest over time