Apache Flink vs PostgreSQL

Overview

PostgreSQL

Stacks103.0K

Followers83.9K

Votes3.6K

GitHub Stars19.0K

Forks5.2K

Apache Flink

Stacks534

Followers879

Votes38

GitHub Stars25.4K

Forks13.7K

Apache Flink vs PostgreSQL: What are the differences?

Developers describe Apache Flink as "Fast and reliable large-scale data processing engine". Apache Flink is an open source system for fast and versatile data analytics in clusters. Flink supports batch and streaming analytics, in one system. Analytical programs can be written in concise and elegant APIs in Java and Scala. On the other hand, PostgreSQL is detailed as "A powerful, open source object-relational database system". PostgreSQL is an advanced object-relational database management system that supports an extended subset of the SQL standard, including transactions, foreign keys, subqueries, triggers, user-defined types and functions.

Apache Flink and PostgreSQL are primarily classified as "Big Data" and "Databases" tools respectively.

"Unified batch and stream processing" is the primary reason why developers consider Apache Flink over the competitors, whereas "Relational database" was stated as the key factor in picking PostgreSQL.

Apache Flink and PostgreSQL are both open source tools. Apache Flink with 9.11K GitHub stars and 4.86K forks on GitHub appears to be more popular than PostgreSQL with 5.38K GitHub stars and 1.79K GitHub forks.

According to the StackShare community, PostgreSQL has a broader approval, being mentioned in 2701 company stacks & 2098 developers stacks; compared to Apache Flink, which is listed in 20 company stacks and 21 developer stacks.

Share your Stack

Help developers discover the tools you use. Get visibility for your team's tech choices and contribute to the community's knowledge.

View Docs

CLI (Node.js)

Manual

Advice on PostgreSQL, Apache Flink

Kyle

Web Application Developer at Redacted DevWorks

Dec 3, 2019

Decidedon

PostGIS

While there's been some very clever techniques that has allowed non-natively supported geo querying to be performed, it is incredibly slow in the long game and error prone at best.

MySQL finally introduced it's own GEO functions and special indexing operations for GIS type data. I prototyped with this, as MySQL is the most familiar database to me. But no matter what I did with it, how much tuning i'd give it, how much I played with it, the results would come back inconsistent.

It was very disappointing.

I figured, at this point, that SQL Server, being an enterprise solution authored by one of the biggest worldwide software developers in the world, Microsoft, might contain some decent GIS in it.

I was very disappointed.

Postgres is a Database solution i'm still getting familiar with, but I noticed it had no built in support for GIS. So I hilariously didn't pay it too much attention. That was until I stumbled upon PostGIS and my world changed forever.

449k views449k

Comments

George

Student

Mar 18, 2020

Needs adviceon

PostgreSQL

Python

Django

Hello everyone,

Well, I want to build a large-scale project, but I do not know which ORDBMS to choose. The app should handle real-time operations, not chatting, but things like future scheduling or reminders. It should be also really secure, fast and easy to use. And last but not least, should I use them both. I mean PostgreSQL with Python / Django and MongoDB with Node.js? Or would it be better to use PostgreSQL with Node.js?

*The project is going to use React for the front-end and GraphQL is going to be used for the API.

Thank you all. Any answer or advice would be really helpful!

620k views620k

Comments

Navraj

CEO at SuPragma

Apr 16, 2020

Needs adviceon

MySQL

PostgreSQL

I asked my last question incorrectly. Rephrasing it here.

I am looking for the most secure open source database for my project I'm starting: https://github.com/SuPragma/SuPragma/wiki

Which database is more secure? MySQL or PostgreSQL? Are there others I should be considering? Is it possible to change the encryption keys dynamically?

Thanks,

Raj

401k views401k

Comments

Detailed Comparison

PostgreSQL	Apache Flink
PostgreSQL is an advanced object-relational database management system that supports an extended subset of the SQL standard, including transactions, foreign keys, subqueries, triggers, user-defined types and functions.	Apache Flink is an open source system for fast and versatile data analytics in clusters. Flink supports batch and streaming analytics, in one system. Analytical programs can be written in concise and elegant APIs in Java and Scala.
-	Hybrid batch/streaming runtime that supports batch processing and data streaming programs.;Custom memory management to guarantee efficient, adaptive, and highly robust switching between in-memory and data processing out-of-core algorithms.;Flexible and expressive windowing semantics for data stream programs;Built-in program optimizer that chooses the proper runtime operations for each program;Custom type analysis and serialization stack for high performance
Statistics
GitHub Stars 19.0K	GitHub Stars 25.4K
GitHub Forks 5.2K	GitHub Forks 13.7K
Stacks 103.0K	Stacks 534
Followers 83.9K	Followers 879
Votes 3.6K	Votes 38
Pros & Cons
Pros 765 Relational database 511 High availability 439 Enterprise class database 383 Sql 304 Sql + nosql Cons 10 Table/index bloatings	Pros 16 Unified batch and stream processing 8 Out-of-the box connector to kinesis,s3,hdfs 8 Easy to use streaming apis 4 Open Source 2 Low latency
Integrations
No integrations available	YARN Hadoop Hadoop HBase Kafka

What are some alternatives to PostgreSQL, Apache Flink?

MongoDB

MongoDB stores data in JSON-like documents that can vary in structure, offering a dynamic, flexible schema. MongoDB was also designed for high availability and scalability, with built-in replication and auto-sharding.

MySQL

The MySQL software delivers a very fast, multi-threaded, multi-user, and robust SQL (Structured Query Language) database server. MySQL Server is intended for mission-critical, heavy-load production systems as well as for embedding into mass-deployed software.

Microsoft SQL Server

Microsoft® SQL Server is a database management and analysis system for e-commerce, line-of-business, and data warehousing solutions.

SQLite

SQLite is an embedded SQL database engine. Unlike most other SQL databases, SQLite does not have a separate server process. SQLite reads and writes directly to ordinary disk files. A complete SQL database with multiple tables, indices, triggers, and views, is contained in a single disk file.

Cassandra

Partitioning means that Cassandra can distribute your data across multiple machines in an application-transparent matter. Cassandra will automatically repartition as machines are added and removed from the cluster. Row store means that like relational databases, Cassandra organizes data by rows and columns. The Cassandra Query Language (CQL) is a close relative of SQL.

Memcached

Memcached is an in-memory key-value store for small chunks of arbitrary data (strings, objects) from results of database calls, API calls, or page rendering.

MariaDB

Started by core members of the original MySQL team, MariaDB actively works with outside developers to deliver the most featureful, stable, and sanely licensed open SQL server in the industry. MariaDB is designed as a drop-in replacement of MySQL(R) with more features, new storage engines, fewer bugs, and better performance.

RethinkDB

RethinkDB is built to store JSON documents, and scale to multiple machines with very little effort. It has a pleasant query language that supports really useful queries like table joins and group by, and is easy to setup and learn.

ArangoDB

A distributed free and open-source database with a flexible data model for documents, graphs, and key-values. Build high performance applications using a convenient SQL-like query language or JavaScript extensions.

InfluxDB

InfluxDB is a scalable datastore for metrics, events, and real-time analytics. It has a built-in HTTP API so you don't have to write any server side code to get up and running. InfluxDB is designed to be scalable, simple to install and manage, and fast to get data in and out.