Need advice about which tool to choose?Ask the StackShare community!
Decisions about Hadoop, MySQL, and PostgreSQL
Jasmine Sun
Backend:
- Considering that our main app functionality involves data processing, we chose
Pythonas the programming language because it offers many powerful math libraries for data-related tasks. We will useFlaskfor the server due to its good integration with Python. We will use a relational database because it has good performance and we are mostly dealing with CSV files that have a fixed structure. We originally choseSQLite, but after realizing the limitations of file-based databases, we decided to switch toPostgreSQL, which has better compatibility with our hosting service,Heroku.
Anthony Simon
Lead Engineer at Stylight · | 20 upvotes · 28.2K views
I try to follow an 80/20 distribution when it comes to my choice of tools. This means my stack consists of about 80% software I already know well, but I do allow myself 20% of the stack to explore tech I have less experience with.
The exact ratio is not what’s important here, it’s more the fact that you should lean towards using proven technologies.
I wrote more about this on my blog post on Choosing Boring Technology: https://panelbear.com/blog/boring-tech/
Sergey Rodovinsky
CTO at Pushnami · | 5 upvotes · 47.9K views
We were looking at several alternative databases that would support following architectural requirements: - very quick prototyping for an unknown domain - ability to support large amounts of data - native ability to replicate and fail over - full stack approach for Node.js development After careful consideration MongoDB came on top, and 3 years later we are still very happy with that decision. Currently we keep almost 2TB of data in our cluster, and start thinking about sharding.
Pros of Hadoop
Pros of MySQL
Pros of PostgreSQL
Pros of Hadoop
- Great ecosystem38
- One stack to rule them all11
- Great load balancer4
- Java syntax1
Pros of MySQL
- Sql789
- Free674
- Easy557
- Widely used527
- Open source485
- High availability180
- Cross-platform support158
- Great community103
- Secure77
- Full-text indexing and searching75
- Fast, open, available25
- SSL support14
- Robust13
- Reliable13
- Enterprise Version8
- Easy to set up on all platforms7
- Easy, light, scalable1
- Relational database1
- NoSQL access to JSON data type1
- Sequel Pro (best SQL GUI)1
- Replica Support1
Pros of PostgreSQL
- Relational database755
- High availability506
- Enterprise class database437
- Sql379
- Sql + nosql299
- Great community171
- Easy to setup145
- Heroku129
- Secure by default128
- Postgis111
- Supports Key-Value48
- Great JSON support46
- Cross platform32
- Extensible29
- Replication25
- Triggers24
- Rollback22
- Multiversion concurrency control21
- Open source20
- Heroku Add-on17
- Stable, Simple and Good Performance14
- Powerful13
- Lets be serious, what other SQL DB would you go for?12
- Good documentation9
- Scalable7
- Intelligent optimizer7
- Transactional DDL6
- Modern6
- Reliable6
- One stop solution for all things sql no matter the os5
- Free5
- Relational database with MVCC4
- Full-Text Search3
- Developer friendly3
- Faster Development3
- Excellent source code2
- Great DB for Transactional system or Application2
- Free version1
- Text1
- Open-source1
- search1
- Full-text1
Sign up to add or upvote prosMake informed product decisions
Cons of Hadoop
Cons of MySQL
Cons of PostgreSQL
Cons of Hadoop
Be the first to leave a con
Cons of MySQL
- Owned by a company with their own agenda13
- Can't roll back schema changes1
Cons of PostgreSQL
- Table/index bloatings9
Sign up to add or upvote consMake informed product decisions
What is Hadoop?
The Apache Hadoop software library is a framework that allows for the distributed processing of large data sets across clusters of computers using simple programming models. It is designed to scale up from single servers to thousands of machines, each offering local computation and storage.
What is MySQL?
The MySQL software delivers a very fast, multi-threaded, multi-user, and robust SQL (Structured Query Language) database server. MySQL Server is intended for mission-critical, heavy-load production systems as well as for embedding into mass-deployed software.
What is PostgreSQL?
PostgreSQL is an advanced object-relational database management system
that supports an extended subset of the SQL standard, including
transactions, foreign keys, subqueries, triggers, user-defined types
and functions.
Need advice about which tool to choose?Ask the StackShare community!
Jobs that mention Hadoop, MySQL, and PostgreSQL as a desired skillset
What companies use Hadoop?
What companies use MySQL?
What companies use PostgreSQL?
Sign up to get full access to all the companiesMake informed product decisions
What tools integrate with Hadoop?
What tools integrate with MySQL?
What tools integrate with PostgreSQL?
What tools integrate with Hadoop?
What tools integrate with MySQL?
Sign up to get full access to all the tool integrationsMake informed product decisions
Blog Posts
+11 2
1505
+8 4
1310
+4 1
481
+6 2
1339
+2 5
1275
+8 7
3626
+16 5
1893
+32 17
4402
What are some alternatives to Hadoop, MySQL, and PostgreSQL?
Cassandra
Partitioning means that Cassandra can distribute your data across multiple machines in an application-transparent matter. Cassandra will automatically repartition as machines are added and removed from the cluster. Row store means that like relational databases, Cassandra organizes data by rows and columns. The Cassandra Query Language (CQL) is a close relative of SQL.
MongoDB
MongoDB stores data in JSON-like documents that can vary in structure, offering a dynamic, flexible schema. MongoDB was also designed for high availability and scalability, with built-in replication and auto-sharding.
Elasticsearch
Elasticsearch is a distributed, RESTful search and analytics engine capable of storing data and searching it in near real time. Elasticsearch, Kibana, Beats and Logstash are the Elastic Stack (sometimes called the ELK Stack).
Splunk
It provides the leading platform for Operational Intelligence. Customers use it to search, monitor, analyze and visualize machine data.
Snowflake
Snowflake eliminates the administration and management demands of traditional data warehouses and big data platforms. Snowflake is a true data warehouse as a service running on Amazon Web Services (AWS)—no infrastructure to manage and no knobs to turn.
Interest over time
News about Hadoop
Elasticsearch for Apache Hadoop 6.2.0 Released
(www.elastic.co)
Feb 6, 2018
How to Get Hadoop Data into a Python Model
(www.activestate.com)
Dec 20, 2017
Elasticsearch for Apache Hadoop 6.0.0 GA is Released
(www.elastic.co)
Nov 14, 2017
Introducing Spark Structured Streaming Support in ES-Hadoop 6.0
(www.elastic.co)
Aug 22, 2017
Elasticsearch for Apache Hadoop 6.0.0-beta1 released
(www.elastic.co)
Aug 8, 2017
News about MySQL
Invisible MySQL?
(elephantdolphin.blogspot.com)
about 18 hours ago
#WDILTW – What can I run from my AWS Aurora database
(ronaldbradford.com)
Feb 26, 2021
MySQL HeatWave: 1100x Faster than Aurora, 400x than RDS, 18x than Redshift at 1/3 the cost
(blogs.oracle.com)
1 day ago
Table Partitioning In MySQL NDB Cluster and What’s New (Part I)
(clustertesting.blogspot.com)
2 days ago
Evolving Schemaless into a Distributed SQL Database
(eng.uber.com)
8 days ago