Flyway vs Kafka Manager: What are the differences?
Developers describe Flyway as "Database Migrations Made Easy". Easy to setup, simple to master. Flyway lets you regain control of your database migrations with pleasure and plain sql. Solves only one problem and solves it well. Flyway migrates your database, so you don't have to worry about it anymore. On the other hand, Kafka Manager is detailed as "A tool for managing Apache Kafka, developed by Yahoo". This interface makes it easier to identify topics which are unevenly distributed across the cluster or have partition leaders unevenly distributed across the cluster. It supports management of multiple clusters, preferred replica election, replica re-assignment, and topic creation. It is also great for getting a quick bird’s eye view of the cluster.
Flyway and Kafka Manager are primarily classified as "Database" and "Message Queue" tools respectively.
Some of the features offered by Flyway are:
- Supported databases: Oracle, SQL Server, SQL Azure, DB2, DB2 z/OS, MySQL, MariaDB, Google Cloud SQL, PostgreSQL, Redshift, Vertica, H2, Hsql, Derby, SQLite
- Supported build tools: Maven, Gradle, Ant and SBT
- Works on: Windows, Mac OSX, Linux, Java and Android
On the other hand, Kafka Manager provides the following key features:
- Manage multiple clusters
- Easy inspection of cluster state (topics, brokers, replica distribution, partition distribution)
- Run preferred replica election
Flyway and Kafka Manager are both open source tools. Kafka Manager with 7.45K GitHub stars and 1.82K forks on GitHub appears to be more popular than Flyway with 4.16K GitHub stars and 904 GitHub forks.
According to the StackShare community, Flyway has a broader approval, being mentioned in 14 company stacks & 19 developers stacks; compared to Kafka Manager, which is listed in 8 company stacks and 4 developer stacks.
What is Flyway?
What is Kafka Manager?
Need advice about which tool to choose?Ask the StackShare community!
Why do developers choose Kafka Manager?
What are the cons of using Kafka Manager?
Sign up to get full access to all the companiesMake informed product decisions
Sign up to get full access to all the tool integrationsMake informed product decisions
Why we built Marmaray, an open source generic data ingestion and dispersal framework and library for Apache Hadoop :
Built and designed by our Hadoop Platform team, Marmaray is a plug-in-based framework built on top of the Hadoop ecosystem. Users can add support to ingest data from any source and disperse to any sink leveraging the use of Apache Spark . The name, Marmaray, comes from a tunnel in Turkey connecting Europe and Asia. Similarly, we envisioned Marmaray within Uber as a pipeline connecting data from any source to any sink depending on customer preference:
(Direct GitHub repo: https://github.com/uber/marmaray Kafka Kafka Manager )
Flyway vs Liquibase #Migration #Backwards-compatible
We were looking for a tool to help us integrating the migration scripts as part of our Deployment. At first sight both tools look very alike, are well integrated with Spring, have a fairly frequent development activity and short release cycles.
Liquibase puts a lot of emphasis on independence with the DB, allowing you to create the scripts on formats like JSON and YML, abstracting away from SQL, which it's also supported. Since we only work with one DB type across services we wouldn't take much advantage of this feature.
Flyway on the other hand has the advantage on being actively working on the integration with PostgreSQL 11, for it's upcoming version 6. Provides a more extensive set of properties that allow us to define what's allowed on what's not on each different environment.
Instead of looking for a tool that will allow us to rollback our DB changes automatically, we decided to implement backwards-compatible DB changes, for example adding a new column instead of renaming an existing one, postponing the deletion of the deprecated column until the release has been successfully installed.
it works with complex SQL script and it is very high customizable.