Need advice about which tool to choose?Ask the StackShare community!
Add tool
Pros of Airflow
Pros of dbt
Pros of Airflow
- Features36
- Beautiful UI11
- Task Dependency Management10
- Extensibility9
- Cluster of workers9
- Python4
- Open source4
- Complex workflows3
- Dashboard2
- K2
- Custom operators2
- Good api1
- Apache project1
Pros of dbt
- Easy for SQL programmers to learn1
Sign up to add or upvote prosMake informed product decisions
Sign up to add or upvote consMake informed product decisions
- No public GitHub repository available -
What is Airflow?
Use Airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The Airflow scheduler executes your tasks on an array of workers while following the specified dependencies. Rich command lines utilities makes performing complex surgeries on DAGs a snap. The rich user interface makes it easy to visualize pipelines running in production, monitor progress and troubleshoot issues when needed.
What is dbt?
dbt - Documentation
Need advice about which tool to choose?Ask the StackShare community!
Jobs that mention Airflow and dbt as a desired skillset
What companies use Airflow?
What companies use dbt?
Sign up to get full access to all the companiesMake informed product decisions
What tools integrate with Airflow?
What tools integrate with dbt?
What tools integrate with Airflow?
What tools integrate with dbt?
What are some alternatives to Airflow and dbt?
Luigi
It is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
Apache NiFi
An easy to use, powerful, and reliable system to process and distribute data. It supports powerful and scalable directed graphs of data routing, transformation, and system mediation logic.
Jenkins
In a nutshell Jenkins CI is the leading open-source continuous integration server. Built with Java, it provides over 300 plugins to support building and testing virtually any project.
AWS Step Functions
AWS Step Functions makes it easy to coordinate the components of distributed applications and microservices using visual workflows. Building applications from individual components that each perform a discrete function lets you scale and change applications quickly.
Pachyderm
Pachyderm is an open source MapReduce engine that uses Docker containers for distributed computations.
Interest over time
News about dbt
More news