Airflow vs StackStorm: What are the differences?
Airflow: A platform to programmaticaly author, schedule and monitor data pipelines, by Airbnb. Use Airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The Airflow scheduler executes your tasks on an array of workers while following the specified dependencies. Rich command lines utilities makes performing complex surgeries on DAGs a snap. The rich user interface makes it easy to visualize pipelines running in production, monitor progress and troubleshoot issues when needed; StackStorm: Open Source IFTTT for Ops: event-driven automation, security responses, auto-remediation with workflow engine & ChatOps. StackStorm is a platform for integration and automation across services and tools. It ties together your existing infrastructure and application environment so you can more easily automate that environment -- with a particular focus on taking actions in response to events.
Airflow and StackStorm are primarily classified as "Workflow Manager" and "Remote Server Task Execution" tools respectively.
Some of the features offered by Airflow are:
- Dynamic: Airflow pipelines are configuration as code (Python), allowing for dynamic pipeline generation. This allows for writting code that instantiate pipelines dynamically.
- Extensible: Easily define your own operators, executors and extend the library so that it fits the level of abstraction that suits your environment.
- Elegant: Airflow pipelines are lean and explicit. Parameterizing your scripts is built in the core of Airflow using powerful Jinja templating engine.
On the other hand, StackStorm provides the following key features:
- Automations tie events to actions you’d like to take, using a rules engine and, if you want, comprehensive workflow. Automations are your operational patterns summarized as code.
- StackStorm automations work either by starting with your existing scripts – just add simple meta data – or by authoring the automations within StackStorm.
- Automations are the heart of StackStorm – they allow you to share operational patterns, boost productivity, and automate away the routine.
Airflow and StackStorm are both open source tools. Airflow with 13.3K GitHub stars and 4.91K forks on GitHub appears to be more popular than StackStorm with 3.36K GitHub stars and 445 GitHub forks.
According to the StackShare community, Airflow has a broader approval, being mentioned in 98 company stacks & 162 developers stacks; compared to StackStorm, which is listed in 6 company stacks and 20 developer stacks.