Airflow vs Shipyard
Overview
Share your Stack
Help developers discover the tools you use. Get visibility for your team's tech choices and contribute to the community's knowledge.
CLI (Node.js)
Manual
Detailed Comparison
Use Airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The Airflow scheduler executes your tasks on an array of workers while following the specified dependencies. Rich command lines utilities makes performing complex surgeries on DAGs a snap. The rich user interface makes it easy to visualize pipelines running in production, monitor progress and troubleshoot issues when needed. | na |
Dynamic: Airflow pipelines are configuration as code (Python), allowing for dynamic pipeline generation. This allows for writting code that instantiate pipelines dynamically.;Extensible: Easily define your own operators, executors and extend the library so that it fits the level of abstraction that suits your environment.;Elegant: Airflow pipelines are lean and explicit. Parameterizing your scripts is built in the core of Airflow using powerful Jinja templating engine.;Scalable: Airflow has a modular architecture and uses a message queue to talk to orchestrate an arbitrary number of workers. Airflow is ready to scale to infinity. | - |
Statistics | |
Stacks 1.7K | Stacks 3 |
Followers 2.8K | Followers 4 |
Votes 128 | Votes 5 |
Pros & Cons | |
Pros
Cons
| Pros
|
What are some alternatives to Airflow, Shipyard?
GitHub Actions
It makes it easy to automate all your software workflows, now with world-class CI/CD. Build, test, and deploy your code right from GitHub. Make code reviews, branch management, and issue triaging work the way you want.
Apache Beam
It implements batch and streaming data processing jobs that run on any execution engine. It executes pipelines on multiple execution environments.
Zenaton
Developer framework to orchestrate multiple services and APIs into your software application using logic triggered by events and time. Build ETL processes, A/B testing, real-time alerts and personalized user experiences with custom logic.
Luigi
It is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
Unito
Build and map powerful workflows across tools to save your team time. No coding required. Create rules to define what information flows between each of your tools, in minutes.
Flow-Like
Mission-critical automation you can audit, control and run on-prem. No black boxes. No silent failures. No data leaks. Built for teams that cannot afford uncertainty.
ETLR
Production-grade workflow automation. No drag-and-drop required. Build, version, and deploy your workflows with YAML.
Fermi Dev
Is the AI Operational Brain for Modern Enterprises. Connect your systems, build dynamic models, and automate business processes with intelligent agents.
Vison AI
Hire AI Employees that deliver Human-Quality work. Automate repetitive tasks, scale effortlessly, and focus on business growth without increasing head count.
Page d'accueil
Thaink² Analytics, la plateforme data et IA de nouvelles génération pour gérer vos projets de bout-en-bout. Fini les pipelines de données instables, les modèles ML/IA qui restent au stade du POC.
