Amazon Managed Workflows for Apache Airflow logo

Amazon Managed Workflows for Apache Airflow

Highly available, secure, and managed workflow orchestration for Apache Airflow
2
3
+ 1
0

What is Amazon Managed Workflows for Apache Airflow?

It is a managed orchestration service for Apache Airflow1 that makes it easier to set up and operate end-to-end data pipelines in the cloud at scale. With Managed Workflows, you can use Airflow and Python to create workflows without having to manage the underlying infrastructure for scalability, availability, and security. Managed Workflows automatically scales its workflow execution capacity to meet your needs, and is integrated with AWS security services to help provide you with fast and secure access to data.
Amazon Managed Workflows for Apache Airflow is a tool in the Workflow Manager category of a tech stack.

Who uses Amazon Managed Workflows for Apache Airflow?

Amazon Managed Workflows for Apache Airflow Integrations

Amazon S3, AWS Lambda, Amazon CloudWatch, Amazon DynamoDB, and Amazon SQS are some of the popular tools that integrate with Amazon Managed Workflows for Apache Airflow. Here's a list of all 15 tools that integrate with Amazon Managed Workflows for Apache Airflow.

Amazon Managed Workflows for Apache Airflow's Features

  • Deploy Airflow rapidly at scale
  • Run Airflow with built-in security
  • Reduce operational costs
  • Use a pre-existing plugin or use your own

Amazon Managed Workflows for Apache Airflow Alternatives & Comparisons

What are some alternatives to Amazon Managed Workflows for Apache Airflow?
Airflow
Use Airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The Airflow scheduler executes your tasks on an array of workers while following the specified dependencies. Rich command lines utilities makes performing complex surgeries on DAGs a snap. The rich user interface makes it easy to visualize pipelines running in production, monitor progress and troubleshoot issues when needed.
GitHub Actions
It makes it easy to automate all your software workflows, now with world-class CI/CD. Build, test, and deploy your code right from GitHub. Make code reviews, branch management, and issue triaging work the way you want.
Apache Beam
It implements batch and streaming data processing jobs that run on any execution engine. It executes pipelines on multiple execution environments.
Camunda
It is an open source platform for workflow and decision automation that brings business users and software developers together.
Luigi
It is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
See all alternatives
Related Comparisons
No related comparisons found

Amazon Managed Workflows for Apache Airflow's Followers
3 developers follow Amazon Managed Workflows for Apache Airflow to keep up with related blogs and decisions.