A platform to programmaticaly author, schedule and monitor data pipelines, by Airbnb
Developer framework to orchestrate multiple services and APIs into your software application using logic triggered by events and time. Build ETL processes, A/B testing, real-time alerts and personalized user experiences with custom logic. | It is a microservice orchestration platform which enables developers to build scalable applications without sacrificing productivity or reliability. Temporal server executes units of application logic, workflows, in a resilient manner that automatically handles intermittent failures, and retries failed operations. |
Workflows as code - Write domain logic directly in your application code. Include loops, wait function, parallel and asynchronous executions;Background Jobs Manager - Dispatch asynchronous jobs with one line of code;Error Handling - Prevent failures by writing automatic retries or fallback logic. View error data in a central location. Resume, retry or kill processes from the dashboard;Real-Time Monitoring - Insights into overall processes and execution history;Scheduler - Launch jobs on a recurring/delayed schedule or on a specific date;Hosted orchestration engine - Zenaton manages the queuing, and storing of database states and then executes tasks on your workers | Microservice orchestration platform;
Open Source;
Enables developers to build scalable applications;
A mature technology |
Statistics | |
GitHub Stars - | GitHub Stars 16.4K |
GitHub Forks - | GitHub Forks 1.2K |
Stacks 8 | Stacks 43 |
Followers 12 | Followers 35 |
Votes 12 | Votes 0 |
Pros & Cons | |
Pros
| No community feedback yet |
Integrations | |

Use Airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The Airflow scheduler executes your tasks on an array of workers while following the specified dependencies. Rich command lines utilities makes performing complex surgeries on DAGs a snap. The rich user interface makes it easy to visualize pipelines running in production, monitor progress and troubleshoot issues when needed.

Istio is an open platform for providing a uniform way to integrate microservices, manage traffic flow across microservices, enforce policies and aggregate telemetry data. Istio's control plane provides an abstraction layer over the underlying cluster management platform, such as Kubernetes, Mesos, etc.

It makes it easy to automate all your software workflows, now with world-class CI/CD. Build, test, and deploy your code right from GitHub. Make code reviews, branch management, and issue triaging work the way you want.

Azure Service Fabric is a distributed systems platform that makes it easy to package, deploy, and manage scalable and reliable microservices. Service Fabric addresses the significant challenges in developing and managing cloud apps.

It implements batch and streaming data processing jobs that run on any execution engine. It executes pipelines on multiple execution environments.

It is a fault tolerant framework. It has built-in load balancer, circuit breaker, retries, timeout and bulkhead features. It is open source and free of charge project.

A cloud-native microservices gateway completely configurable and extensible through JavaScript/Node.js built for ALL platforms and languages. Enterprise features are FREE thanks to the power of 3K+ ExpressJS battle hardened modules.

It is a JavaScript framework for writing data-centric HTTP microservices that run directly inside of ArangoDB.

It is a portable, event-driven runtime that makes it easy for developers to build resilient, stateless and stateful microservices that run on the cloud and edge and embraces the diversity of languages and developer frameworks.

It is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.