Introducing ‘Managed Airflow’ in Azure Data Factory

Hey AirFlow users,

I would like to share the news about Managed Airflow in Azure, the text below was extracted from here.

We are excited to announce the capability to run Apache Airflow DAGs (Directed Acyclic Graph) within Azure Data Factory, adding a key Open-Source integration that provides extensibility for orchestrating python-based workflows at scale on Azure.

Azure Data Factory Managed Airflow provides a managed orchestration service for Apache Airflow that simplifies the creation and management of Airflow environments. In addition, it natively integrates Apache Airflow with Azure Active Directory for a single sign-on (SSO) and a more secure solution (instead of requiring basic auth for logins).

What is Apache Airflow?

Apache Airflow is an open-source tool used to programmatically author, schedule, and monitor sequences of processes and tasks referred to as “workflows.”

In Airflow, a DAG — or a Directed Acyclic Graph — is a collection of all the tasks you want to run, organized to reflect their relationships and dependencies. A DAG is defined in a Python script, representing the DAGs structure (tasks and their dependencies) as code.