Apache Airflow
Control Plane · Orchestration & Scheduling
Open-source platform for authoring, scheduling and monitoring workflows defined as Python DAGs.
- Open source
Data tooling landscape
Control Plane
Decides what runs, when and how. Orchestration, infrastructure as code and CI/CD for data.
5 tools · 3 categories
Orchestration & Scheduling (1)
Infrastructure as Code (3)
Bicep
Control Plane · Infrastructure as Code
Microsoft's domain-specific language for declaratively deploying Azure resources.
- Open source
Databricks Asset Bundles
Control Plane · Infrastructure as Code
Defines Databricks jobs, pipelines and resources as code, deployed with the Databricks CLI.
- Commercial
Terraform
Control Plane · Infrastructure as Code
Infrastructure as code tool from HashiCorp, with providers for clouds and data platforms such as Databricks and Snowflake.
- Source available
DataOps & CI/CD (1)
Azure DevOps
Control Plane · DataOps & CI/CD
Microsoft's suite of repos, boards and CI/CD pipelines.
- Commercial