Integrating Apache Airflow and Databricks: Building ETL pipelines with Apache Spark - The Databricks Blog