Orchestrate and Run Your dbt Jobs

dbt is a popular data framework to transform and load data into your lakehouse. Databricks makes it very easy to launch production-grade dbt pipelines using your Databricks SQL warehouse.

In this dbt and Databricks demo, we'll cover:

• How to build a dbt pipeline to ingest your customer data sets. (We'll be building the same pipeline as the one available in the 'lakehouse-retail-c360' demo).
• How to start your dbt pipeline from your idea.
• And ultimately how Databricks Workflows can start dbt tasks to orchestrate your production run.

Note: This demo will clone for you the repo
https://github.com/databricks-demos/dbt-databricks-c360 in your repo personal folder.

To install the demo, get a free Databricks workspace and execute the following two commands in a Python notebook

%pip install dbdemos

import dbdemos
dbdemos.install('dbt-on-databricks')

Dbdemos is a Python library that installs complete Databricks demos in your workspaces. Dbdemos will load and start notebooks, Delta Live Tables pipelines, clusters, Databricks SQL dashboards, warehouse models … See how to use dbdemos

Dbdemos is distributed as a GitHub project.

For more details, please view the GitHub README.md file and follow the documentation.
Dbdemos is provided as is. See the License and Notice for more information.
Databricks does not offer official support for dbdemos and the associated assets.
For any issue, please open a ticket and the demo team will have a look on a best-effort basis.