Upgrade Table to Unity Catalog with UCX and Hive Metastore Federation

Unity Catalog is a unified governance solution for all data and AI assets, including files, tables, machine learning models, and dashboards, within your Data Intelligence Platform on any cloud.

In this demo, we’ll show you how to upgrade your existing tables from the legacy Hive metastore catalog to Unity Catalog. You will then be able to leverage all Unity Catalog capabilities, such as security, ACLs, row-level access, lineage tracking, auditing, and more.

This demo includes:

• An introduction to UCX, the automated toolkit for migration, which encompasses dashboards, jobs, and notebooks.

• Setting up Databricks Hive Metastore Federation.

• Examples using the UI as well as custom scripts to upgrade an entire database, including handling external locations and managed tables.

 

To install the demo, get a free Databricks workspace and execute the following two commands in a Python notebook

Dbdemos is a Python library that installs complete Databricks demos in your workspaces. Dbdemos will load and start notebooks, DLT pipelines, clusters, Databricks SQL dashboards, warehouse models … See how to use dbdemos

 

Dbdemos is distributed as a GitHub project.

For more details, please view the GitHub README.md file and follow the documentation.
Dbdemos is provided as is. See the License and Notice for more information.
Databricks does not offer official support for dbdemos and the associated assets.
For any issue, please open a ticket and the demo team will have a look on a best-effort basis.