Building File-Based Applications with Unity Catalog Volumes
OVERVIEW
EXPERIENCE | In Person |
---|---|
TYPE | Breakout |
TRACK | Data Governance |
INDUSTRY | Enterprise Technology |
TECHNOLOGIES | Data Sharing, AI/Machine Learning, Governance |
SKILL LEVEL | Intermediate |
DURATION | 40 min |
DOWNLOAD SESSION SLIDES |
Are you looking to build file-based applications that can handle extensive collections of non-tabular data, regardless of the data format? Unity Catalog Volumes provide a solution for accessing, storing, processing, and sharing files of any format, including structured, semi-structured, and unstructured data. With Volumes, you can manage non-tabular data alongside tabular data and models in Unity Catalog, ensuring a unified discovery and governance for all your data and AI assets. Whether you need to read directories, process files, create and write new ones, or work with files using specific libraries and tools, Volumes have you covered. In this session, you'll discover the full capabilities of Volumes and how they can help you build scalable file-based applications using Spark APIs, REST APIs, native file libraries, SQL connectors, SDKs, and more. Plus, you'll see how to use Volumes for AI and Ingestion use cases in action.
SESSION SPEAKERS
Adriana Ispas
/Sr. Staff Product Manager
Databricks
Adrian Ionescu
/Staff Software Engineer
Databricks