SESSION
What's New in Databricks Workflows - with Live Demos!
OVERVIEW
EXPERIENCE | In Person |
---|---|
TYPE | Breakout |
TRACK | Data Engineering and Streaming |
INDUSTRY | Enterprise Technology, Media and Entertainment, Retail and CPG - Food |
TECHNOLOGIES | ETL, Orchestration |
SKILL LEVEL | Intermediate |
DURATION | 40 min |
DOWNLOAD SESSION SLIDES |
Join the Databricks Workflows product team to learn about the latest capabilities of Databricks Workflows, the unified orchestrator for data, analytics, and AI on the Data Intelligence Platform. In this session, we’ll show how you can easily define, manage, and monitor multi-task workflows for ETL, analytics, and machine learning pipelines. This session will include useful demos and showcase some of the recent innovations the team has added to Workflows including:
- Repair runs for jobs and tasks with greater control
- Enhanced control flow using for-each and conditionals
- Improved job scheduling using file arrival and table triggers
- Authoring jobs in Python using Databricks Asset Bundles
SESSION SPEAKERS
Saad Ansari
/Product Management
Databricks
Roland Fäustlin
/Product Manager
Databricks