SESSION
Databricks Streaming: Project Lightspeed Goes Hyperspeed
OVERVIEW
EXPERIENCE | In Person |
---|---|
TYPE | Breakout |
TRACK | Data Engineering and Streaming |
TECHNOLOGIES | Databricks Experience (DBX), Apache Spark, ETL |
SKILL LEVEL | Advanced |
DURATION | 40 min |
DOWNLOAD SESSION SLIDES |
For two years, Project Lightspeed has focused on next-gen streaming data processing with Spark Structured Streaming. This year, we’ve made some incredible strides in ultra low-latency processing.
Join us for a deep dive into the most powerful streaming data platform on the planet. We’ll cover topics like
- Shocking new latency benchmarks for UC-enabled serverless streaming pipelines
- New stateful processing capabilities including transformWithState and State Reader APIs
- The new Apache Pulsar connector
- Structured Streaming x DLT Pipelines roadmap
According to IDC, 12 of the top 15 AI use cases across banking, manufacturing, retail, government, and utilities require real-time data. Also, according to IDC, Databricks is the worldwide leader in analytic stream processing. See how to deliver the right data at the right time with data streaming on the Databricks Data Intelligence Platform.
SESSION SPEAKERS
Ryan Nienhuis
/Sr. Staff Product Manager
Databricks
Praveen Gattu
/Sr. Software Dev Manager
Databricks