SESSION

Databricks Streaming: Project Lightspeed Goes Hyperspeed

Accept Cookies to Play Video

OVERVIEW

EXPERIENCEIn Person
TYPEBreakout
TRACKData Engineering and Streaming
TECHNOLOGIESDatabricks Experience (DBX), Apache Spark, ETL
SKILL LEVELAdvanced
DURATION40 min
DOWNLOAD SESSION SLIDES

For two years, Project Lightspeed has focused on next-gen streaming data processing with Spark Structured Streaming. This year, we’ve made some incredible strides in ultra low-latency processing.

 

Join us for a deep dive into the most powerful streaming data platform on the planet. We’ll cover topics like

  • Shocking new latency benchmarks for UC-enabled serverless streaming pipelines
  • New stateful processing capabilities including transformWithState and State Reader APIs
  • The new Apache Pulsar connector
  • Structured Streaming x DLT Pipelines roadmap

 

According to IDC, 12 of the top 15 AI use cases across banking, manufacturing, retail, government, and utilities require real-time data. Also, according to IDC, Databricks is the worldwide leader in analytic stream processing. See how to deliver the right data at the right time with data streaming on the Databricks Data Intelligence Platform.

SESSION SPEAKERS

Ryan Nienhuis

/Sr. Staff Product Manager
Databricks

Praveen Gattu

/Sr. Software Dev Manager
Databricks