SESSION
Implementing Optimization Solutions on Databricks
OVERVIEW
EXPERIENCE | In Person |
---|---|
TYPE | Breakout |
TRACK | Data Lakehouse Architecture |
TECHNOLOGIES | Delta Lake |
SKILL LEVEL | Intermediate |
DURATION | 40 min |
Traditional optimization techniques face challenges in scalability and efficiency due to the volume of data. We were able to explore different algorithms and tune them to execute on Databricks. The Databricks Platform enables us to process data and solve these problems at scale while integrating well with our existing infrastructure.
SESSION SPEAKERS
Bryan Liu
/Sr. Data Scientist
Effectv / Comcast
Jivitesh Poojary
/Lead ML Engineer
Effectv / Comcast