Got Metrics? Build a Metric Store - A tour of Databricks at Databricks

I have Metrics, You have Metrics, we all have Metrics. The problem isn’t whether we have metrics. The problem is we all have metrics, the numbers never line up, and we spend endless cycles trying to make sense of why. This is our story from our very own Data Team @ Databricks and how we built a Metric Store to solve the fundamental problem with Metrics, Business Intelligence, and data operations. Imagine a world where the numbers line up, all the time. Where changing metric definitions are consistently applied globally without lengthy projects. Imagine a world where ALL metrics have ML based forecasting, AI based anomaly detection, and automatic explainability out of the box. This is a practical talk based on our own journey. We will cover our motivations, technical challenges, solutions and the world-class Data Warehouse unlocked. We will cover an overview of the main capabilities built directly into our Metric Store, why they work, and how you can get started today.