Albertsons - Near Realtime Model Serving with Databricks Serverless

In this session, we will present our unique use case to provide a model serving for an internal pricing analytics application that triggers thousands of models in a single click and expects to receive a response in near real-time. We will provide an in-depth overview of how we have achieved this complex requirement through our in-house developed model serving framework and Databricks serverless compute. Attendees will leave with an idea of a model serving framework, how to make it more generic, and techniques they can use to employ the models and how to use Databricks serverless compute option effectively to achieve the performance at scale and keep the costs at a minimum.