Announcing Inference Tables: Simplified Monitoring and Diagnostics for AI modelsOctober 5, 2023 by Ahmed Bilal, Steven Chen, Kasey Uhlenhuth, Joshua Hartman, Alkis Polyzotis and Viswesh Periyasamy in Platform Blog Have you ever deployed an AI model, only to discover it's delivering unexpected results in a real-world setting? Monitoring models is as crucial...
Deploy Private LLMs using Databricks Model ServingSeptember 28, 2023 by Ahmed Bilal, Ankit Mathur, Kasey Uhlenhuth and Joshua Hartman in Engineering Blog We are excited to announce public preview of GPU and LLM optimization support for Databricks Model Serving! With this launch, you can deploy...