Deploy and Scale AI Models With Mosaic Model Serving

Ever struggled with getting your AI models into production? Join us to discover how Databricks' Mosaic AI Model Serving takes the headache out of deploying both traditional ML and generative AI models at scale. This session demonstrates how to implement a highly available, auto-scaling service that optimizes performance while controlling costs. Discover deployment strategies for various model types—from custom models to foundation models like Llama 4 and external models from OpenAI and Anthropic—with proper governance through Mosaic AI Gateway.

Key takeaways:

• Selecting optimal deployment approaches based on use case and performance needs
• Integrating models with enterprise data using Feature Store and Vector Search
• Monitoring deployed models and ensuring security compliance
• Implementing efficient batch inference for large-scale processing