Session
Use External Models in Databricks: Connecting to Azure, AWS, GCP, Anthropic and More
Overview
| Experience | In Person |
|---|---|
| Type | Breakout |
| Track | Artificial Intelligence |
| Industry | Enterprise Technology |
| Technologies | MLFlow, Llama, Mosaic AI |
| Skill Level | Intermediate |
| Duration | 40 min |
In this session you will learn how to leverage a wide set of GenAI models in Databricks, including external connections to cloud vendors and other model providers. We will cover establishing connection to externally served models, via Mosaic AI Gateway. This will showcase connection to Azure, AWS & GCP models, as well as model vendors like Anthropic, Cohere, AI21 Labs and more. You will also discover best practices on model comparison, governance and cost control on those model deployments.
Session Speakers
Ina Koleva
/Staff Product Manager
Databricks