Deploy Llama 2 with Databricks Lakehouse AI

What you’ll learn

Discover how to download and serve Llama 2 models from Databricks Marketplace.

Llama 2 foundation chat models are now available in the Databricks Marketplace for fine-tuning and deployment on private model serving endpoints.

Each model is wrapped in MLflow and saved within Unity Catalog, making it easy to use the MLflow evaluation in notebooks and to deploy with a single click on LLM-optimized GPU model serving endpoints.

These endpoints are pre-configured and accelerated to serve foundational models, providing the best cost/performance ratio.

Launch product tour

Recommended

<p>Build High-Quality RAG Apps with Mosaic AI Agent Framework and Agent Evaluation, Model Serving, and Vector Search</p>

Tutorial

Build High-Quality RAG Apps with Mosaic AI Agent Framework and Agent Evaluation, Model Serving, and Vector Search

<p>How to Use AutoML to Develop ML Models</p>

On-Demand Video

How to Use AutoML to Develop ML Models

<p>Lakehouse Monitoring and Vector Search</p>

On-Demand Video

Lakehouse Monitoring and Vector Search