Introducing the Open Variant Data Type in Delta Lake and Apache Spark
We are excited to announce a new data type called variant for semi-structured data. Variant provides an order of magnitude performance improvements compared...
Announcing Mosaic AI Vector Search General Availability in Databricks
Following the announcement we made around a suite of tools for Retrieval Augmented Generation, today we are thrilled to announce the general availability...
Research Survey: Productivity benefits from Databricks Assistant
In the fast-paced landscape of data science and engineering, integrating Artificial Intelligence (AI) has become integral for enhancing productivity. We’ve seen many tools...
Accelerate GenAI App Development with New Updates to Databricks Model Serving
Last year, we launched foundation model support in Databricks Model Serving to enable enterprises to build secure and custom GenAI apps on a...
Production-Quality RAG Applications with Databricks
In December, we announced a new suite of tools to get Generative AI applications to production using Retrieval Augmented Generation (RAG). Since then...
Databricks Assistant Tips & Tricks for Data Engineers
The generative AI revolution is transforming the way that teams work, and Databricks Assistant leverages the best of these advancements. It allows you...
How we improved DatabricksIQ LLM quality for AI-generated table comments
We recently made significant improvements to the underlying algorithms supporting AI-generated comments in Unity Catalog and we’re excited to share our results. Through...
Building Enterprise GenAI Apps with Meta Llama 3 on Databricks
We are excited to partner with Meta to release the latest state-of-the-art large language model, Meta Llama 3 , on Databricks. With Llama...
Accelerated DBRX Inference on Mosaic AI Model Serving
Introduction In this blog post we dive into inference with DBRX, the open state-of-the-art large language model (LLM) created by Databricks (see Introducing...
Announcing General Availability of Ray on Databricks
We released Ray support public preview last year and since then, hundreds of Databricks customers have been using it for variety of use...