How we improved DatabricksIQ LLM quality for AI-generated table comments
We recently made significant improvements to the underlying algorithms supporting AI-generated comments in Unity Catalog and we’re excited to share our results. Through...
Building Enterprise GenAI Apps with Meta Llama 3 on Databricks
We are excited to partner with Meta to release the latest state-of-the-art large language model, Meta Llama 3 , on Databricks. With Llama...
Accelerated DBRX Inference on Mosaic AI Model Serving
Introduction In this blog post we dive into inference with DBRX, the open state-of-the-art large language model (LLM) created by Databricks (see Introducing...
Announcing General Availability of Ray on Databricks
We released Ray support public preview last year and since then, hundreds of Databricks customers have been using it for variety of use...
Announcing the State Reader API: The New "Statestore" Data Source
Databricks Runtime 14.3 includes a new capability that allows users to access and analyze Structured Streaming 's internal state data: the State Reader...
PySpark in 2023: A Year in Review
With the releases of Apache Spark 3.4 and 3.5 in 2023, we focused heavily on improving PySpark performance, flexibility, and ease of use...
GGML GGUF File Format Vulnerabilities
The GGUF file format is a binary file format used for storing and loading model weights for the GGML library. The library documentation...
Data Exfiltration Protection with Azure Databricks
Last updated on: August 23, 2024 In the previous blog , we discussed how to securely access Azure Data Services from Azure Databricks...
Implementing LLM Guardrails for Safe and Responsible Generative AI Deployment on Databricks
Introduction Let’s explore a common scenario – your team is eager to leverage open source LLMs to build chatbots for customer support interactions...
Announcing the General Availability of Databricks Feature Serving
Today, we are excited to announce the general availability of Feature Serving. Features play a pivotal role in AI Applications, typically requiring considerable...