Skip to main content
Page 1
>
Engineering blog

Building Enterprise GenAI Apps with Meta Llama 3 on Databricks

We are excited to partner with Meta to release the latest state-of-the-art large language model, Meta Llama 3 , on Databricks. With Llama...
Platform blog

Announcing General Availability of Next-Generation Lakeview Dashboards

The next generation of Databricks SQL (DBSQL) dashboards, also known as Lakeview Dashboards, is now generally available on AWS and Azure. This new...
Engineering blog

Accelerated DBRX Inference on Mosaic AI Model Serving

Introduction In this blog post we dive into inference with DBRX, the open state-of-the-art large language model (LLM) created by Databricks (see Introducing...
Engineering blog

Announcing General Availability of Ray on Databricks

We released Ray support public preview last year and since then, hundreds of Databricks customers have been using it for variety of use...
Engineering blog

Announcing the State Reader API: The New "Statestore" Data Source

Databricks Runtime 14.3 includes a new capability that allows users to access and analyze Structured Streaming 's internal state data: the State Reader...
Industries category icon 1

PySpark in 2023: A Year in Review

With the releases of Apache Spark 3.4 and 3.5 in 2023, we focused heavily on improving PySpark performance, flexibility, and ease of use...
Engineering blog

GGML GGUF File Format Vulnerabilities

March 22, 2024 by Neil Archibald in Engineering Blog
The GGUF file format is a binary file format used for storing and loading model weights for the GGML library. The library documentation...
Engineering blog

Data Exfiltration Protection with Azure Databricks

In the previous blog , we discussed how to securely access Azure Data Services from Azure Databricks using Virtual Network Service Endpoints or...
Engineering blog

Implementing LLM Guardrails for Safe and Responsible Generative AI Deployment on Databricks

Introduction Let’s explore a common scenario – your team is eager to leverage open source LLMs to build chatbots for customer support interactions...
Engineering blog

Announcing the General Availability of Databricks Feature Serving

Today, we are excited to announce the general availability of Feature Serving. Features play a pivotal role in AI Applications, typically requiring considerable...