How AI in Business is Revolutionized by Data Intelligence
AI is everywhere; on our cell phones, on our computers, and frequently in the headlines. But behind all the headlines, the use of...
Bringing MegaBlocks to Databricks
At Databricks, we’re committed to building the most efficient and performant training tools for large-scale AI models. With the recent release of DBRX...
DSPy on Databricks
Large language models (LLMs) have generated interest in effective human-AI interaction through optimizing prompting techniques. “Prompt engineering” is a growing methodology for tailoring...
Introducing DBRX: A New State-of-the-Art Open LLM
Today, we are excited to introduce DBRX, an open, general-purpose LLM created by Databricks. Across a range of standard benchmarks, DBRX sets a...
Turbocharged Training: Optimizing the Databricks Mosaic AI Stack With FP8
At Databricks, we believe that the best companies in the world, in every sector, will have AI-powered systems that are trained and customized...
Fast, Secure and Reliable: Enterprise-grade LLM Inference
Introduction After a whirlwind year of developments in 2023, many enterprises are eager to adopt increasingly capable generative AI models to supercharge their...
Fine-Grained Human Feedback
(This post written in collaboration with Zeqiu (Ellen) Wu and Yushi Hu , both PhD students affiliated with the University of Washington, and...
LIMIT: Less Is More for Instruction Tuning
How should you finetune a large language model for general-purpose question answering? One intriguing approach is that of supervised finetuning on a small...
US Air Force Hackathon: How Large Language Models Will Revolutionize USAF Flight Test
[DISTRIBUTION STATEMENT A. Approved for public release; Distribution is unlimited 412TW-PA-24004] The views expressed are those of the author and do not reflect...
OLMo Is Here, Powered by Databricks
As Chief Scientist (Neural Networks) at Databricks, I lead our research team toward the goal of giving everyone the ability to build and...