Bringing MegaBlocks to Databricks
At Databricks, we’re committed to building the most efficient and performant training tools for large-scale AI models. With the recent release of DBRX...
DSPy on Databricks
Large language models (LLMs) have generated interest in effective human-AI interaction through optimizing prompting techniques. “Prompt engineering” is a growing methodology for tailoring...
Introducing DBRX: A New State-of-the-Art Open LLM
Today, we are excited to introduce DBRX, an open, general-purpose LLM created by Databricks. Across a range of standard benchmarks, DBRX sets a...
Turbocharged Training: Optimizing the Databricks Mosaic AI Stack With FP8
At Databricks, we believe that the best companies in the world, in every sector, will have AI-powered systems that are trained and customized...
Fast, Secure and Reliable: Enterprise-grade LLM Inference
Introduction After a whirlwind year of developments in 2023, many enterprises are eager to adopt increasingly capable generative AI models to supercharge their...
Fine-Grained Human Feedback
(This post written in collaboration with Zeqiu (Ellen) Wu and Yushi Hu , both PhD students affiliated with the University of Washington, and...
LIMIT: Less Is More for Instruction Tuning
How should you finetune a large language model for general-purpose question answering? One intriguing approach is that of supervised finetuning on a small...
US Air Force Hackathon: How Large Language Models Will Revolutionize USAF Flight Test
[DISTRIBUTION STATEMENT A. Approved for public release; Distribution is unlimited 412TW-PA-24004] The views expressed are those of the author and do not reflect...
OLMo Is Here, Powered by Databricks
As Chief Scientist (Neural Networks) at Databricks, I lead our research team toward the goal of giving everyone the ability to build and...
Serving Quantized LLMs on NVIDIA H100 Tensor Core GPUs
Quantization is a technique for making machine learning models smaller and faster. We quantize Llama2-70B-Chat, producing an equivalent-quality model that generates 2.2x more...