Skip to main content
Page 1

Introducing Mixtral 8x7B with Databricks Model Serving

December 21, 2023 by Ahmed Bilal, Daya Khudia, Ankit Mathur, Asfandyar Qureshi, Bruce Fontaine, Linden Li, Maddie Dawson, Sandeep Krishnamurthy, Josh Hartman and Hagay Lupesko in Engineering Blog
Today, Databricks is excited to announce support for Mixtral 8x7B in Model Serving . Mixtral 8x7B is a sparse Mixture of Experts (MoE)...

LLM Training on Unity Catalog data with MosaicML Streaming Dataset

October 17, 2023 by Xiaohan Zhang, Maddie Dawson and Karan Jariwala in Mosaic Research
Introduction Large Language Models (LLMs) have given us a way to generate text, extract information, and identify patterns in industries from healthcare to...

Databricks ❤️ Hugging Face

April 25, 2023 by Ali Ghodsi, Patrick Wendell, Maddie Dawson, Lu Wang, Xiangrui Meng and Nicolas Pelaez in Open Source
Generative AI has been taking the world by storm. As the data and AI company, we have been on this journey with the...

Getting started with NLP using Hugging Face transformers pipelines

February 6, 2023 by Paul Ogilvie and Maddie Dawson in Engineering Blog
Advances in Natural Language Processing (NLP) have unlocked unprecedented opportunities for businesses to get value out of their text data. Natural Language Processing...