Building DBRX-class Custom LLMs with Mosaic AI TrainingMay 14, 2024 by Anna Pfohl, Cheng Li, Mihir Patel, Wai Wu, Will Gleich, Ajay Saini and Hagay Lupesko in Mosaic Research We recently introduced DBRX : an open, state-of-the-art, general-purpose LLM. DBRX was trained, fine-tuned, and evaluated using Mosaic AI Training, scaling training to...
Turbocharged Training: Optimizing the Databricks Mosaic AI Stack With FP8March 21, 2024 by Mihir Patel, Cheng Li, Davis Blalock and Saaketh Narayan in Mosaic Research At Databricks, we believe that the best companies in the world, in every sector, will have AI-powered systems that are trained and customized...