Turbocharged Training: Optimizing the Databricks Mosaic AI Stack With FP8March 21, 2024 by Mihir Patel, Cheng Li, Davis Blalock and Saaketh Narayan in Mosaic Research At Databricks, we believe that the best companies in the world, in every sector, will have AI-powered systems that are trained and customized...
MosaicML StreamingDataset: Fast, Accurate Streaming of Training Data from Cloud StorageFebruary 9, 2023 by James Knighton, Karan Jariwala, Davis Blalock and Erica Ji Yuen in Mosaic Research Loading your training data becomes an escalating challenge as datasets grow bigger in size and the number of nodes scales. We built StreamingDataset...