A Pattern for the Lightweight Deployment of Distributed XGBoost and LightGBM ModelsOctober 6, 2023 by Jesse Heravi, Sean Owen, Marshall Carter, Nichole Lu and Bryan Smith in Engineering Blog A common challenge data scientists encounter when developing machine learning solutions is training a model on a dataset that is too large to...
Rapid NLP Development With Databricks, Delta, and TransformersSeptember 9, 2022 by Marshall Carter in Engineering Blog Free form text data can offer actionable insights unavailable in structured data fields. An insurance company may leverage its claims adjusters’ notes to...
Parallel ML: How Compass Built a Framework for Training Many Machine Learning Models on DatabricksJuly 20, 2022 by Marshall Carter and Sujoy Dutta in Engineering Blog This is a collaborative post from Databricks and Compass . We thank Sujoy Dutta, Senior Machine Learning Engineer at Compass, for his contributions...