Skip to main content
Page 1

Offline LLM Evaluation: Step-by-Step GenAI Application Assessment on Databricks

December 13, 2023 by Abe Omorogbe, Liang Zhang, Sunish Sheth, Corey Zumar, Maheswaran Venkatachalam, Emil Lysgaard and Mathias Christiansen in Engineering Blog
Background In an era where Retrieval-Augmented Generation (RAG) is revolutionizing the way we interact with AI-driven applications, ensuring the efficiency and effectiveness of...

Announcing MLflow 2.8 LLM-as-a-judge metrics and Best Practices for LLM Evaluation of RAG Applications, Part 2

October 31, 2023 by Quinn Leng, Kasey Uhlenhuth, Alkis Polyzotis, Abe Omorogbe and Sunish Sheth in Engineering Blog
Today we're excited to announce MLflow 2.8 supports our LLM-as-a-judge metrics which can help save time and costs while providing an approximation of...

Announcing MLflow 2.4: LLMOps Tools for Robust Model Evaluation

June 7, 2023 by Corey Zumar, Hubert Zub, Kasey Uhlenhuth, Prithvi Kannan, Ridhima Gupta, Sunish Sheth, Harutaka Kawamura and Ann Zhang in Machine Learning
LLMs present a massive opportunity for organizations of all scales to quickly build powerful applications and deliver business value. Where data scientists used...

Introducing MLflow 2.3: Enhanced with Native LLMOps Support and New Features

April 17, 2023 by Ben Wilson, Harutaka Kawamura, Liang Zhang, Corey Zumar, Jin Zhang and Sunish Sheth in Platform Blog
With over 11 million monthly downloads, MLflow has established itself as the premier platform for end-to-end MLOps, empowering teams of all sizes to...

Accelerate your model development with the new MLflow Experiments UI

February 16, 2023 by Ridhima Gupta, Hubert Zub, Prithvi Kannan, Apurva Koti, Sunish Sheth and Corey Zumar in Engineering Blog
MLflow is the premier platform for model development and experimentation. Thousands of data scientists use MLflow Experiment Tracking every day to find the...