Architecting MLOps on the Lakehouse
Here at Databricks, we have helped thousands of customers put Machine Learning (ML) into production. Shell has over 160 active AI projects saving...
Page 1
>
Three Principles for Selecting Machine Learning Platforms
This blog post is the second in a series on ML platforms, operations, and governance. For the first post, see Rafi Kurlansik’s post...
Scaling Hyperopt to Tune Machine Learning Models in Python
Try the Hyperopt notebook to reproduce the steps outlined below and watch our on-demand webinar to learn more. Hyperopt is one of the...
Automated Hyperparameter Tuning, Scaling and Tracking: On-Demand Webinar and FAQs now available!
Try this notebook in Databricks On June 20th, our team hosted a live webinar— Automated Hyperparameter Tuning, Scaling and Tracking on Databricks —with...
Hyperparameter Tuning with MLflow, Apache Spark MLlib and Hyperopt
Hyperparameter tuning is a common technique to optimize machine learning models based on hyperparameters, or configurations that are not learned during model training...
Enhanced Hyperparameter Tuning and Optimized AWS Storage with Databricks Runtime 5.4 ML
We are excited to announce the release of Databricks Runtime 5.4 ML ( Azure | AWS ). This release includes two Public Preview...
Databricks Runtime 5.2 ML Features Multi-GPU Workflow, Pregel API, and Performant GraphFrames
We are excited to announce the release of Databricks Runtime 5.2 for Machine Learning. This release includes several new features and performance improvements...
Introducing HorovodRunner for Distributed Deep Learning Training
Today, we are excited to introduce HorovodRunner in our Databricks Runtime 5.0 ML ! HorovodRunner provides a simple way to scale up your...
Databricks Engineering Interns & Impact in Summer 2018
Thanks to our awesome interns! This summer, our Engineering interns at Databricks did amazing work. Our interns, working on teams from Developer Tools...
Developing Custom Machine Learning Algorithms in PySpark
Developing custom Machine Learning (ML) algorithms in PySpark—the Python API for Apache Spark—can be challenging and laborious. In this blog post, we describe...