Deep Learning Tutorial Demonstrates How to Simplify Distributed Deep Learning Model Inference Using Delta Lake and Apache Spark™
On October 10th, our team hosted a live webinar—Simple Distributed Deep Learning Model Inference—with Xiangrui Meng, Software Engineer at Databricks. Model inference, unlike model training, is usually embarrassingly parallel and hence simple to distribute. However, in practice, complex data scenarios and compute infrastructure often make this "simple" task hard to do from data source to...
A Day at the 2019 Women in Product Conference
From left to right: Shveta, Julia, Yardley Pohl (a WIP board member and co-founder), Anna, Allie, Cyrielle, and Rani at the Databricks booth Databricks was a proud sponsor of the 2019 Women In Product conference which focuses on empowering women in product management and advocating for equal representation. We had a booth and happy hour...
Introducing the MLflow Model Registry
Watch the announcement and demo At today’s Spark + AI Summit in Amsterdam, we announced the availability of the MLflow Model Registry, a new component in the MLflow open source ML platform. Since we introduced MLflow at Spark+AI Summit 2018, the project has gained more than 140 contributors and 800,000 monthly downloads on PyPI, making...
A Guide to Women In Unified Analytics Events at Spark+AI Summit Europe
Spark + AI Summit is Europe’s largest data and machine learning conference, and the big news in 2019 is how many women are driving some of the greatest advances in big data, machine learning, and data science. This 15-17 October in Amsterdam, more than 1700 data scientists, engineers, and developers will gather to share best...
A Guide to MLflow Talks at Spark + AI Summit 2019 Europe
We are thrilled to see how well MLflow has been welcomed by the community since we launched it last summer. With now over 800K monthly downloads, 130 code contributors and dozens of contributing organizations including RStudio and Microsoft, it is one of the fastest growing open source projects in the field of Machine Learning, confirming...
A Guide to AI, Data Science, Machine Learning and Deep Learning Talks at Spark+AI Summit Europe 2019
The Spark + AI Summit Europe is just around the corner, and it's a great opportunity for data scientists and Machine Learning (ML) practitioners to get up to speed on the latest tools and innovations in the field! Below is a selection of talks on ML best practices for productionizing ML at scale, real-life use...
AutoML on Databricks: Augmenting Data Science from Data Prep to Operationalization
Thousands of data science jobs are going unfilled today as global demand for the talent greatly outstrips supply. Every day, businesses pay the price of the data scientist shortage in missed opportunities and slow innovation. For organizations to realize the full potential of machine learning, data teams have to build hundreds of predictive models a...
Automated Hyperparameter Tuning, Scaling and Tracking: On-Demand Webinar and FAQs now available!
On June 20th, our team hosted a live webinar—Automated Hyperparameter Tuning, Scaling and Tracking on Databricks—with Joseph Bradley, Software Engineer, and Yifan Cao, Senior Product Manager at Databricks. Automated Machine Learning (AutoML) has received significant interest recently because of its ability to shorten time-to-value for data science teams and maximize the predictive performance of models....
What’s new with MLflow? On-Demand Webinar and FAQs now available!
On June 6th, our team hosted a live webinar—Managing the Complete Machine Learning Lifecycle: What's new with MLflow—with Clemens Mewald, Director of Product Management at Databricks. Machine learning development brings many new complexities beyond the traditional software development lifecycle. Unlike in traditional software development, ML developers want to try multiple algorithms, tools and parameters to...
Announcing General Availability of Managed MLflow on Databricks
MLflow is an open source platform to help manage the complete machine learning lifecycle. With MLflow, data scientists can track and share experiments locally or in the cloud, package and share models across frameworks, and deploy models virtually anywhere. Today at the Spark + AI Summit, we announced the General Availability of Managed MLflow on...