Announcing General Availability of Managed MLflow on Databricks
Try this tutorial in Databricks MLflow is an open source platform to help manage the complete machine learning lifecycle. With MLflow, data scientists...
Koalas: Easy Transition from pandas to Apache Spark
Today at Spark + AI Summit, we announced Koalas, a new open source project that augments PySpark’s DataFrame API to make it compatible...
Managing the Complete Machine Learning Lifecycle: On-Demand Webinar now available!
On March 7th, our team hosted a live webinar— Managing the Complete Machine Learning Lifecycle —with Andy Konwinski, Co-Founder and VP of Product...
Databricks Runtime 5.3 ML Now Generally Available
We are excited to announce the general availability (GA) of Databricks Runtime for Machine Learning, as part of the release of Databricks Runtime...
Introducing Brickchain: Planet-scale Unified Analytics
Today we are excited to announce Brickchain , the next generation technology for zettabyte-scale analytics, by harnessing all the compute power on the...
Managed MLflow on Databricks now in public preview
Try this tutorial in Databricks Building production machine learning applications is challenging because there is no standard way to record experiments, ensure reproducible...
How to Work with Avro, Kafka, and Schema Registry in Databricks
In the previous blog post , we introduced the new built-in Apache Avro data source in Apache Spark and explained how you can...
Accelerating Machine Learning on Databricks: On-Demand Webinar and FAQ Now Available!
Try this notebook in Databricks On January 15th, we hosted a live webinar— Accelerating Machine Learning on Databricks —with Adam Conway, VP of...
Kicking Off 2019 with an MLflow User Survey
It’s been six months since we launched MLflow , an open source platform to manage the machine learning lifecycle, and the project has...
Introducing Built-in Image Data Source in Apache Spark 2.4
Introduction With recent advances in deep learning frameworks for image classification and object detection, the demand for standard image processing in Apache Spark...