Company Blog

In less than a year, MLflow has reached almost 500K monthly downloads, and gathered over 80 code contributors and 40 contributing organizations, confirming the need for an open source approach to help standardize the machine learning lifecycle across tools, teams, and processes. We are thrilled to host some of our key contributors and customers next...

When one looks at the amazing roster of talks for next week’s Spark + AI Summit, what you don’t see is a lot of discussion on how to leverage object storage. On some level you would expect to - ultimately if you want to run your Spark job on peta-scale data sets and have it...

The retail industry has been leading the pack in harnessing the power of big data and AI to drive customer engagement. By analyzing customer data and purchasing behavior, retail companies can leverage the latest machine learning technologies to deepen customer insights and deliver tailored shopping experiences that captivate customers across every channel. Spark + AI...

Data and AI are ushering in a new era of precision medicine. The scale of the cloud, combined with advancements in machine learning, are enabling healthcare and life sciences organizations to use their mountains of data—such as electronic health records, genomics, real-world evidence, claims, and more—to drive innovation across the entire ecosystem, from accelerating drug...

The financial services industry is transforming rapidly. Customers today demand more personalized experiences, better returns on their investments and improved protection against fraud. As a result,  every bank, insurance company and institutional investor is turning towards big data and AI to meet these demands and outmaneuver the competition. Spark + AI Summit is the premier...

On March 7th, our team hosted a live webinar—Managing the Complete Machine Learning Lifecycle—with Andy Konwinski, Co-Founder and VP of Product at Databricks. In this webinar, we walked you through how MLflow, an open source framework for the complete Machine Learning lifecycle, helps solve for challenges around experiment tracking, reproducible projects and model deployment. Specifically,...

We are proud to announce the release of Databricks Runtime 5.3, which includes several new features and improvements, including: GA of Delta Time Travel Public Preview of MySQL table replication to Delta Optimized DBFS FUSE folder for deep learning workloads (Azure-only) Databricks Delta Time Travel (Generally Available) Delta Time Travel has graduated to general availability....

We are excited to announce the general availability (GA) of Databricks Runtime for Machine Learning, as part of the release of Databricks Runtime 5.3 ML. Built on top of Databricks Runtime, Databricks Runtime ML is the optimized runtime for developing ML/DL applications in Databricks. It offers native integration with popular ML/DL frameworks, such as scikit-learn,...

Over the past several years, Spark + AI Summit has become the premier event for data scientists, engineers, and Apache SparkTM enthusiasts to come together and share how they’re driving innovation with the latest data and machine learning technologies. Last year’s Summit set a new record, with more than 4000 attendees and over 100 talks...

From Static Data Warehouse to Scalable Insights and AI On-Demand Government agencies today are dealing with a wider variety of data at a much larger scale. From satellite imagery to sensor data to citizen records, petabytes of semi- and unstructured data is collected each day. Unfortunately, traditional data warehouses are failing to provide government agencies...