Building a Geospatial Lakehouse, Part 2
In Part 1 of this two-part series on how to build a Geospatial Lakehouse, we introduced a reference architecture and design principles to…
Data Science and ML
Cross-version Testing in MLflow
MLflow is an open source platform that was developed to manage the ML lifecycle, including experimentation, reproducibility, deployment, and a central model registry.…
Simplify Your Forecasting With Databricks AutoML
Last year, we announced Databricks AutoML for Classification and Regression and showed the importance of having a glass box approach to empower data…
Scaling SHAP Calculations With PySpark and Pandas UDF
Motivation With the proliferation of applications of Machine Learning (ML) and especially Deep Learning (DL) models in decision making, it is becoming more…
Implementing MLOps on Databricks using Databricks notebooks and Azure DevOps, Part 2
This is the second part of a two-part series of blog posts that show an end-to-end MLOps framework on Databricks, which is based…
Enabling Computer Vision Applications With the Data Lakehouse
The potential for computer vision applications to transform retail and manufacturing operations, as explored in the blog Tackle Unseen Quality, Operations and Safety…
Are GPUs Really Expensive? Benchmarking GPUs for Inference on Databricks Clusters
It is no secret that GPUs are critical for artificial intelligence and deep learning applications since their highly-efficient architectures make them ideal for…
Moneyball 2.0: Real-time Decision Making With MLB’s Statcast Data
The Oakland Athletics baseball team in 2002 used data analysis and quantitative modeling to identify undervalued players and create a competitive lineup on…
GPU-accelerated Sentiment Analysis Using Pytorch and Huggingface on Databricks
Sentiment analysis is commonly used to analyze the sentiment present within a body of text, which could range from a review, an email…
Introducing Apache Spark™ 3.2
We are excited to announce the availability of Apache Spark™ 3.2 on Databricks as part of Databricks Runtime 10.0. We want to thank…
