Real-Time Distributed Monitoring and Logging in the Azure Cloud
How can you observe the unobservable? At Databricks we rely heavily on detailed metrics from our internal services to maintain high availability and...
Single Sign-On (SSO) to Third Party Applications
This past winter, I was a software engineering intern at Databricks on the Identity and Access Management (IAM) team. During my time here...
Detecting Financial Fraud at Scale with Decision Trees and MLflow on Databricks
Try this notebook in Databricks Detecting fraudulent patterns at scale using artificial intelligence is a challenge, no matter the use case. The massive...
Understanding Dynamic Time Warping
Try this notebook in Databricks This blog is part 1 of our two-part series Using Dynamic Time Warping and MLflow to Detect Sales...
Using Dynamic Time Warping and MLflow to Detect Sales Trends
Try this notebook series (in DBC format) in Databricks This blog is part 2 of our two-part series Using Dynamic Time Warping and...
Introducing MLflow Run Sidebar in Databricks Notebooks
At Spark+AI Summit 2019, we announced the GA of Managed MLflow on Databricks in which we take the latest and greatest of open...
Announcing General Availability of Managed MLflow on Databricks
Try this tutorial in Databricks MLflow is an open source platform to help manage the complete machine learning lifecycle. With MLflow, data scientists...
Databricks and Tableau Lean In to Improve BI User Experience
Since 2014, Tableau and Databricks have partnered to improve the speed and user experience of visualizing massive data sets. This is a natural...
Open Sourcing Delta Lake
Get an early preview of O'Reilly's new ebook for the step-by-step guidance you need to start using Delta Lake. Build reliable data lakes...
Koalas: Easy Transition from pandas to Apache Spark
Today at Spark + AI Summit, we announced Koalas, a new open source project that augments PySpark’s DataFrame API to make it compatible...