How Databricks Powers Stantec's Flood Predictor Engine
This is a collaborative post between Stantec and Databricks. We thank ML Operations Lead Assaad Mrad, Ph.D. and Data Scientist Jared Van Blitterswyk...
Build Reliable and Cost Effective Streaming Data Pipelines With Delta Live Tables’ Enhanced Autoscaling
This year we announced the general availability of Delta Live Tables (DLT) , the first ETL framework to use a simple, declarative approach...
An Automated Guide to Distributed and Decentralized Management of Unity Catalog
Unity Catalog provides a unified governance solution for all data and AI assets in your lakehouse on any cloud. As customers adopt Unity...
Why We Migrated From Apache Airflow to Databricks Workflows at YipitData
This is a collaborative post from Databricks and YipitData. We thank Engineering Manager Hillevi Crognale at YipitData for her contributions. YipitData is the...
ArcGIS GeoAnalytics Engine in Databricks
This is a collaborative post from Esri and Databricks. We thank Senior Solution Engineer Arif Masrur, Ph.D. at Esri for his contributions. Advances...
Intermittent Demand Forecasting With Nixtla on Databricks
This is a collaborative post from Nixtla and Databricks. We thank Max Mergenthaler Canseco, CEO and Co-founder, and Federico Garza Ramírez, CTO and...
Databricks Workflows Through Terraform
Part 1 of the blog series on deploying Workflows through Terraform. How to create complex jobs / workflows from scratch in Databricks using...
Near-real-time IoT Robust Anomaly Detection Framework
1. Introduction With rapid digitalization of the economy, we experience exponential growth of real-time data being processed by businesses and organizations worldwide. Lots...
Solution Accelerator: Multi-factory Overall Equipment Effectiveness (OEE) and KPI Monitoring
Check out the Databricks Solution Accelerator for OEE and KPI monitoring in manufacturing . The need to monitor and measure manufacturing equipment performance...
Serving Up a Primer for Unity Catalog Onboarding
Introduction This blog is part of our Admin Essentials series, where we'll focus on topics important to those managing and maintaining Databricks environments...