Delivering cost-effective data in real time with dbt and Databricks
As businesses grow, data volumes scale from GBs to TBs (or more), and latency demands go from hours to minutes (or less), making...
It’s Time for Streaming Architectures for Every Use Case
In today's data-driven world, organizations face the challenge of effectively ingesting and processing data at an unprecedented scale. With the amount and variety...
How Lakehouse AI improves model accuracy with real-time computations
The predictive quality of a machine learning model is a direct reflection of the quality of data used to train and serve the...
How to upgrade your Hive tables to Unity Catalog
In this blog we will demonstrate with examples, how you can seamlessly upgrade your Hive metastore (HMS)* tables to Unity Catalog (UC) using...
Introducing Predictive Optimization: Faster Queries, Cheaper Storage, No Sweat
Predictive Optimization intelligently optimizes your Lakehouse table data layouts for peak performance and cost-efficiency - without you needing to lift a finger.
How Providence Health Built a Model Marketplace using Databricks
Providence's MLOps Platform Providence is a healthcare organization with 120,000 caregivers serving over 50 hospitals and 1,000 clinics across seven states. Providence is...
New Support for Conflict Resolution in Repos: Merge, Rebase and Pull
At Databricks, we are committed to simplifying the developer experience and are thrilled to unveil additional Git capabilities in Databricks Repos. Users can...
The Simplification of AI Data
Talk to any data science organization and they will almost unanimously tell you that the biggest challenge to building high quality AI models...
Protecting Your Compute Resources From Bitcoin Miners With a Data Lakehouse
As cryptocurrencies, particularly Bitcoin, have grown in popularity, so has the phenomenon of Bitcoin mining. While normal mining operations are critical for blockchain...
Best Practices and Guidance for Cloud Engineers to Deploy Databricks on AWS: Part 3
For the final part of our Best Practices and Guidance for Cloud Engineers to Deploy Databricks on AWS series, we'll cover an important...