Linking the unlinkables; simple, automated, scalable data linking with Databricks ARC
In April 2023 we announced the release of Databricks ARC to enable simple, automated linking of data within a single table. Today we...
Page 1
Fleet optimization with CARTO & Databricks
Effective delivery has become increasingly important for businesses in recent years, particularly for logistics companies and those in the consumer packaged goods (CPG)...
Improving Public Sector Decision Making With Simple, Automated Record Linking
What is data linking and why does it matter? Availability of more, high quality data is a critical enabler for better decision making...
Unsupervised Outlier Detection on Databricks
Kakapo ( KAH-kə-poh ) implements a standard set of APIs for outlier detection at scale on Databricks. It provides an integration of the...
Best practices for cross-government data sharing
Government data exchange is the practice of sharing data between different government agencies and often partners in commercial sectors. Government can share data...
Better Data for Better Decisions in the Public Sector Through Entity Resolution - Part 1
One of the domains where better decisions mean a better society is the Public Sector. Each and every one of us has a...
Building Geospatial Data Products
Geospatial data has been driving innovation for centuries, through use of maps, cartography and more recently through digital content. For example, the oldest...
Security Best Practices for Delta Sharing
Update: Delta Sharing is now generally available on AWS and Azure. The data lakehouse has enabled us to consolidate our data management architectures...
Designing a Java Connector for Delta Sharing Recipient
Making an open data marketplace Stepping into this brave new digital world we are certain that data will be a central product for...
Arcuate - Machine Learning Model Exchange With Delta Sharing and MLflow
Stepping into this brave new digital world we are certain that data will be a central product for many organizations. The way to...
High Scale Geospatial Processing With Mosaic
Breaking through the scale barrier (discussing existing challenges) At Databricks, we are hyper-focused on supporting users along their data modernization journeys. A growing...
Implementing the GDPR 'Right to be Forgotten' in Delta Lake
Databricks' Lakehouse platform empowers organizations to build scalable and resilient data platforms that allow them to drive value from their data. As the...
Efficient Point in Polygon Joins via PySpark and BNG Geospatial Indexing
This is a collaborative post by Ordnance Survey, Microsoft and Databricks. We thank Charis Doidge, Senior Data Engineer, and Steve Kingston, Senior Data...
Make Your RStudio on Databricks More Durable and Resilient
One of the questions that we often hear from our customers these days is, “Should I develop my solution in Python or R?”...
Improving Customer Experience With Transaction Enrichment
The retail banking landscape has dramatically changed over the past five years with the accessibility of open banking applications, mainstream adoption of Neobanks...