How Lakehouse Architecture Empowered Rogers Communications to Modernize Revenue Assurance
This is a guest post from Duane Robinson, Sr. Manager of Data Science at Rogers Communications. At Rogers Communications, we take pride in...
Parallel ML: How Compass Built a Framework for Training Many Machine Learning Models on Databricks
This is a collaborative post from Databricks and Compass . We thank Sujoy Dutta, Senior Machine Learning Engineer at Compass, for his contributions...
Databricks SQL Highlights From Data & AI Summit
Data warehouses are not keeping up with today's world: the explosion of languages other than SQL, unstructured data, machine learning, IoT and streaming...
Sync Your Customer Data to the Databricks Lakehouse Platform With RudderStack
Collecting, storing, and processing customer event data involves unique technical challenges. It's high volume, noisy, and it constantly changes. In the past, these...
Building a Cybersecurity Lakehouse for CrowdStrike Falcon Events Part II
Visibility is critical when it comes to cyber defense – you can't defend what you can't see. In the context of a modern...
Scanning for Arbitrary Code in Databricks Workspace With Improved Search and Audit Logs
How can we tell whether our users are using a compromised library? How do we know whether our users are using that API...
Disaster Recovery Automation and Tooling for a Databricks Workspace
This post is a continuation of the Disaster Recovery Overview, Strategies, and Assessment blog. Introduction A broad ecosystem of tooling exists to implement...
Mosaic ResNet Deep Dive
TL;DR: We recently released a set of recipes which can accelerate training of a ResNet-50 on ImageNet by up to 7x over standard...
Hunting for IOCs Without Knowing Table Names or Field Labels
There is a breach! You are an infosec incident responder and you get called in to investigate. You show up and start asking...
Using Spark Structured Streaming to Scale Your Analytics
This is a guest post from the M Science Data Science & Engineering Team. Modern data doesn't stop growing "Engineers are taught by...