Platform Blog | Databricks Blog

Page 36

Orchestrating Data and ML Workloads at Scale: Create and Manage Up to 10k Jobs Per Workspace

August 10, 2022 by Anastasia Lebedeva, Bilal Aslam, Dino Wernli, Lennart Kats, Roland Fäustlin and Tatiana Romanova in Platform Blog

Databricks Workflows is the fully-managed orchestrator for data, analytics, and AI. Today, we are happy to announce several enhancements that make it easier...

Low-latency Streaming Data Pipelines with Delta Live Tables and Apache Kafka

August 9, 2022 by Frank Munz in Platform Blog

Delta Live Tables (DLT) is the first ETL framework that uses a simple declarative approach for creating reliable data pipelines and fully manages...

Databricks and Jupyter: Announcing ipywidgets in the Databricks Notebook

August 9, 2022 by Austin Ford, Bago Amirbekian, Xiao Chen and Jason Grout in Platform Blog

Today, we are excited to announce a deeper integration between the Databricks Notebook and the ecosystem established by Project Jupyter, a leader in...

Near Real-Time Anomaly Detection with Delta Live Tables and Databricks Machine Learning

August 8, 2022 by Avinash Sooriyarachchi and Sathish Gangichetty in Platform Blog

Why is Anomaly Detection Important? Whether in retail, finance, cyber security, or any other industry, spotting anomalous behavior as soon as it happens...

Identity Columns to Generate Surrogate Keys Are Now Available in a Lakehouse Near You!

August 8, 2022 by Franco Patano in Platform Blog

What is an identity column? An identity column is a column in a database that automatically generates a unique ID number for each...

New Solution Accelerator: Customer Entity Resolution

August 4, 2022 by Luke Bilbro, Sonal Goyal, Bryan Smith and Mimi Qunell in Industries

Check our new Customer Entity Resolution Solution Accelerator for more details and to download the notebooks. A growing number of customers now expect...

Monte Carlo and Databricks Partner to Help Companies Build More Reliable Data Lakehouses

August 3, 2022 by Ariel Amster and Matt Sulkis in Partners

This is a collaborative post between Monte Carlo and Databricks. We thank Matt Sulkis, Head of Partnerships, Monte Carlo, for his contributions. As...

Announcing Photon Engine General Availability on the Databricks Lakehouse Platform

August 3, 2022 by Alexander Behm, Cyrielle Simeone, Justin Breese and Sriram Krishnamurthy in Platform Blog

We are pleased to announce that Photon , the record-setting next-generation query engine for lakehouse systems, is now generally available on Databricks across...

Announcing the Preview of Serverless Compute for Databricks SQL on Azure Databricks

August 3, 2022 by Nikhil Jethava and Shankar Sivadasan in Platform Blog

Databricks SQL Serverless is now generally available. Read our blog to learn more. We are excited to announce the preview of Serverless compute...

How to Build a Marketing Analytics Solution Using Fivetran and dbt on the Databricks Lakehouse

August 3, 2022 by Tahir Fayyaz, Bilal Aslam and Robert Saxby in Platform Blog

Marketing teams use many different platforms to drive marketing and sales campaigns, which can generate a significant volume of valuable but disconnected data...