Articles by Paul Lappas - Databricks Blog

Page 1

Cost-effective, incremental ETL with serverless compute for Delta Live Tables pipelines

August 27, 2024 by Paul Lappas, Michael Armbrust, Manish Dalwadi, Andreas Neumann, Xi Liang, Kiavash Kianfar and Karl Wang in Platform Blog

We recently announced the general availability of serverless compute for Notebooks, Workflows, and Delta Live Tables (DLT) pipelines. Today, we'd like to explain...

Lakehouse Monitoring GA: Profiling, Diagnosing, and Enforcing Data Quality with Intelligence

August 1, 2024 by Jacqueline Li, Kasey Uhlenhuth, Paul Lappas and Danny Chiao in Security and Trust

At Data and AI Summit, we announced the general availability of Databricks Lakehouse Monitoring . Our unified approach to monitoring data and AI...

Faster AI/BI Dashboards with Materialized Views

February 1, 2024 by Chao Cai and Paul Lappas in Platform Blog

In this blog post, we will share how you can use Databricks SQL Materialized Views with AI/BI Dashboards to deliver fresh data and...

Delivering cost-effective data in real time with dbt and Databricks

December 12, 2023 by Shabbir Khanbhai, Paul Lappas and Bilal Aslam in Platform Blog

As businesses grow, data volumes scale from GBs to TBs (or more), and latency demands go from hours to minutes (or less), making...

Delta Live Tables Now Generally Available on Google Cloud

August 14, 2023 by Matt Jones, Paul Lappas and Richard Tomlinson in Platform Blog

Today we are announcing the general availability of Delta Live Tables (DLT) on Google Cloud. DLT pipelines empower data engineers to build reliable...

Simplified Analytics Engineering with Databricks and dbt Labs

July 17, 2023 by Bilal Aslam, Paul Lappas, Can Efeoglu, Erika Ehrli, Matt Jones, Hiral Jasani and Clarke Patterson in Platform Blog

For over a year now, Databricks and dbt Labs have been working together to realize the vision of simplified real-time analytics engineering, combining...

Introducing Materialized Views and Streaming Tables for Databricks SQL

June 28, 2023 by Paul Lappas, Michael Armbrust, Yannis Papakonstantinou, Nitin Sharma and Andreas Neumann in Platform Blog

We are thrilled to announce that materialized views and streaming tables are now publicly available in Databricks SQL on AWS and Azure. Streaming...

Build Reliable and Cost Effective Streaming Data Pipelines With Delta Live Tables’ Enhanced Autoscaling

December 8, 2022 by Paul Lappas, Li Zhang, Alex Ott, Kiavash Kianfar, Yuhong Chen and Prashanth Babu Velanati Venkata in Platform Blog

This year we announced the general availability of Delta Live Tables (DLT) , the first ETL framework to use a simple, declarative approach...

Delta Live Tables Announces New Capabilities and Performance Optimizations

June 29, 2022 by Paul Lappas and Michael Armbrust in Platform Blog

Since the availability of Delta Live Tables (DLT) on all clouds in April ( announcement ), we've introduced new features to make development...

Announcing General Availability of Databricks’ Delta Live Tables (DLT)

April 5, 2022 by Michael Armbrust, Awez Syed, Paul Lappas, Erika Ehrli, Sam Steiny, Richard Tomlinson, Andreas Neumann and Mukul Murthy in Platform Blog

Today, we are thrilled to announce that Delta Live Tables (DLT) is generally available (GA) on the Amazon AWS and Microsoft Azure clouds...