Articles by John O'Dwyer - Databricks Blog

Page 1

10 Powerful Features to Simplify Semi-structured Data Management in the Databricks Lakehouse

November 11, 2021 by John O'Dwyer and Emma Liu in Engineering Blog

Hassle Free Data Ingestion Discover how Databricks simplifies semi-structured data ingestion into Delta Lake with detailed use cases, a demo, and live Q&A...

How Incremental ETL Makes Life Simpler With Data Lakes

August 30, 2021 by John O'Dwyer in Platform Blog

Get an early preview of O'Reilly's new ebook for the step-by-step guidance you need to start using Delta Lake. Incremental ETL (Extract, Transform...

Getting Started With Ingestion into Delta Lake

July 23, 2021 by John O'Dwyer and Nancy Shah in Data Engineering

Ingesting data can be hard and complex since you either need to use an always-running streaming platform like Kafka or you need to...

How to Simplify CDC With Delta Lake's Change Data Feed

June 9, 2021 by Surya Sai Turaga and John O'Dwyer in Engineering Blog

Try this notebook in Databricks Change data capture (CDC) is a use case that we see many customers implement in Databricks – you...

Simplifying Streaming Stock Analysis using Delta Lake and Apache Spark: On-Demand Webinar and FAQ Now Available!

June 18, 2019 by John O'Dwyer, Navin Albert and Denny Lee in Product

Get an early preview of O'Reilly's new ebook for the step-by-step guidance you need to start using Delta Lake. On June 13th, we...

Simplify Streaming Stock Data Analysis Using Databricks Delta

July 19, 2018 by John O'Dwyer and Denny Lee in Platform Blog

Traditionally, real-time analysis of stock data was a complicated endeavor due to the complexities of maintaining a streaming system and ensuring transactional consistency...