SESSION

What's Wrong with the Medallion Architecture? (repeated)

Accept Cookies to Play Video

OVERVIEW

EXPERIENCEIn Person
TYPELightning Talk
TRACKData Lakehouse Architecture
INDUSTRYProfessional Services, Retail and CPG - Food, Financial Services
TECHNOLOGIESDelta Lake, Governance, Orchestration
SKILL LEVELBeginner
DURATION20 min

This sesion is repeated.

 

In recent years, companies have seen an explosion in adopting lakehouses and reaping the rewards, but time and time again, we hear from people that they regret the layering of their lake. The zones don't quite fit what they were trying to achieve, and no one in the company understands what "silver" vs. "gold" actually means. We need to tackle a key question: Is the Medallion Architecture right for most businesses - and how should you interpret the advice? In this session, we'll break down the different stages of data curation and talk about how it works in reality, calling on practical examples from many, many real-world implementations. We'll talk about schema evolution, data cleansing, record validation, and traditional data modeling techniques, layering them on top of our lakehouse zones so we truly understand what happens where. This session is ideal for data architects, engineers, and analysts looking to design the best platform possible!

SESSION SPEAKERS

Simon Whiteley

/CTO
Advancing Analytics