What's Wrong with the Medallion Architecture? (repeated)
OVERVIEW
EXPERIENCE | In Person |
---|---|
TYPE | Lightning Talk |
TRACK | Data Lakehouse Architecture |
INDUSTRY | Professional Services, Retail and CPG - Food, Financial Services |
TECHNOLOGIES | Delta Lake, Governance, Orchestration |
SKILL LEVEL | Beginner |
DURATION | 20 min |
This sesion is repeated.
In recent years, companies have seen an explosion in adopting lakehouses and reaping the rewards, but time and time again, we hear from people that they regret the layering of their lake. The zones don't quite fit what they were trying to achieve, and no one in the company understands what "silver" vs. "gold" actually means. We need to tackle a key question: Is the Medallion Architecture right for most businesses - and how should you interpret the advice? In this session, we'll break down the different stages of data curation and talk about how it works in reality, calling on practical examples from many, many real-world implementations. We'll talk about schema evolution, data cleansing, record validation, and traditional data modeling techniques, layering them on top of our lakehouse zones so we truly understand what happens where. This session is ideal for data architects, engineers, and analysts looking to design the best platform possible!
SESSION SPEAKERS
Simon Whiteley
/CTO
Advancing Analytics