Rise of the Medallion Mesh (Repeat)
OVERVIEW
EXPERIENCE | In Person |
---|---|
TYPE | Breakout |
TRACK | Data Warehousing - Analytics and BI |
INDUSTRY | Enterprise Technology |
TECHNOLOGIES | Delta Lake, ETL, SQL Analytics / BI / Visualizations |
SKILL LEVEL | Intermediate |
DURATION | 40 min |
This session is repeated.
Organizations today face a significant challenge: the loss of productivity due to data preparation issues. This talk explores innovative solutions from successful customers in data architecture, focusing on the Medallion Mesh pattern. We delve into the Medallion architecture, born from Delta Lake, which organizes data into Bronze, Silver, and Gold layers, offering a structured approach to data management. Combined with Data Mesh, a decentralized framework promoting domain-based data product creation, this approach addresses the bottlenecks in large organizations. The talk highlights the integration of dbt for pipeline management, emphasizing how the Medallion Mesh pattern democratizes data access, fosters self-service, and ensures scalability. We'll explore real-world applications and discuss how to tailor these patterns to diverse organizational needs, ensuring a flexible, efficient, and future-proof data architecture.
SESSION SPEAKERS
Franco Patano
/Lead Product Specialist
Databricks