Data Evolution at Inari: Harnessing Delta Live Tables & Unity Catalog
OVERVIEW
EXPERIENCE | In Person |
---|---|
TYPE | Breakout |
TRACK | Data Engineering and Streaming |
INDUSTRY | Health and Life Sciences, Manufacturing |
TECHNOLOGIES | Developer Experience, ETL, Governance |
SKILL LEVEL | Beginner |
DURATION | 40 min |
DOWNLOAD SESSION SLIDES |
Inari is a company dedicated to building a sustainable global food system, utilizing its SEEDesign platform and combining AI and gene editing for impactful solutions. The Data Engineering team at Inari was established only a few months ago, and at the time, they embraced Databricks during a major lab informatics system migration. Over three months, we adopted the Python implementation for DLT for efficient data ingestion and transformation, and implemented a medallion architecture in Databricks Unity Catalog to manage data effectively. This presentation will showcase our strategic approach toward data management using Unity Catalog, experiences developing with Delta Live Tables, and finally, the results, demonstrating Inari’s innovative progress in agriculture and advanced data management.
SESSION SPEAKERS
Ranganath Sundar
/Sr. Manager, Data Engineering
Inari Agriculture
Jonathon Long
/Staff Data Engineer
Inari Agriculture