SESSION

How Crisis Text Line's Data Platform Supports Mental Health

Accept Cookies to Play Video

OVERVIEW

EXPERIENCEIn Person
TYPEBreakout
TRACKData Lakehouse Architecture
INDUSTRYHealth and Life Sciences, Public Sector
TECHNOLOGIESDelta Lake, ETL, Orchestration
SKILL LEVELBeginner
DURATION40 min
DOWNLOAD SESSION SLIDES

Crisis Text Line has unique insight into the global mental health crisis as a free, 24/7, confidential service. We field over a million conversations with texters across the country each year - and this crisis is growing quickly. Human connection is key, but our volunteers need help to support people at scale. Therefore, we need technology to bridge the gap. This presentation will discuss using Spark and Delta Lake on Databricks for data ingest and transformation. We have automated resource provisioning and permissions on Databricks using Terragrunt. This allows us to spin up data platforms for different countries with a small team of engineers. Our flexible pipelines allow us to apply different logic for sensitive data to meet various regulations. We also support our Data Science team for model serving, so automation with little oversight is vital. Our iterative approach to architecting all the necessary platform components renders company value quickly.

SESSION SPEAKERS

IMAGE COMING SOON

Kristi Lui

/Principal Product Manager
Crisis Text Line

Ankit Gupta

/Staff Data Engineer
Crisis Text Line