How Crisis Text Line's Data Platform Supports Mental Health

Crisis Text Line has unique insight into the global mental health crisis as a free, 24/7, confidential service. We field over a million conversations with texters across the country each year - and this crisis is growing quickly. Human connection is key, but our volunteers need help to support people at scale. Therefore, we need technology to bridge the gap. This presentation will discuss using Spark and Delta Lake on Databricks for data ingest and transformation. We have automated resource provisioning and permissions on Databricks using Terragrunt. This allows us to spin up data platforms for different countries with a small team of engineers. Our flexible pipelines allow us to apply different logic for sensitive data to meet various regulations. We also support our Data Science team for model serving, so automation with little oversight is vital. Our iterative approach to architecting all the necessary platform components renders company value quickly.