March 5th , 2020. 3pm Sydney / 12pm Singapore / 9.30am Mumbai
A common data engineering pipeline architecture uses tables that correspond to different quality levels, progressively adding structure to the data: data ingestion (“Bronze” tables), transformation/feature engineering (“Silver” tables), and machine learning training or prediction (“Gold” tables). Combined, we refer to these tables as a “multi-hop” architecture. It allows data engineers to build a pipeline that begins with raw data as a “single source of truth” from which everything flows. In this session, we will show how to build a scalable data engineering data pipeline using Delta Lake.
Virgin Hyperloop promises to remove the friction that slows most modes of transport, propelling people inside tubes on air bearings at speed of up to 1,200 km/h. Making this high-concept technology a reality takes a huge team and massive amounts of data — and that requires a platform where data teams can easily collaborate and innovate on virtually unlimited amounts of data.
INTEGRIS Health, the largest not-for-profit health system in Oklahoma, is widely recognized as a leading innovator in healthcare. This is due in large part to their strategy of migrating clinical and operational data to the cloud for advanced analytics. To enable this transformation, Integris built a secure, agile and unified platform for data analytics and machine learning in the cloud with Apache Spark, Azure Databricks and KenSci. In this webinar, Integris will share how they built and leverage this platform to rapidly prototype ML models and deliver on innovative use cases such as preventing neonatal sepsis, predicting patients at high risk for falls, avoiding pressure ulcers, reducing the length of stay and more.
In this webinar, we’ll cover why companies are switching to modern cloud-based platforms like Databricks, and how they use it to drive innovation, productivity, and business outcomes. We’ll also share a best practice framework for how to successfully migrate data and workloads to the cloud safely and securely.