Devon Energy is a Fortune 500 company focused on unconventional upstream oil and gas production. With a companywide focus on innovation and data-driven decision making, IT has been challenged to make more data available to more people more quickly. To this end, we have leveraged the scale of Microsoft Azure and Databricks’ Unified Analytics Platform to help reimagine our integration, data warehousing and analytics landscape to improve agility while moving our workloads to the cloud.
We are in the third year of this transformation and have lessons learned around improving the testability of data pipelines, code management, model training and deployment, promotion, and user empowerment. In this talk, we will share our experience managing the lifecycle of data engineering and machine learning solutions and striking the balance between agility and reliability in a single platform, while democratizing data access to users from all disciplines across the company.
Paul Bruffett is the architect responsible for Devon Energy’s big data and advanced analytics platform. With a background in distributed systems design and domain driven microservices solution architecture, Paul is currently focused on leading Devon's migration from an on premises Hadoop cluster and datawarehouse to an agile, cloud first big data environment and data lake. Paul also uses his experience in deep learning and analytics to lead the design and implementation of a platform for developing and deploying machine learning and deep learning pipelines using modern technologies and frameworks.