Jean Carlo Machado is a Senior Software Engineer at GetYourGuide. He is working with Ranking, Recommendations and the MLPlatform. Jean is excited to see the MLOps field develop and to apply its good practices. His biggest hobby is programming and he is excited about what machine learning and automation can do for society.
May 28, 2021 10:30 AM PT
Fast-growing startups usually face a common set of challenges when employing machine learning. Data scientists are expected to work on new products and develop new models as well as iterate on existing ones. Once in production, models should be continuously monitored and regularly maintained as the infrastructure evolves. Before too long, data scientists end up spending most of their time doing maintenance and firefighting of existing models instead of creating new ones.
At GetYourGuide, we faced these challenges and decided to think about machine learning development holistically, which led us to our machine learning platform. Our platform uses MLflow to keep track of our machine learning life-cycle and ease the development experience. To integrate our models into our production environment, we also need to deal with additional requirements like API specification, SLOs and monitoring. To empower our data scientists, we have built a templating system that takes care of the heavy lifting of going to production, leveraging software engineering tools and ML-specific ones like BentoML.
In this talk we will present:
- Our previous approaches for deploying models and their tradeoffs
- Our data science and platform principles
- The main functionalities of our platform
- A live demo to create a new service
- Our learnings in the process