Large-scale testing of new data products or enhancements to existing products in a research and development environment can be a technical challenge for data scientists. In some cases, tools available to data scientists lack production-level capacity, whereas other tools do not provide the algorithms needed to run the methodology. At Nielsen, the Databricks platform provided a solution to both of these challenges. This breakout session will cover a specific Nielsen business case where two methodology enhancements were developed and tested at large-scale using the Databricks platform. Development and large-scale testing of these enhancements would not have been possible using standard database tools.
Session hashtag: #EUent4
Matt is a Senior Data Scientist in the Digital Products Team and joined Nielsen in February 2016. Matt holds a PhD in Fisheries Science from Texas Tech University and has 10+ years’ experience analyzing small, medium, and large data from a variety of disciplines.