Driver Location Intelligence at Scale using Apache Spark, Delta Lake, and MLflow on Databricks - Databricks

Driver Location Intelligence at Scale using Apache Spark, Delta Lake, and MLflow on Databricks

Download Slides

TomTom has the mission of creating a world free of congestion and better driving experience. In order to do that, we need to understand driving behavoiur from end users, at the same time that we optimize the operational costs of our services. However, due to the large scale of our probe data from vehicles providing insights and performing advanced analytics can can be quite challenging.

During this discussion I will showcase two use cases where Databricks, Delta Lake and MLflow has enabled us to accelerate innovation. The first one is the IQMaps usecase. IQMaps is a system designed specifically for in-dash systems – taking the same up-to-date user experience you expect from navigation apps and bringing it to reliable, in-car navigation. IQ Maps learn the drivers’ driving patterns and updates the map regions that are most relevant to the user, using Wi-Fi or 4G. However, optimizing the data network consumption, which can have a high cost, while keeping the best driving experience, by having the map updated, requires complex simulations using millions of locations traces from vehicles. Apache Spark has been our key instrument to find the best balance to this trade off. The second use case is Destination Prediction. For many years, we have offered a personalized feature on our navigation products that predicts with high accuracy the driver’s next destination. Nonetheless, with the exponential increase and availability of data, and the access to more sophisticated Machine Learning models, we have revisited this feature to take it to the next level. Both us ecases take advantage of the latest frameworks and tools available on Databricks. With MLflow and Delta we have been able to find the best models that predict the destination for each individual driver, and to track each one of the KPIs.

 

Try Databricks
See More Spark + AI Summit Europe 2019 Videos

« back
About Sergio Ballesteros Solanas

TomTom

Sergio is a Data Scientist at TomTom where he plays a critical role on providing insights to take data driven decisions on navigation products and researching new product features to improve the driving experience. Also he has deep experience in building large scale data pipelines and personalized services such as route recommender systems.

About Kia Eisinga

TomTom

Kia Eisinga is a senior data scientist at TomTom. She has been working in the field of data science for around 4 years. She enjoys working with TomTom’s different sources of structured and unstructured data and being confronted with practical, complex problems. Kia is convinced that data is an integral part of every business and that data science can bring a huge competitive advantage when embraced in the right way.