Quoc Le

Data Scientist, Roblox

Quoc N. Le is a Data Scientist at Roblox, where he is focused on leveraging AI for Natural Language Processing. Prior to Roblox, he designed the machine learning algorithms for world-wide sales forecasting at Salesforce (Einstein Guidance). Le is also a veteran of machine learning competitions, winning 1st Place in the Data Driven “Box Plots for Education” competition in 2015.

Past sessions

Roblox is a global online platform bringing millions of people together through play, with over 37 million daily active users and millions of games on the platform. Machine learning is a key part of our ability to scale important services to our massive community. In this talk, we share our journey of scaling our deep learning text classifiers to process 50k+ requests per second at latencies under 20ms. We will share how we were able to not only make BERT fast enough for our users, but also economical enough to run in production at a manageable cost on CPU. Further details can be found in our blog post below:

https://robloxtechblog.com/how-we-scaled-bert-to-serve-1-billion-daily-requests-on-cpus-d99be090db26

In this session watch:
Quoc Le, Data Scientist, Roblox
Kip Kaehler, Engineering Manager, Roblox

[daisna21-sessions-od]