Anthony Moi is the tech lead at Hugging Face, the leading NLP startup, based in NYC and Paris, that raised more than $20M from prominent investors. The company creates tools for deep learning applied to natural language processing, namely huggingface/transformers and huggingface/tokenizers. Ahthony is the lead maintainer and contributor to huggingface/tokenizers
June 25, 2020 05:00 PM PT
The natural language processing (NLP) landscape has radically changed with the arrival of transformer networks in 2017. From BERT to XLNet, ALBERT and ELECTRA, huge neural networks now manage to obtain unprecedented scores on benchmarks for tasks like sequence classification, question answering and named entity recognition. The pipeline from text to prediction remains complex, but tools like huggingface/transformers and huggingface/tokenizers take most of the burden off of the user, offering a simple API. This talk will focus on the entire NLP pipeline, from text to tokens with huggingface/tokenizers and from tokens to predictions with huggingface/transformers.