BigCode - building language models for code in the open

In recent months, applications such as GitHub Copilot that are powered by large language models trained on code have been taking off. However, many details such as dataset composition, licensing situation, or inference techniques are not available. BigCode is an initiative to build code models in an open and responsible way with the community.


Leandro von Werra, Hugging Face

Leandro von Werra is a Machine Learning Engineer in the Open Source team at Hugging Face working on evaluation and code generation. He is co-author of the book Natural Language Processing with Transformers and built a popular library for Reinforcement Learning with Transformers (TRL).