Language models that write code In 2020 OpenAI has presented GPT-3 to the world: a transformer model that operated natural language and showcased high level of general skills and emergent meta-learning capabilities. Shortly thereafter, a research project got started that […]
Adapting Language Models for Conversational Tasks Improvements in pretraining large language models (LM) made training large-scale conversational encoders impractical. In this talk, we show that the transformation of LMs towards conversational encoders and adaptation of the task towards the original […]
A practical approach to measuring and using the prediction uncertainty of a natural language processing system Can a model with 90% accuracy be useful, if the task strictly requires 98%? The answer is, probably yes, but not always. Thanks to […]
