Menu
Home
People
Places
Arts
History
Plants & Animals
Science
Life & Culture
Technology
Reference.org
T5 (language model)
open-in-new
<p>T5 (Text-to-Text Transfer Transformer) is a series of <a href="/facts/Large_language_model/WnogWVJY">large language models</a> developed by <a href="/facts/Google_AI/dG4ouT6p">Google AI</a> introduced in 2019. Like the <a href="/facts/Attention_Is_All_You_Need/W6jRVM7m">original Transformer</a> model, T5 models are <a href="/facts/Transformer_(deep_learning_architecture)/cDbjx6a8">encoder-decoder Transformers</a>, where the encoder processes the input text, and the decoder generates the output text. </p><p>T5 models are usually pretrained on a massive <a href="/facts/Text_corpus/bYeEQQdh">dataset of text</a> and code, after which they can perform the text-based tasks that are similar to their pretrained tasks. They can also be finetuned to perform other tasks. </p><p>T5 models have been employed in various applications, including chatbots, machine translation systems, text summarization tools, code generation, and robotics. </p>