Microsoft Unveils Powerful New AI Language Model Outperforming Top Systems
-
T-NLG is a large language model developed by Microsoft in 2020 as part of its AI research. It outperformed other models like GPT and BERT in tests.
-
T-NLG uses transformer architecture to predict the next word in a sequence, understanding context to generate natural language.
-
Microsoft trained T-NLG on 256 Nvidia GPUs, using 17 billion parameters to achieve strong language processing abilities.
-
Microsoft continues researching more advanced AI like 530-billion parameter Megatron and multilingual models, while partnering with OpenAI.
-
Generative AI keeps advancing with models like OpenAI's ChatGPT, Google's Bard, and capabilities like summarization, question answering, and image generation.