days
0
-47
-6
hours
0
0
minutes
-3
-8
seconds
0
-2
search

#OpenAI

Natural language generation with 17 billion parameters

Microsoft’s deep learning language model Turing-NLG outperforms GPT-2

Microsoft has announced its deep learning language model Turing-NLG, and its impressive 17 billion parameters make it the largest language model to date. While it is not publicly available, a demo version has been released to a small group for testing purposes. Let’s see if more parameters mean better results, compared to OpenAI’s GPT-2 and NVIDIA’s Megatron-LM.