days
0
-13
-9
hours
-1
-3
minutes
0
-5
seconds
-4
-1
search

#OpenAI

Natural language generation with 17 billion parameters

Microsoft’s deep learning language model Turing-NLG outperforms GPT-2

Microsoft has announced its deep learning language model Turing-NLG, and its impressive 17 billion parameters make it the largest language model to date. While it is not publicly available, a demo version has been released to a small group for testing purposes. Let’s see if more parameters mean better results, compared to OpenAI’s GPT-2 and NVIDIA’s Megatron-LM.