OpenAI Archives - JAXenter

#OpenAI

Natural language generation with 17 billion parameters

Microsoft’s deep learning language model Turing-NLG outperforms GPT-2

#machine learning #microsoft #NLP #OpenAI

Microsoft has announced its deep learning language model Turing-NLG, and its impressive 17 billion parameters make it the largest language model to date. While it is not publicly available, a demo version has been released to a small group for testing purposes. Let’s see if more parameters mean better results, compared to OpenAI’s GPT-2 and NVIDIA’s Megatron-LM.

AI research with PyTorch

OpenAI sets PyTorch as its new standard deep learning framework

#deep learning #OpenAI #pytorch

The AI research organization OpenAI has declared to standardize which deep learning framework to use in its projects, and the winner is PyTorch. Let’s take a closer look and see not only why OpenAI selected PyTorch, but also what benefits the standardization itself should offer.