gwern comments on NVIDIA and Microsoft releases 530B parameter transformer model, Megatron-Turing NLG

[gwern]

Paper is out: https://​​arxiv.org/​​abs/​​2201.11990