What is the GShard dense transformer you are referring to in this post?
It should be referenced here in Figure 1: https://arxiv.org/pdf/2006.16668.pdf
What is the GShard dense transformer you are referring to in this post?
It should be referenced here in Figure 1: https://arxiv.org/pdf/2006.16668.pdf