Pattern comments on Inference cost limits the impact of ever larger models

[Pattern]

MoEs?

[plex]

Mixture of Experts, pretty sure.