Joseph Miller comments on Zach Stein-Perlman’s Shortform

[Joseph Miller]

llama had to be so big to be SOTA,

How many parameters do you estimate for other SOTA models?

[Garrett Baker]

Minstral had like 150b parameters or something.