(I’d be curious what people at the orgs think about this one!)
For DeepMind:
my impression is that it is still clunky to do a lot of things with a large model when you are at an org
Mostly false: it’s clunky inasmuch as working with large models is generally clunky (e.g. they may not fit on a single device), but even then for common use cases you can use the solution that other people wrote.
things like retraining are obviously very expensive
True
these orgs seem to also favor large group projects
For DeepMind:
Mostly false: it’s clunky inasmuch as working with large models is generally clunky (e.g. they may not fit on a single device), but even then for common use cases you can use the solution that other people wrote.
True
True (relative to academia)
Mostly false