Fits nicely into (t,n)/(w,h) - as above t is time of human, n is number of humans, w is number of watts inference costs, h is amount of time inference takes. (perhaps there are other units besides watts that matter, such as specific hardware, but imo watts are a fundamental metric in terms of ability to eat all biological life as literal food or whatever doom it is we expect these days.)
Hmm, I’m more interested in FLOP than watts, because almost all watts can’t be converted to FLOP.
Also, I think at some point there’ll be a salient difference between “many FLOP/s for a short time” and “fewer FLOP/s for a long time” but right now it doesn’t feel like a crucial distinction to track.
Fits nicely into (t,n)/(w,h) - as above t is time of human, n is number of humans, w is number of watts inference costs, h is amount of time inference takes. (perhaps there are other units besides watts that matter, such as specific hardware, but imo watts are a fundamental metric in terms of ability to eat all biological life as literal food or whatever doom it is we expect these days.)
Hmm, I’m more interested in FLOP than watts, because almost all watts can’t be converted to FLOP.
Also, I think at some point there’ll be a salient difference between “many FLOP/s for a short time” and “fewer FLOP/s for a long time” but right now it doesn’t feel like a crucial distinction to track.
Hmm. I don’t think that’ll last very long. Perhaps there’s no particular need to think ahead on this, though.