teradimich comments on “AI and Compute” trend isn’t predictive of what is happening

[teradimich]

Probably that:

When we didn’t have enough information to directly count FLOPs, we looked GPU training time and total number of GPUs used and assumed a utilization efficiency (usually 0.33)