What about Fugaku the current fastest supercomputer with 1 exaflops in single or further reduced precision. What’s the cost of training a 100 trillion model with it?
https://www.top500.org/news/japan-captures-top500-crown-arm-powered-supercomputer/
What about Fugaku the current fastest supercomputer with 1 exaflops in single or further reduced precision. What’s the cost of training a 100 trillion model with it?
https://www.top500.org/news/japan-captures-top500-crown-arm-powered-supercomputer/