At the time, the largest training run was AlphaGoZero, at about a mole of flops in 2017. Six years later, Metaculus currently estimates that GPT-4 took ~10-20 moles of flops.
By “mole” do you mean the unit from chemistry?
In chemistry, a mole is a unit of measurement used to express amounts of a chemical substance. It is one of the base units in the International System of Units (SI) and is defined as the amount of substance that contains as many elementary entities (such as atoms, molecules, ions, or electrons) as there are atoms in 12 grams of carbon-12 (12C), the isotope of carbon with relative atomic mass 12 by definition. This number is known as Avogadro’s number, which is approximately 6.022×10236.022×1023 entities per mole.
By “mole” do you mean the unit from chemistry?
Am I missing something? Why use that unit?
Yes, I mean “mole” as in the unit from chemistry. I used it because I found it amusing.