Note that the MLPerf benchmark for GPT-3 is not on the full C4 dataset, it’s on 0.4% of the C4 dataset.
See: https://twitter.com/abhi_venigalla/status/1673813863186452480?s=20
Note that the MLPerf benchmark for GPT-3 is not on the full C4 dataset, it’s on 0.4% of the C4 dataset.
See: https://twitter.com/abhi_venigalla/status/1673813863186452480?s=20