1a3orn comments on AGI rising: why we are in a new era of acute risk and increasing public awareness, and what to do now

[1a3orn]

What happens when it’s massively scaled up?

Probably nothing, honestly.

Here’s a chart of one of the benchmarks the GPT-NAS paper tests on. They GPT-NAS paper is like.… not off trend? Not even SOTA? Honestly looking at all these results my tenative guess is that the differences are basically noise for most techniques; the state space is tiny such that I doubt any of these really leverage actual regularities in it.

[Greg C]

From the Abstract:

Rather than targeting state-of-the-art performance, our objective is to highlight GPT-4’s potential

They weren’t aiming for SOTA! What happens when they do?