you say “Human ingenuity is irrelevant. Lots of people believe they know the one last piece of the puzzle to get AGI, but I increasingly expect the missing pieces to be too alien for most researchers to stumble upon just by thinking about things without doing compute-intensive experiments.” and you link https://tsvibt.blogspot.com/2024/04/koan-divining-alien-datastructures-from.html for “too alien for most researchers to stumble upon just by thinking about things without doing compute-intensive experiments”
i feel like that post and that statement are in contradiction/tension or at best orthogonal
I think Mesa is saying something like “The missing pieces are too alien for us to expect to discover them by thinking/theorizing but we’ll brute-force the AI into finding/growing those missing pieces by dumping more compute into it anyway.” and Tsvi’s koan post is meant to illustrate how difficult it would be to think oneself into those missing pieces.
you say “Human ingenuity is irrelevant. Lots of people believe they know the one last piece of the puzzle to get AGI, but I increasingly expect the missing pieces to be too alien for most researchers to stumble upon just by thinking about things without doing compute-intensive experiments.” and you link https://tsvibt.blogspot.com/2024/04/koan-divining-alien-datastructures-from.html for “too alien for most researchers to stumble upon just by thinking about things without doing compute-intensive experiments”
i feel like that post and that statement are in contradiction/tension or at best orthogonal
I think Mesa is saying something like “The missing pieces are too alien for us to expect to discover them by thinking/theorizing but we’ll brute-force the AI into finding/growing those missing pieces by dumping more compute into it anyway.” and Tsvi’s koan post is meant to illustrate how difficult it would be to think oneself into those missing pieces.