For an AI related Causal Goodhart example, what about Schmidhuber’s idea than an AI should maximise “complexity”? Since humans are the main cause of complexity (in the sense he was thinking of) in the current world, but would not be in an extreme world, this seems to fit.
For an AI related Causal Goodhart example, what about Schmidhuber’s idea than an AI should maximise “complexity”? Since humans are the main cause of complexity (in the sense he was thinking of) in the current world, but would not be in an extreme world, this seems to fit.