the setup implies that they’re simulated as perfect reasoners
That would make them throughly non-human in psychology. It’s a possibly useful take on CEV but I’m not sure it’s a standard one.
Mea culpa; I seem to have overgeneralized the extrapolation process.
But unless all its flaws are context-independent and uniformly distributed across humanity, I suspect they’d make human volition less likely to cohere, not more.
That would make them throughly non-human in psychology. It’s a possibly useful take on CEV but I’m not sure it’s a standard one.
Mea culpa; I seem to have overgeneralized the extrapolation process.
But unless all its flaws are context-independent and uniformly distributed across humanity, I suspect they’d make human volition less likely to cohere, not more.