I think your question sort of misunderstands the CEV proposal. It’s something aligned AI might produce, not something we would personally work towards creating. Yes we might keep CEV in mind when figuring out how to build aligned AI, but it’s not something we can go straight towards else we would Goodhart ourselves into existential catastrophe at the worst or astronomical waste at the best.
I think your question sort of misunderstands the CEV proposal. It’s something aligned AI might produce, not something we would personally work towards creating. Yes we might keep CEV in mind when figuring out how to build aligned AI, but it’s not something we can go straight towards else we would Goodhart ourselves into existential catastrophe at the worst or astronomical waste at the best.