I believe Eliezer has accidentally already created a path forward for that eventuality: We instantiate the Bayesian Conspiracy and show off how much better our miracles are than anyone else’s. Brennan’s World, here we come.
But they may not be sufficiently better than a convincing demagogue may unmake them. The art may not be strong enough: http://lesswrong.com/lw/9p/extreme_rationality_its_not_that_great/
I believe Eliezer has accidentally already created a path forward for that eventuality: We instantiate the Bayesian Conspiracy and show off how much better our miracles are than anyone else’s. Brennan’s World, here we come.
But they may not be sufficiently better than a convincing demagogue may unmake them. The art may not be strong enough: http://lesswrong.com/lw/9p/extreme_rationality_its_not_that_great/