Eliezer: It sure seems to me that our evolution and culture constructed ethical attitudes are entangled with the world. By the way, I don’t think that we agree at all about what “I find it quite easy to imagine” means, but of course, some words, like “I”, are tricky. It might be more interesting to ask “what data could I give a soundly designed AGI that would convince it that 2+2=3?” For you and for sound AGI designs, I’d like to know what situation would be convincing regarding the proposition “beliefs should not respond to evidence or to reasoning”.
Doug: we can all reduce entropy in physical systems. This does, however, require that we act upon those systems, but the god you are discussing would also be acting upon the systems where it reversed entropy, right?
Ben: I’m pretty sure that “Christianity is true” is not a hypothesis. Believing something more specific, like Jesus was born to a Virgin and returned 3 days after being buried doesn’t present any serious problems.
Eliezer: It sure seems to me that our evolution and culture constructed ethical attitudes are entangled with the world. By the way, I don’t think that we agree at all about what “I find it quite easy to imagine” means, but of course, some words, like “I”, are tricky. It might be more interesting to ask “what data could I give a soundly designed AGI that would convince it that 2+2=3?” For you and for sound AGI designs, I’d like to know what situation would be convincing regarding the proposition “beliefs should not respond to evidence or to reasoning”.
Doug: we can all reduce entropy in physical systems. This does, however, require that we act upon those systems, but the god you are discussing would also be acting upon the systems where it reversed entropy, right?
Ben: I’m pretty sure that “Christianity is true” is not a hypothesis. Believing something more specific, like Jesus was born to a Virgin and returned 3 days after being buried doesn’t present any serious problems.