I think this is a good answer to Eliezer’s thought experiment. Teach those budding rationalists about the human desire to conform even in the face of the prima facie ridiculousness of the prevailing beliefs.
Teach them about greens and blues; teach them about Easter Islanders building statues with their last failing stock of resources (or is that too close to teaching about religion?). Teach them how common the pattern is: when something is all around you, you are less likely to doubt its wisdom.
Human rationality (at least for now) is still built on the blocks and modules provided to us by evolution. They can lead us astray, like the “posit agency” module firing when no agent is there. But they can also be powerful correctives. A pattern-recognizing module is a dangerous thing when we create imaginary patterns… but, oh boy, when there actually is a pattern there, let that module rip!
I think this is a good answer to Eliezer’s thought experiment. Teach those budding rationalists about the human desire to conform even in the face of the prima facie ridiculousness of the prevailing beliefs.
Teach them about greens and blues; teach them about Easter Islanders building statues with their last failing stock of resources (or is that too close to teaching about religion?). Teach them how common the pattern is: when something is all around you, you are less likely to doubt its wisdom.
Human rationality (at least for now) is still built on the blocks and modules provided to us by evolution. They can lead us astray, like the “posit agency” module firing when no agent is there. But they can also be powerful correctives. A pattern-recognizing module is a dangerous thing when we create imaginary patterns… but, oh boy, when there actually is a pattern there, let that module rip!