ETA: Reasoning about counterfactual states of knowledge is really hard; not only practically speaking ’cuz brains aren’t meant to do that, but theoretically too, which is why people get really confused about anthropics. The later point deserves a post I mean Facebook status update at some point.
That’s true. It’s tricky enough that Eliezer seems to get confused about it (or at least I thought he was confusing himself back when he wrote a post or two on the subject.)
That’s true. It’s tricky enough that Eliezer seems to get confused about it (or at least I thought he was confusing himself back when he wrote a post or two on the subject.)