I will say that it doesn’t even seem to be possible for there to be people who don’t rationalize. (Or enough that you’re at all likely to find them.)
You’d think not. Yet even Eliezer seems to think that one of our case studies really, truly might not ever rationalize and possibly never has before. This seems to be a case of a beautiful, sane theory beaten to death by a small gang of brutal facts.
“Some”, “signs”, “rather”. These words all show signs of being rather belief in belief. I notice you don’t say, “Some of these people are high-level rationalists,” just that they show warning signs of being so. What does this really mean?
It means that I don’t know how to measure how strong someone’s rationality skills are other than talking to others whom I intuitively want to say are good rationalists and comparing notes. So I’m hedging my assertions. But to whatever degree several people at the Singularity Institute are able to figure out who is or is not a reasonably good rationalist, some of our sample “non-rationalizers” appear to us to be good rationalists, and some appear not to be so.
Also, could you explain what you mean by “seem to have little clue what Tarski is for”?
Sure. We tell them the kinds of situations in which Tarski is useful, including some personal examples of our own applications of it, and they just blink at us and completely fail to relate. For instance, I might say, “So once I was walking past a pizza place and smelled pizza. Cheese turns out to be really bad for me, but at the time I was hungry. So I watched my mind construct arguments like, ‘I haven’t gotten much calcium for the last while.’” Nothing of this sort—fake justification, selective search, nothing—seems to connect to something they can relate to. So they just don’t see where they’d ever use Tarski.
And yes, we’ve had at least one person be openly skeptical that anyone could possibly find Tarski useful because he didn’t think anyone rationalized the way we were describing. And another of our case studies seemed to know rationalization only as a joke. (“The cake has fewer calories and doesn’t count if I eat it while standing, right?”)
Good points.
I’m not trying to sneak in connotations, by the way. We’re just talking about the fact that these people seem to be quite good at things like goal-factoring, VOI calculations, etc.