Intelligence and final goals are orthogonal axes along which possible agents can freely vary. In other words,
more or less any level of intelligence could in principle be
combined with more or less any final goal.
It seems true—but pretty irrelevant. We mostly care about real world agents—not what could “in principle” be constructed. It’s a kind of weasel wording—no doubt intended to provoke concern about evil geniuses.
It seems true—but pretty irrelevant. We mostly care about real world agents—not what could “in principle” be constructed. It’s a kind of weasel wording—no doubt intended to provoke concern about evil geniuses.