but the immediate advantage intelligence confers isn’t in setting those goals, it is in achieving them.
The goals that are sufficiently well defined for lower intelligence may become undefined for higher intelligence. Furthermore, in any accepted metric of intelligence, such as IQ test, we do not consider person’s tendency to procrastinate when trying to attain his stated goals to be part of ‘intelligence’. Furthermore, there’s more than one dimension to it. If you give a person some hallucinogenic drug, you’ll observe the outcome very distinct from simple diminishment of intelligence.
Or in an AI, if you rely on a self contradictory axiomatic system with the minimum length of proof to self contradiction of L, the intelligences that can not explore past L behave just fine while those that explore past L end up being able to prove a statement and it’s opposite. That may be happening in humans with regard to morality. If the primal rules, or the rules of inference are self contradictory, that incapacitates the higher reasoning and leaves the decisions to much less intelligent subsystems, with the intelligence only able to rationalize any action. Or the decision ends up dependent to which of A or ~A has shortest proof, or which proof invokes items that accidentally got cross wired to some sort of feeling of rightness. Either way the outcome looks bizarre and stupid.
The goals that are sufficiently well defined for lower intelligence may become undefined for higher intelligence. Furthermore, in any accepted metric of intelligence, such as IQ test, we do not consider person’s tendency to procrastinate when trying to attain his stated goals to be part of ‘intelligence’. Furthermore, there’s more than one dimension to it. If you give a person some hallucinogenic drug, you’ll observe the outcome very distinct from simple diminishment of intelligence.
Or in an AI, if you rely on a self contradictory axiomatic system with the minimum length of proof to self contradiction of L, the intelligences that can not explore past L behave just fine while those that explore past L end up being able to prove a statement and it’s opposite. That may be happening in humans with regard to morality. If the primal rules, or the rules of inference are self contradictory, that incapacitates the higher reasoning and leaves the decisions to much less intelligent subsystems, with the intelligence only able to rationalize any action. Or the decision ends up dependent to which of A or ~A has shortest proof, or which proof invokes items that accidentally got cross wired to some sort of feeling of rightness. Either way the outcome looks bizarre and stupid.