AI won’t have wishes or desires. There is no correlation in the animal kingdom between desires and cognitive function (the desire to climb on the social hierarchy or to have sex is preserved no matter the level of intelligence). Dumb humans want basically the same things as bright humans. All that suggests that predictive modeling of the world is totally decoupled from wishes and desires.
I suppose it is theoretically possible to build a system that also incorporates desires, but why would we do that? We want Von Neuman’s cognitive abilities, not Von Neuman’s personality.
AI won’t have wishes or desires. There is no correlation in the animal kingdom between desires and cognitive function (the desire to climb on the social hierarchy or to have sex is preserved no matter the level of intelligence). Dumb humans want basically the same things as bright humans. All that suggests that predictive modeling of the world is totally decoupled from wishes and desires.
I suppose it is theoretically possible to build a system that also incorporates desires, but why would we do that? We want Von Neuman’s cognitive abilities, not Von Neuman’s personality.