A very thought-provoking and well-written article. Thanks!
Thanks, I think the time dilation issue is not typically considered in visions of future AGI society and could prove to be a powerful constraint.
That is, and experience of some thought/communication speed ratio for a hyperintelligence would be “like” a human experience of that same ratio
But hyperintelligences aren’t just faster. I think they’d probably be very very different qualitatively. Who knows if the costs / benefits of time-consuming communication will be perceived in similar or even recognizable ways?
I agree they will probably think differently, if not immediately then eventually as the space of mind architectures is explored.
Still we can analyze the delay factor from an abstract computational point of view and reach some conclusions without getting into specific qualitative features of what certain types of thought are “like”.
I find it hard to estimate likelihoods of different types of qualitative divergences from human-like mind architectures.
On the one hand we have the example of early cells such as bacteria which radiated into a massive array of specialized forms, but life is all built around variations of a few old general designs for cells. So are human minds like that? Is that the right analogy?
On the other hand we can see human brain architecture as just one particular point in a vast space of possibility.
Thanks, I think the time dilation issue is not typically considered in visions of future AGI society and could prove to be a powerful constraint.
I agree they will probably think differently, if not immediately then eventually as the space of mind architectures is explored.
Still we can analyze the delay factor from an abstract computational point of view and reach some conclusions without getting into specific qualitative features of what certain types of thought are “like”.
I find it hard to estimate likelihoods of different types of qualitative divergences from human-like mind architectures.
On the one hand we have the example of early cells such as bacteria which radiated into a massive array of specialized forms, but life is all built around variations of a few old general designs for cells. So are human minds like that? Is that the right analogy?
On the other hand we can see human brain architecture as just one particular point in a vast space of possibility.