I fail to see how Wright’s answer is even remotely relevant. Let’s say that for some mysterious reason brains have a door that connects them to some metaphysical realm that silicon-based devices could never have. Does this changes the fact that a properly programmed computer can beat any human at chess or checkers? Does this changes the fact that cars can self-drive successfully for thousands of miles? Does this changes the fact that right now a living organism is being simulated at cellular level? The only thing that distinguishes the Singualirty scenario from a simple observation of the state of the world is the assumption that there is a point after which an AI can exponentially self-improve, and that will have an exponentially large effect on our society.
The fact that Albert Einstein existed wouldn’t provide as much evidence for the future likelihood of science-doing AI if brains had such doors, although you are correct that this wouldn’t mean we sill could not develop such AIs.
I fail to see how Wright’s answer is even remotely relevant. Let’s say that for some mysterious reason brains have a door that connects them to some metaphysical realm that silicon-based devices could never have.
Does this changes the fact that a properly programmed computer can beat any human at chess or checkers? Does this changes the fact that cars can self-drive successfully for thousands of miles? Does this changes the fact that right now a living organism is being simulated at cellular level?
The only thing that distinguishes the Singualirty scenario from a simple observation of the state of the world is the assumption that there is a point after which an AI can exponentially self-improve, and that will have an exponentially large effect on our society.
The fact that Albert Einstein existed wouldn’t provide as much evidence for the future likelihood of science-doing AI if brains had such doors, although you are correct that this wouldn’t mean we sill could not develop such AIs.