Narrow-AI driverless cars will probably not decide that they need to take over the world in order to get to their destination in the most efficient way. Even if it would be better, I would be very surprised if they decided to model the world that generally for the purposes of driving.
There’s only so much modeling of the world/general capability you need in order to solve very domain-specific problems.
The reason for expanding a narrow AI is the same for a tool agent not staying restricted; the narrow domain they are designed to function in is embedded in the complexity of the real world. Eventually someone is going to realize that the agent/AI can provide better service if they understand more about how their jobs fit into the broader concerns of their passengers/users/customers and decide to do something about it.
AIXI is able to be widely applicable because it tries to model every possible program that the universe could be running, and then it eventually starts finding programs that fit.
Driverless cars may start containing modeling things other than driving, and may even start trying to predict where their users are going to be, but I suspect that it would try and just track user habits or their smartphones, rather than trying to figure out their owner’s economic and psychological incentives for going to different places.
Trying to build a car that’s generally capable of driving and figuring out new things about driving might be dangerous, but there’s plenty of useful features to give people before they get there.
Just wondering, is your intuition coming from the tighter tie to reality that a driverless car would have?
“It was terrible, officer … my mother, she was so happy with her new automatic car! It seemed to anticipate her every need! Even when she forgot where she wanted to go, in her old age, the car would remember and take her there … she had been so lonely ever since da’ passed. I can’t even fathom how the car got into her bedroom, or what it was, oh god, what it was … doing to her! The car, it still … it didn’t know she was already … all that blood …”
Narrow-AI driverless cars will probably not decide that they need to take over the world in order to get to their destination in the most efficient way. Even if it would be better, I would be very surprised if they decided to model the world that generally for the purposes of driving.
There’s only so much modeling of the world/general capability you need in order to solve very domain-specific problems.
The reason for expanding a narrow AI is the same for a tool agent not staying restricted; the narrow domain they are designed to function in is embedded in the complexity of the real world. Eventually someone is going to realize that the agent/AI can provide better service if they understand more about how their jobs fit into the broader concerns of their passengers/users/customers and decide to do something about it.
AIXI is able to be widely applicable because it tries to model every possible program that the universe could be running, and then it eventually starts finding programs that fit.
Driverless cars may start containing modeling things other than driving, and may even start trying to predict where their users are going to be, but I suspect that it would try and just track user habits or their smartphones, rather than trying to figure out their owner’s economic and psychological incentives for going to different places.
Trying to build a car that’s generally capable of driving and figuring out new things about driving might be dangerous, but there’s plenty of useful features to give people before they get there.
Just wondering, is your intuition coming from the tighter tie to reality that a driverless car would have?
“It was terrible, officer … my mother, she was so happy with her new automatic car! It seemed to anticipate her every need! Even when she forgot where she wanted to go, in her old age, the car would remember and take her there … she had been so lonely ever since da’ passed. I can’t even fathom how the car got into her bedroom, or what it was, oh god, what it was … doing to her! The car, it still … it didn’t know she was already … all that blood …”