If Eliezer’s objection were valid, he should have been able to come up with a scenario in which the algorithm Google Maps used to choose a route could pose a threat. It doesn’t matter what else he says, if he can’t show that.
The discussion was about AGI. The algorithm the real Google Maps actually uses is irrelevant, since it is not an AGI. “Tool AI” does not simply mean “Narrow AI”.
The point is not what algorithm google maps uses. The point is that google maps does not model the user, and try to manipulate the user. Google maps is asked for a short way to get between two points, and it finds such a route and reports it. It is invulnerable to all the objections Eliezer makes, even though it is the example Eliezer began with when making his objections!
The discussion was about AGI. The algorithm the real Google Maps actually uses is irrelevant, since it is not an AGI. “Tool AI” does not simply mean “Narrow AI”.
The point is not what algorithm google maps uses. The point is that google maps does not model the user, and try to manipulate the user. Google maps is asked for a short way to get between two points, and it finds such a route and reports it. It is invulnerable to all the objections Eliezer makes, even though it is the example Eliezer began with when making his objections!