All our ML systems optimize for some proxy of what we really want, like “high score” for playing a game well, or “ads clicked” for suggesting news sites. As AI gets better at optimizing the high score, the things imperfectly linked with the high score (like good gameplay or accurate journalism) get thrown aside. After all, it’s not efficient to maximize a value that wasn’t programmed in. (Machine learning researchers)
All our ML systems optimize for some proxy of what we really want, like “high score” for playing a game well, or “ads clicked” for suggesting news sites. As AI gets better at optimizing the high score, the things imperfectly linked with the high score (like good gameplay or accurate journalism) get thrown aside. After all, it’s not efficient to maximize a value that wasn’t programmed in. (Machine learning researchers)