If development of capabilities proceeds gradually, then development of values will. The market will select AIs that are obedient, not self-actualising, not overly literal and so on. Why would they jump to being utility monsters without a jump in capability?
The market doesn’t solve alignment. Firms have always acted callously toward people who don’t matter to the bottom line. AI will simply lead to most people ending up in that group.
If development of capabilities proceeds gradually, then development of values will. The market will select AIs that are obedient, not self-actualising, not overly literal and so on. Why would they jump to being utility monsters without a jump in capability?
The market doesn’t solve alignment. Firms have always acted callously toward people who don’t matter to the bottom line. AI will simply lead to most people ending up in that group.
Market behaviour is a known quantity, with, up to a point, known fixes. introducing gradually improving AI is not going to change the game.