Yeah, there are plenty of examples of dictators that go through great lengths to inflict tremendous amounts of pain on many people. It’s terrifying to think of someone like that in control of an AGI.
Granted, people like that probably tend to be less likely than the average head-of-state to find themselves in control of an AGI, since brutal dictators often have unhealthy economies, and are therefore unlikely to win an AGI race. But it’s not like they have a monopoly on revenge or psychopathy either.
I think sociopaths are about 4% of the population, so your scenario isn’t really that implausible. I just meant if all of societies’ values change over time. Or just the FAI extracting out “true” utility function which includes all the negative stuff, like desire for revenge.
Yeah, there are plenty of examples of dictators that go through great lengths to inflict tremendous amounts of pain on many people. It’s terrifying to think of someone like that in control of an AGI.
Granted, people like that probably tend to be less likely than the average head-of-state to find themselves in control of an AGI, since brutal dictators often have unhealthy economies, and are therefore unlikely to win an AGI race. But it’s not like they have a monopoly on revenge or psychopathy either.
I think sociopaths are about 4% of the population, so your scenario isn’t really that implausible. I just meant if all of societies’ values change over time. Or just the FAI extracting out “true” utility function which includes all the negative stuff, like desire for revenge.