I think that’s the important question. It deserves a lot more thought. I’m planning a post focusing on this.
In short, if they’re remotely decent people (positive empathy—sadism balance), I think they do net-good things, and the world gets way way better, and increasingly so over time as those individuals get wiser. With an AGI/ASI, it becomes trivially easy to help people, so very little good intention is required.
I think that’s the important question. It deserves a lot more thought. I’m planning a post focusing on this.
In short, if they’re remotely decent people (positive empathy—sadism balance), I think they do net-good things, and the world gets way way better, and increasingly so over time as those individuals get wiser. With an AGI/ASI, it becomes trivially easy to help people, so very little good intention is required.