assuming you’re talking about futures in which AI hasn’t catastrophic outcomes, no one will be forcibly mandated to do anything
This isn’t clear to me: does every option that involves someone being forcibly mandated to do something qualify as a catastrophe? Conceptually, there seems to be a lot of room between the two.
I understand the analogy in Katja’s post as being: even in a great post-AGI world, everyone is forced to move to a post-AGI world. That world has higher GDP/capita, but it doesn’t necessarily contain the specific things people value about their current lives.
Just listing all the positive aspects of living in NYC (even if they’re very positive) might not remove all hesitation: I know my local community, my local parks, the beloved local festival that happens in August.
If all diseases have been cured in NYC and I’m hesitant because I’ll miss out on the festival, I’m probably not adequately taking the benefits into account. But if you tell me not to worry at all about moving to NYC, you’re also not taking all the costs into account / aren’t talking in a way that will connect with me.
This isn’t clear to me: does every option that involves someone being forcibly mandated to do something qualify as a catastrophe? Conceptually, there seems to be a lot of room between the two.
I understand the analogy in Katja’s post as being: even in a great post-AGI world, everyone is forced to move to a post-AGI world. That world has higher GDP/capita, but it doesn’t necessarily contain the specific things people value about their current lives.
Just listing all the positive aspects of living in NYC (even if they’re very positive) might not remove all hesitation: I know my local community, my local parks, the beloved local festival that happens in August.
If all diseases have been cured in NYC and I’m hesitant because I’ll miss out on the festival, I’m probably not adequately taking the benefits into account. But if you tell me not to worry at all about moving to NYC, you’re also not taking all the costs into account / aren’t talking in a way that will connect with me.