I agree with the view that trade with AI might not be a meaningful aspect related to dealing with risk or alignment—though I suspect it will be part of the story. I think the story for dogs is that initially the trade struck with humans may well have been a pretty good one. They ended up with a much more competent pack, ate and slept better for it and didn’t really lose any of their freedom or autonomy I suspect. Too long ago in the undocumented history to know but I don’t think today is a good indication of the partnership and cooperative relationship (trade relationship) that was true for much of the time.
I think that older setting is what one needs to consider in terms of any AI-human scenarios.
That isn’t very comforting. To extend the analogy: there was a period when humans were relatively less powerful when they would trade with some other animals such as wolves/dogs. Later, when humans became more powerful that stopped.
It is likely that the powers of AGI will increase relatively quickly, so even if you conclude there is a period when AGI will trade with humans that doesn’t help us that much.
I agree with the view that trade with AI might not be a meaningful aspect related to dealing with risk or alignment—though I suspect it will be part of the story. I think the story for dogs is that initially the trade struck with humans may well have been a pretty good one. They ended up with a much more competent pack, ate and slept better for it and didn’t really lose any of their freedom or autonomy I suspect. Too long ago in the undocumented history to know but I don’t think today is a good indication of the partnership and cooperative relationship (trade relationship) that was true for much of the time.
I think that older setting is what one needs to consider in terms of any AI-human scenarios.
That isn’t very comforting. To extend the analogy: there was a period when humans were relatively less powerful when they would trade with some other animals such as wolves/dogs. Later, when humans became more powerful that stopped.
It is likely that the powers of AGI will increase relatively quickly, so even if you conclude there is a period when AGI will trade with humans that doesn’t help us that much.