Is MIRI making an FAI only in regards to humans? That is, it would do whatever best aligned itself with what humans want?
If so, what would happen in the case of extra terrestrial contact? All sorts of nasty situations could occur e.g. them having an AI as well, with a fairly different set of goals, so the two AIs might engage in some huge and terrifying conflict. Or maybe they’d just agree to co-operate because the conflict would be too costly.
So have the researchers at MIRI put something like this as a goal?
Is MIRI making an FAI only in regards to humans? That is, it would do whatever best aligned itself with what humans want?
If so, what would happen in the case of extra terrestrial contact? All sorts of nasty situations could occur e.g. them having an AI as well, with a fairly different set of goals, so the two AIs might engage in some huge and terrifying conflict. Or maybe they’d just agree to co-operate because the conflict would be too costly.
So have the researchers at MIRI put something like this as a goal?