If you think AI researchers won’t co operate on friendly AI, then FAI is doomed. If people are going to cooperate. they can agree on restricting AI to oracles as well as any other measure.
I’m trying to interpret this in a way that makes it true, but I can’t make “AI researchers” a well-defined set in that case. There are plenty of people working on AI who aren’t capable of creating a strong AI, but it’s hard to know in advance exactly which few researchers are the exception.
I don’t think we know yet which people will need to cooperate for FAI to succeed.
If you think AI researchers won’t co operate on friendly AI, then FAI is doomed. If people are going to cooperate. they can agree on restricting AI to oracles as well as any other measure.
I’m trying to interpret this in a way that makes it true, but I can’t make “AI researchers” a well-defined set in that case. There are plenty of people working on AI who aren’t capable of creating a strong AI, but it’s hard to know in advance exactly which few researchers are the exception.
I don’t think we know yet which people will need to cooperate for FAI to succeed.