A mad scientist building an AI in his basement doesn’t have to compromise with anyone, … until he has to go out and get funding, that is.
So he’ll get funding for one thing, and then secretly build something else. Or he’ll wait and in another 20 years the hardware will be cheap enough that he won’t need external funding. Or he’ll get funding from a rich individual, which would result in a compromise between a total of 2 people—not a great improvement.
So he’ll get funding for one thing, and then secretly build something else. Or he’ll wait and in another 20 years the hardware will be cheap enough that he won’t need external funding. Or he’ll get funding from a rich individual, which would result in a compromise between a total of 2 people—not a great improvement.
Or, even more likely, some other team of researchers, more tolerant of compromise, will construct a FOOMing AGI first.