The plausible story in movement-building is not convincing existing AGI PIs to stop a long program of research, but instead convincing younger people who would otherwise eventually become AGI researchers to do something safer. The evidence to look for would be people who said “well, I was going to do AI research but instead I decided to get involved with SingInst type goals”—and I suspect someone who knows the community better might be able to cite quite a few people for whom this is true, though I don’t have any names myself.
I didn’t think of that. I expect current researchers to be dead or nearly senile by the time we have plentiful human substitutes/emulations, so I shouldn’t care that incumbents are unlikely to change careers (except for the left tail—I’m very vague in my expectation).
The plausible story in movement-building is not convincing existing AGI PIs to stop a long program of research, but instead convincing younger people who would otherwise eventually become AGI researchers to do something safer. The evidence to look for would be people who said “well, I was going to do AI research but instead I decided to get involved with SingInst type goals”—and I suspect someone who knows the community better might be able to cite quite a few people for whom this is true, though I don’t have any names myself.
I didn’t think of that. I expect current researchers to be dead or nearly senile by the time we have plentiful human substitutes/emulations, so I shouldn’t care that incumbents are unlikely to change careers (except for the left tail—I’m very vague in my expectation).