It’s a short post, so you can read it quickly. What do you think about his argument?
I think it’s silly. I suspect MIRI and every other singulatarian organization, and every other individual working on the challeges of unfriendly AI, could fit comfortably in a 100-person auditorium.
In contrast, “trying to fix industrial capitalism” is one of the main topics of political dispute everywhere in the world. “How to make markets work better” is one of the main areas of research in economics. The American Economic Association has 18,000 members. We have half a dozen large government agencies, with budgets of hundreds of millions of dollars each, to protecting people from hostile capitalism. (The SEC, the OCC, the FTC, etc etc, are all ultimately about trying to curb capitalist excess. Each of these organizations has a large enforcement bureaucracy, and also a number of full-time salaried researchers.)
The resources and human energy devoted to unfriendly AI are tiny compared to the amount expended on politics and economics. So it’s strange to complain about the diversion of resources.
Excellent point. I’m surprised this did not occur to me. This reminds me of Scott Aaronson’s reply when someone suggested that quantum computational complexity is quite unimportant compared to experimental approaches to quantum computing and therefore shouldn’t get much funding:
I find your argument extremely persuasive—assuming, of course, that we’re both talking about Bizarro-World, the place where quantum complexity research commands megabillions and is regularly splashed across magazine covers, while Miley Cyrus’s twerking is studied mostly by a few dozen nerds who can all fit in a seminar room at Dagstuhl.
I think it’s silly. I suspect MIRI and every other singulatarian organization, and every other individual working on the challeges of unfriendly AI, could fit comfortably in a 100-person auditorium.
It looks to me like the room in this picture contains more than 100 people.
Yes. I will revise upwards my impression of how many people are working on Singularity topics. That said, not everybody who showed up at the summit was working on singularity-problems. Some were just interested bystanders.
I think it’s silly. I suspect MIRI and every other singulatarian organization, and every other individual working on the challeges of unfriendly AI, could fit comfortably in a 100-person auditorium.
In contrast, “trying to fix industrial capitalism” is one of the main topics of political dispute everywhere in the world. “How to make markets work better” is one of the main areas of research in economics. The American Economic Association has 18,000 members. We have half a dozen large government agencies, with budgets of hundreds of millions of dollars each, to protecting people from hostile capitalism. (The SEC, the OCC, the FTC, etc etc, are all ultimately about trying to curb capitalist excess. Each of these organizations has a large enforcement bureaucracy, and also a number of full-time salaried researchers.)
The resources and human energy devoted to unfriendly AI are tiny compared to the amount expended on politics and economics. So it’s strange to complain about the diversion of resources.
Excellent point. I’m surprised this did not occur to me. This reminds me of Scott Aaronson’s reply when someone suggested that quantum computational complexity is quite unimportant compared to experimental approaches to quantum computing and therefore shouldn’t get much funding:
It looks to me like the room in this picture contains more than 100 people.
Yes. I will revise upwards my impression of how many people are working on Singularity topics. That said, not everybody who showed up at the summit was working on singularity-problems. Some were just interested bystanders.