It seems unlikely that anyone is going to get the knowledge base to build an AGI from simply being exposed to a few memes here
Agreed; I was remarking on the danger of being exposed to a few memes on the Uber Less Wrong that we seek to become. Memes which we may have designed to be very accessible and enticing to lay readers.
Those people don’t generally want to destroy the world, because the world is where their toys are
With a population of seven billion, it’s hard not to commit a weak version of the typical mind fallacy and assume you can assume anything about people’s motivations.
As technology improves, people individual have more destructive power
OK; so we should regard as risky any technology or social structure which we expect to significantly advance the rate of technological progress.
With a population of seven billion, it’s hard not to commit a weak version of the typical mind fallacy and assume you can assume anything about people’s motivations.
Diverse as we all are, humans occupy but a tiny pin-point in the mind-design space of all possible intelligent agents. That our values are mostly aligned is one reason that there are so many opportunities for the positive-sum exchanges that have fueled the economic growth of the past several hundred years. I rarely encounter anyone that really truly desires a future that I find horrible (though plenty claim to want such futures). On the other hand, plenty of people go about achieving their goals in all sorts of awfully inefficient ways.
Improving the world’s rationality to the point that people can actually achieve their goals seems like the least of our worries.
Agreed; I was remarking on the danger of being exposed to a few memes on the Uber Less Wrong that we seek to become. Memes which we may have designed to be very accessible and enticing to lay readers.
With a population of seven billion, it’s hard not to commit a weak version of the typical mind fallacy and assume you can assume anything about people’s motivations.
OK; so we should regard as risky any technology or social structure which we expect to significantly advance the rate of technological progress.
Diverse as we all are, humans occupy but a tiny pin-point in the mind-design space of all possible intelligent agents. That our values are mostly aligned is one reason that there are so many opportunities for the positive-sum exchanges that have fueled the economic growth of the past several hundred years. I rarely encounter anyone that really truly desires a future that I find horrible (though plenty claim to want such futures). On the other hand, plenty of people go about achieving their goals in all sorts of awfully inefficient ways.
Improving the world’s rationality to the point that people can actually achieve their goals seems like the least of our worries.