In Friendly Teams Robin Hanson talks about the guy who tried to get his company to undergo recursive self-improvement and how he was a really smart fellow who saw a lot of things coming.
Robin Hanson further argues that key insights are not enough but that it takes many small insights that are the result of a whole society of agents.
Robin further asks what it is that makes the singleton AI scenario more reasonable if does not work out for groups of humans, not even remotely. Well, I can see that people would now say that an AI can directly improve its own improvement algorithm. I suppose the actual question that Robin asks is how the AI will reach that point in the first place. How is it going to acquire the capabilities that are necessary to improve its capabilities indefinitely.
In Friendly Teams Robin Hanson talks about the guy who tried to get his company to undergo recursive self-improvement and how he was a really smart fellow who saw a lot of things coming.
Robin Hanson further argues that key insights are not enough but that it takes many small insights that are the result of a whole society of agents.
Robin further asks what it is that makes the singleton AI scenario more reasonable if does not work out for groups of humans, not even remotely. Well, I can see that people would now say that an AI can directly improve its own improvement algorithm. I suppose the actual question that Robin asks is how the AI will reach that point in the first place. How is it going to acquire the capabilities that are necessary to improve its capabilities indefinitely.