Give your goal to an AI, it might optimize the goal. Give your goal to a future more-powerful AI, and it might optimize you. (Machine learning researchers)
AI capabilities will inevitably reach a point where manmade systems optimize our thinking more than we optimize theirs. When that happens, things will get really complicated, really quickly. It will make today’s AI situation look like child’s play.
Give your goal to an AI, it might optimize the goal. Give your goal to a future more-powerful AI, and it might optimize you. (Machine learning researchers)
AI capabilities will inevitably reach a point where manmade systems optimize our thinking more than we optimize theirs. When that happens, things will get really complicated, really quickly. It will make today’s AI situation look like child’s play.