eventually we should be able to press a button and recreate the entire world however we want.
Confusing, unclear what that means. First idea is that you’re talking about virtual world, but that doesn’t fit. When applied to the physical world, it doesn’t seem to follow from your presentation.
So if we ever get to the point of having that button, it’s very important that we know exactly what we want. And not at the level of “I want a sandwich right now,” at the level of actually programming it into a computer.
So we have to understand the sandwich wish at the level of actually programming it into computer, right? (Misleading.)
humans evolved into a world with only chimpanzees.
There were Neanderthals etc., but probably neither is particularly relevant for the “evolved” part, which itself doesn’t seem to relate to the point.
And if you don’t want the world to be a Luddite dictatorship, you have to imagine that people will keep creating AIs
But I do want the world to be a Luddite dictatorship. Where do I sign? Do I now have to imagine that people won’t keep creating AIs, to complete the ritual? (Not wanting this is irrelevant, it just won’t happen.)
It’s almost as if you aren’t the target audience. Or that shifting a back-and-forth, feel-it-out, one-on-one conversation to broad, vague text is a difficult translation procedure.
Confusing, unclear what that means. First idea is that you’re talking about virtual world, but that doesn’t fit. When applied to the physical world, it doesn’t seem to follow from your presentation.
So we have to understand the sandwich wish at the level of actually programming it into computer, right? (Misleading.)
There were Neanderthals etc., but probably neither is particularly relevant for the “evolved” part, which itself doesn’t seem to relate to the point.
But I do want the world to be a Luddite dictatorship. Where do I sign? Do I now have to imagine that people won’t keep creating AIs, to complete the ritual? (Not wanting this is irrelevant, it just won’t happen.)
(Stopped reading at this point.)
It’s almost as if you aren’t the target audience. Or that shifting a back-and-forth, feel-it-out, one-on-one conversation to broad, vague text is a difficult translation procedure.