Spoiler Warning. Tried hiding it with >! and :::spoiler but neither seems to work.
For those unaware, this is a story (worth reading) about anti-memes, ideas that cannot be spread, so researchers have a hard time working with them, not knowing they exist. So the point of the parent comment probably is that even if an adequate AGI project existed we wouldn’t know about it.
I don’t think any AGI projects that exist today are anywhere near adequacy on all of these dimensions.
(And I don’t think we live in the sort of world where there could plausibly be a secret-to-me adequate project, right now in 2022.)
I could imagine optimistic worlds where an adequate project exists in the future but I or others publicly glomarize about whether it’s adequate (e.g., because we don’t want to publicly talk about the state of the project’s opsec or something)? Mostly, though, I think we’d want to loudly and clearly broadcast ‘this is the Good Project, the Schelling AGI project to put your resources into if you put your resources into any AGI project’, because part of the point is to facilitate coordination. And my current personal guess is that ‘is this adequate?’ would be useful public information in most worlds where an adequate project like that existed. In a sense this is really basic stuff, and should be more like ‘first-order-obvious boxes to check’.
I don’t think the SCP foundation actually exists. “We need to talk about fifty-five” is just a very well written, fictional story about a team of scientists trying to pacify “doomsday technology” within that universe that I think people here would enjoy reading. I also agree with you that everything you said is obviously true, and I probably mistakenly implied something really dumb by commenting that here without context.
I don’t actually necessarily think that, it’s just an interesting story. I feel like there are parallels somewhere, even if I don’t know where they are.
We need to talk about fifty-five.
Spoiler Warning. Tried hiding it with
>!and:::spoilerbut neither seems to work.For those unaware, this is a story (worth reading) about
anti-memes, ideas that cannot be spread, so researchers have a hard time working with them, not knowing they exist. So the point of the parent comment probably is thateven if an adequate AGI project existed we wouldn’t know about it.I don’t think any AGI projects that exist today are anywhere near adequacy on all of these dimensions.
(And I don’t think we live in the sort of world where there could plausibly be a secret-to-me adequate project, right now in 2022.)
I could imagine optimistic worlds where an adequate project exists in the future but I or others publicly glomarize about whether it’s adequate (e.g., because we don’t want to publicly talk about the state of the project’s opsec or something)? Mostly, though, I think we’d want to loudly and clearly broadcast ‘this is the Good Project, the Schelling AGI project to put your resources into if you put your resources into any AGI project’, because part of the point is to facilitate coordination. And my current personal guess is that ‘is this adequate?’ would be useful public information in most worlds where an adequate project like that existed. In a sense this is really basic stuff, and should be more like ‘first-order-obvious boxes to check’.
I don’t think the SCP foundation actually exists. “We need to talk about fifty-five” is just a very well written, fictional story about a team of scientists trying to pacify “doomsday technology” within that universe that I think people here would enjoy reading. I also agree with you that everything you said is obviously true, and I probably mistakenly implied something really dumb by commenting that here without context.
I haven’t read OP or know the context, but it was very enjoyable when skimming Recent Discussion to see someone feel the need to make this disclaimer.
FWIW I enjoyed the story when you posted it, and didn’t assume you were trying to make a specific new point with it. :)
I don’t actually necessarily think that, it’s just an interesting story. I feel like there are parallels somewhere, even if I don’t know where they are.