A lot of reasonable AI alignment ideas are only going to be relevant post-singularity, and changing understanding of timelines keeps reshuffling them out of current relevance. Turns out LLM human imitations very likely can be very capable on their own, without a separate AGI needed to build them up. AI alignment is so poorly understood that any capable AIs that are not just carefully chosen human imitations are going to be more dangerous, that seems like a solid bet for the next few years before LLMs go full AGI. So alignment concerns about such AIs (that are not just human imitations) should be post-singularity concerns for the human imitations to worry about.
A lot of reasonable AI alignment ideas are only going to be relevant post-singularity, and changing understanding of timelines keeps reshuffling them out of current relevance. Turns out LLM human imitations very likely can be very capable on their own, without a separate AGI needed to build them up. AI alignment is so poorly understood that any capable AIs that are not just carefully chosen human imitations are going to be more dangerous, that seems like a solid bet for the next few years before LLMs go full AGI. So alignment concerns about such AIs (that are not just human imitations) should be post-singularity concerns for the human imitations to worry about.
How do we get LLM human imitations?
I meant the same thing as masks/simulacra.
Though currently I’m more bullish about the shoggoths, because masks probably fail alignment security, even though their alignment might be quite robust despite the eldritch substrate.