I realized I didn’t really reply to your first point, and that it’s a really important one.
We’re in agreement that scaffolded LLMs are a possible first route to AGI, but not a guaranteed one.
If that’s the path, timelines are relatively short.
If that’s a possibility, we’d better have alignment solutions for that possible path, ASAP.
That’s why I continue to focus on aligning LMAs.
If other paths to AGI turn out to be the first routes, timelines are probably a little longer, so we’ve got a little longer to work on alignment for those types of systems. And there are more people working on RL-based alignment schemes (I think?)
I realized I didn’t really reply to your first point, and that it’s a really important one.
We’re in agreement that scaffolded LLMs are a possible first route to AGI, but not a guaranteed one.
If that’s the path, timelines are relatively short.
If that’s a possibility, we’d better have alignment solutions for that possible path, ASAP.
That’s why I continue to focus on aligning LMAs.
If other paths to AGI turn out to be the first routes, timelines are probably a little longer, so we’ve got a little longer to work on alignment for those types of systems. And there are more people working on RL-based alignment schemes (I think?)
I’m glad you’re working on it! I think your arguments are plausible and your approach is potentially promising.