Yeah it does seem unfortunate that there’s not a robust pipeline for tackling the “hard problem” (even conditioned to more “moderate” models of x-risk)
But (conditioned on “moderate” models) there’s still a log of low-hanging fruit that STEM people from average universities (a group I count myself among) can pick. Like it seems good for Alice to bounce off of ELK and work on technical governance, and for Bob to make incremental progress on debate. The current pipeline/incentive system is still valuable, even if it systematically neglects tackling the “hard problem of alignment”.
Yeah it does seem unfortunate that there’s not a robust pipeline for tackling the “hard problem” (even conditioned to more “moderate” models of x-risk)
But (conditioned on “moderate” models) there’s still a log of low-hanging fruit that STEM people from average universities (a group I count myself among) can pick. Like it seems good for Alice to bounce off of ELK and work on technical governance, and for Bob to make incremental progress on debate. The current pipeline/incentive system is still valuable, even if it systematically neglects tackling the “hard problem of alignment”.