I’m sorry, I just don’t have time to engage on these points right now. You’re talking about the alignment problem. It’s the biggest topic on LessWrong. You’re assuming it won’t be solved, but that’s hotly debated among people like me who spend tons of time on the details of the debate.
My recommended starting point is my Cruxes of disagreement on alignment difficulty post. It explains why some people think it’s nearly impossible, some think it’s outright easy, and people like me who think it’s possible but not easy are working like mad to solve it before people actually build AGI.
I’m sorry, I just don’t have time to engage on these points right now. You’re talking about the alignment problem. It’s the biggest topic on LessWrong. You’re assuming it won’t be solved, but that’s hotly debated among people like me who spend tons of time on the details of the debate.
My recommended starting point is my Cruxes of disagreement on alignment difficulty post. It explains why some people think it’s nearly impossible, some think it’s outright easy, and people like me who think it’s possible but not easy are working like mad to solve it before people actually build AGI.