Anecdotally: even if I could write this post, I never would have, because I would assume that Eliezer cares more about writing, has better writing skills, and has a much wider audience. In short, why would I write this when Eliezer could write it?
You might want to be a lot louder if you think it’s a mistake to leave you as the main “public advocate / person who writes stuff down” person for the cause.
a mistake to leave you as the main “public advocate / person who writes stuff down” person for the cause.
It sort of sounds like you’re treating him as the sole “person who writes stuff down”, not just the “main” one. Noam Chomsky might have been the “main linguistics guy” in the late 20th century, but people didn’t expect him to write more than a trivial fraction of the field’s output, either in terms of high-level overviews or in-the-trenches research.
I think EY was pretty clear in the OP that this is not how things go on earths that survive. Even if there aren’t many who can write high-level alignment overviews today, more people should make the attempt and try to build skill.
In the counterfactual world where Eliezer was totally happy continuing to write articles like this and being seen as the “voice of AI Safety”, would you still agree that it’s important to have a dozen other people also writing similar articles?
I’m genuinely lost on the value of having a dozen similar papers—I don’t know of a dozen different versions of fivethirtyeight.com or GiveWell, and it never occurred to me to think that the world is worse for only having one of those.
We have to actually figure out how to build aligned AGI, and the details are crucial. If you’re modeling this as a random blog post aimed at persuading people to care about this cause area, a “voice of AI safety” type task, then sure, the details are less important and it’s not so clear that Yet Another Marginal Blog Post Arguing For “Care About AI Stuff” matters much.
But humanity also has to do the task of actually figuring out and implementing alignment. If not here, then where, and when? If here—if this is an important part of humanity’s process of actually figuring out the exact shape of the problem, clarifying our view of what sorts of solutions are workable, and solving it—then there is more of a case that this is a conversation of real consequence, and having better versions of this conversation sooner matters.
He wasn’t designated “main person who writes stuff down” by a cabal of AI safety elders. He’s not personally responsible for the fate of the world—he just happens to be the only person who consistently writes cogent things down. If you want you can go ahead and devote your life to AI safety, start doing the work he does as effectively and realistically as he does it, and then you’ll eventually be designated Movement Leader and have the opportunity to be whined at. He was pretty explicitly clear in the post that he does not want to be this and that he spent the last fifteen years trying to find someone else who can do what he does.
I largely agree with you, but until this post I had never realized that this wasn’t a role Eliezer wanted. If I went into AI Risk work, I would have focused on other things—my natural inclination is to look at what work isn’t getting done, and to do that.
If this post wasn’t surprising to you, I’m curious where you had previously seen him communicate this?
If this post was surprising to you, then hopefully you can agree with me that it’s worth signal boosting that he wants to be replaced?
Anecdotally: even if I could write this post, I never would have, because I would assume that Eliezer cares more about writing, has better writing skills, and has a much wider audience. In short, why would I write this when Eliezer could write it?
You might want to be a lot louder if you think it’s a mistake to leave you as the main “public advocate / person who writes stuff down” person for the cause.
It sort of sounds like you’re treating him as the sole “person who writes stuff down”, not just the “main” one. Noam Chomsky might have been the “main linguistics guy” in the late 20th century, but people didn’t expect him to write more than a trivial fraction of the field’s output, either in terms of high-level overviews or in-the-trenches research.
I think EY was pretty clear in the OP that this is not how things go on earths that survive. Even if there aren’t many who can write high-level alignment overviews today, more people should make the attempt and try to build skill.
In the counterfactual world where Eliezer was totally happy continuing to write articles like this and being seen as the “voice of AI Safety”, would you still agree that it’s important to have a dozen other people also writing similar articles?
I’m genuinely lost on the value of having a dozen similar papers—I don’t know of a dozen different versions of fivethirtyeight.com or GiveWell, and it never occurred to me to think that the world is worse for only having one of those.
Here’s my answer: https://www.lesswrong.com/posts/uMQ3cqWDPHhjtiesc/agi-ruin-a-list-of-lethalities?commentId=LowEED2iDkhco3a5d
We have to actually figure out how to build aligned AGI, and the details are crucial. If you’re modeling this as a random blog post aimed at persuading people to care about this cause area, a “voice of AI safety” type task, then sure, the details are less important and it’s not so clear that Yet Another Marginal Blog Post Arguing For “Care About AI Stuff” matters much.
But humanity also has to do the task of actually figuring out and implementing alignment. If not here, then where, and when? If here—if this is an important part of humanity’s process of actually figuring out the exact shape of the problem, clarifying our view of what sorts of solutions are workable, and solving it—then there is more of a case that this is a conversation of real consequence, and having better versions of this conversation sooner matters.
He wasn’t designated “main person who writes stuff down” by a cabal of AI safety elders. He’s not personally responsible for the fate of the world—he just happens to be the only person who consistently writes cogent things down. If you want you can go ahead and devote your life to AI safety, start doing the work he does as effectively and realistically as he does it, and then you’ll eventually be designated Movement Leader and have the opportunity to be whined at. He was pretty explicitly clear in the post that he does not want to be this and that he spent the last fifteen years trying to find someone else who can do what he does.
I largely agree with you, but until this post I had never realized that this wasn’t a role Eliezer wanted. If I went into AI Risk work, I would have focused on other things—my natural inclination is to look at what work isn’t getting done, and to do that.
If this post wasn’t surprising to you, I’m curious where you had previously seen him communicate this?
If this post was surprising to you, then hopefully you can agree with me that it’s worth signal boosting that he wants to be replaced?