I mentioned some specific biases that seem especially likely to cause risk for an FAI team. Is that the kind of “understanding” you’re talking about, or something else?
I think that falls under my parenthetical comment in the first paragraph. Understanding what rationality-type skills would make this specific thing go well is obviously useful, but it would also be great if we had a general understanding of what rationality-type skills naturally vary together, so that we can use phrases like “more rational” and have a better idea of what they refer to across different contexts.
It seems like there would probably be better ways to spend the extra resources if we had them though.
Maybe? Note that if people like Holden have concerns about whether FAI is too dangerous, that might make them more likely to provide resources toward a separate FAI feasibility team than toward, say, a better FAI team, so it’s not necessarily a fixed heap of resources that we’re distributing.
I think that falls under my parenthetical comment in the first paragraph. Understanding what rationality-type skills would make this specific thing go well is obviously useful, but it would also be great if we had a general understanding of what rationality-type skills naturally vary together, so that we can use phrases like “more rational” and have a better idea of what they refer to across different contexts.
Maybe? Note that if people like Holden have concerns about whether FAI is too dangerous, that might make them more likely to provide resources toward a separate FAI feasibility team than toward, say, a better FAI team, so it’s not necessarily a fixed heap of resources that we’re distributing.