I think that the plans you lay out are all directly talking about the AI system we eventually build, and as a result I’m more optimistic about them (and your work, as it’s easy to see how it makes progress towards these plans) relative to HRAD.
In contrast, as far as I can tell, HRAD work does not directly contribute to any of these plans, and instead the case seems to rely on something more indirect where a better understanding of reasoning will later help us execute on one of these plans. It’s this indirection that makes me worried.
Well, HRAD certainly has relations to my own research programme. Embedded agency seems important since human values are probably “embedded” to some extent, counterfactuals are important for translating knowledge from the user’s subjective vantage point to the AI’s subjective vantage point, reflection is important if it’s required for high capability (as Turning RL suggests). I do agree that having a high level plan for solving the problem is important to focus the research in the right directions.
I think that the plans you lay out are all directly talking about the AI system we eventually build, and as a result I’m more optimistic about them (and your work, as it’s easy to see how it makes progress towards these plans) relative to HRAD.
In contrast, as far as I can tell, HRAD work does not directly contribute to any of these plans, and instead the case seems to rely on something more indirect where a better understanding of reasoning will later help us execute on one of these plans. It’s this indirection that makes me worried.
Well, HRAD certainly has relations to my own research programme. Embedded agency seems important since human values are probably “embedded” to some extent, counterfactuals are important for translating knowledge from the user’s subjective vantage point to the AI’s subjective vantage point, reflection is important if it’s required for high capability (as Turning RL suggests). I do agree that having a high level plan for solving the problem is important to focus the research in the right directions.