During this weekend’s SERI Conference, to my understanding, Paul Christiano specified that his work focuses on preventing AI to disempower humans and disregards externalities. Whose work focuses on understanding these externalities, such as wellbeing and freedom experienced by humans and other sentience, including AI and animals? Is it possible to safely employ the AI that has the best total externalities, measured across times under the veil of ignorance? Is it necessary that overall beneficial systems are developed prior to the existence of AGI, so that it does not make decisions unfavorable to some entities? Alternatively, to strive for an overall favorability situation development with an AGI safely governed by humans otherwise dystopic scenarios could occur for some individuals?
A bunch of people work on a bunch of different aspects of AI. You might be interested in AI governance and/or FATE* research (Fairness, Accountability, Transparency, Ethics). You can see some examples of the former in this spreadsheet under the AI governance category.
I don’t know of anyone who works specifically on the questions you listed (but as mentioned above there are many who work on subquestions).
During this weekend’s SERI Conference, to my understanding, Paul Christiano specified that his work focuses on preventing AI to disempower humans and disregards externalities. Whose work focuses on understanding these externalities, such as wellbeing and freedom experienced by humans and other sentience, including AI and animals? Is it possible to safely employ the AI that has the best total externalities, measured across times under the veil of ignorance? Is it necessary that overall beneficial systems are developed prior to the existence of AGI, so that it does not make decisions unfavorable to some entities? Alternatively, to strive for an overall favorability situation development with an AGI safely governed by humans otherwise dystopic scenarios could occur for some individuals?
A bunch of people work on a bunch of different aspects of AI. You might be interested in AI governance and/or FATE* research (Fairness, Accountability, Transparency, Ethics). You can see some examples of the former in this spreadsheet under the AI governance category.
I don’t know of anyone who works specifically on the questions you listed (but as mentioned above there are many who work on subquestions).
Thank you so much!