I don’t trust Ilya Sutskever to be the final arbiter of whether a Superintelligent AI design is safe and aligned. We shouldn’t trust any individual, especially if they are the ones building such a system to claim that they’ve figured out how to make it safe and aligned. At minimum, there should be a plan that passes review by a panel of independent technical experts. And most of this plan should be in place and reviewed before you build the dangerous system.
I don’t trust Ilya Sutskever to be the final arbiter of whether a Superintelligent AI design is safe and aligned. We shouldn’t trust any individual,
I’m not sure how I feel about the whole idea of this endeavour in the abstract—but as someone who doesn’t know Ilya Sutskever and only followed the public stuff, I’m pretty worried that he in particular runs it if decision-making is on the “by an individual” level and even if not. Running this safely will likely require lots of moral integrity and courage. The board drama made it look to me like Ilya disqualified himself from having enough of that.
Lightly held because I don’t know the details but just from the public stuff I’ve seen I don’t know why I should at all believe that Ilya has sufficient moral integrity and courage for this project even if he might “mean well” at the moment.
I don’t trust Ilya Sutskever to be the final arbiter of whether a Superintelligent AI design is safe and aligned. We shouldn’t trust any individual, especially if they are the ones building such a system to claim that they’ve figured out how to make it safe and aligned. At minimum, there should be a plan that passes review by a panel of independent technical experts. And most of this plan should be in place and reviewed before you build the dangerous system.
I’m not sure how I feel about the whole idea of this endeavour in the abstract—but as someone who doesn’t know Ilya Sutskever and only followed the public stuff, I’m pretty worried that he in particular runs it if decision-making is on the “by an individual” level and even if not. Running this safely will likely require lots of moral integrity and courage. The board drama made it look to me like Ilya disqualified himself from having enough of that.
Lightly held because I don’t know the details but just from the public stuff I’ve seen I don’t know why I should at all believe that Ilya has sufficient moral integrity and courage for this project even if he might “mean well” at the moment.
I do hope he will continue to contribute to the field of alignment research.