I think there is a big question of what to do when we have something closed to aligned AI. Who attempts to take it towards super intelligence? How will we make sure it is actually beneficial to humanity not just the sub group of people that are building it. If the builders of it cannot convince the rest of the world of this there will be multiple attempts to build it, which might be bad under some scenarios.
Things have been very quiet on the coherent extrapolated volition front.
I think there is a big question of what to do when we have something closed to aligned AI. Who attempts to take it towards super intelligence? How will we make sure it is actually beneficial to humanity not just the sub group of people that are building it. If the builders of it cannot convince the rest of the world of this there will be multiple attempts to build it, which might be bad under some scenarios.
Things have been very quiet on the coherent extrapolated volition front.