Value drift is the kind of thing that naturally happens gradually and in an unclear way. It’s hard to intervene against it without novel coordination tech/institutions, especially if it leaves people unworried and tech/instututions remain undeveloped.
This seems very similar to not worrying about AGI because it’s believed to be far away, systematically not considering the consequences of whenever it arrives, not working on solutions as a result. And then suddenly starting to see what the consequences are when it’s getting closer, when it’s too late to develop solutions, or to put in place institutions that would stop its premature development. As if anything about the way it’s getting closer substantially informs the shape of the consequences and couldn’t be imagined well in advance. Except fire alarms for value drift might be even less well-defined than for AGI.
Value drift is the kind of thing that naturally happens gradually and in an unclear way. It’s hard to intervene against it without novel coordination tech/institutions, especially if it leaves people unworried and tech/instututions remain undeveloped.
This seems very similar to not worrying about AGI because it’s believed to be far away, systematically not considering the consequences of whenever it arrives, not working on solutions as a result. And then suddenly starting to see what the consequences are when it’s getting closer, when it’s too late to develop solutions, or to put in place institutions that would stop its premature development. As if anything about the way it’s getting closer substantially informs the shape of the consequences and couldn’t be imagined well in advance. Except fire alarms for value drift might be even less well-defined than for AGI.