Preference/​optimization/​reward are not well-defined for humans, attempts to shoehorn human data into this frame probably result in monstrous goodharting. Uploading is more straightforwardly valuable where it produces exact uploads that can then be instantiated in vast quantities and with greater serial speed, with the hope that they can then figure out what to do next.
Preference/​optimization/​reward are not well-defined for humans, attempts to shoehorn human data into this frame probably result in monstrous goodharting. Uploading is more straightforwardly valuable where it produces exact uploads that can then be instantiated in vast quantities and with greater serial speed, with the hope that they can then figure out what to do next.