catalyze a massive shift in materials science innovation that could lead to fast AI takeoff
Have you considered not investing in those things, for that reason? As I understand it, accelerating AGI timelines would be the dumbest thing I could ever do. (Money isn’t worth winning if it comes at the expense of imperiling my species (and can’t then be used to proportionately de-emperil them))
(My understanding is that alignment work likely requires serial contributions from slow human theorists, can’t really be accelerated very much with availability of better hardware. Better hardware moves the deadline back more than it speeds up the alignment theorists, it burns more time than it grants.
More powerful hardware is also more amenable to brute force methods, making it more likely that AGI will be realized with very opaque designs rather than meticulously crafted, explicit understandable designs that we might have been able to audit and verify.)
Have you considered not investing in those things, for that reason? As I understand it, accelerating AGI timelines would be the dumbest thing I could ever do. (Money isn’t worth winning if it comes at the expense of imperiling my species (and can’t then be used to proportionately de-emperil them))
(My understanding is that alignment work likely requires serial contributions from slow human theorists, can’t really be accelerated very much with availability of better hardware. Better hardware moves the deadline back more than it speeds up the alignment theorists, it burns more time than it grants.
More powerful hardware is also more amenable to brute force methods, making it more likely that AGI will be realized with very opaque designs rather than meticulously crafted, explicit understandable designs that we might have been able to audit and verify.)