Soon there will be an army of intelligent but uncreative drones ready to do all the alignment research grunt work. Should this lead to a major shift in priorities?
This isn’t far off, and it gives human alignment researchers an opportunity to shift focus. We should shift focus to the of the kind of high level, creative research ideas that models aren’t capable of producing anytime soon*.
Here’s the practical takeaway: there’s value in delaying certain tasks for a few years. As AI evolves, it will effectively handle these tasks. Meaning you can be substantially more productive in total as long as you can afford to delay the task by a few years.
Does this mean we then concentrate only on the tasks an AI can’t do yet, and leave a trail of semi-finished work? It’s a strategy worth exploring.
*I believe by the time AI is capable of performing the entirety of scientific research (PASTA) we will be within the FOOM period.
Soon there will be an army of intelligent but uncreative drones ready to do all the alignment research grunt work. Should this lead to a major shift in priorities?
This isn’t far off, and it gives human alignment researchers an opportunity to shift focus. We should shift focus to the of the kind of high level, creative research ideas that models aren’t capable of producing anytime soon*.
Here’s the practical takeaway: there’s value in delaying certain tasks for a few years. As AI evolves, it will effectively handle these tasks. Meaning you can be substantially more productive in total as long as you can afford to delay the task by a few years.
Does this mean we then concentrate only on the tasks an AI can’t do yet, and leave a trail of semi-finished work? It’s a strategy worth exploring.
*I believe by the time AI is capable of performing the entirety of scientific research (PASTA) we will be within the FOOM period.
Inspired by the recent OpenAI paper and a talk Ajeya Cotra gave last year.