People usually train animals (well, at least pets) “manually” (i.e. using a human-in-the-loop to generate something like a reward signal). People usually train AI systems “automatically” (i.e. using a programmatic reward signal).
What if we tried to train animals “automatically”? I imagine this would be a great line of research for someone just starting their academic career. I would expect: 1) It would provide nice, convincing examples of specification gaming. 2) It would outperform manual training in some cases. This could help show that animals are smarter than they’ve been shown to be, so far.
[Question] Has anyone researched specification gaming with biological animals?
People usually train animals (well, at least pets) “manually” (i.e. using a human-in-the-loop to generate something like a reward signal).
People usually train AI systems “automatically” (i.e. using a programmatic reward signal).
What if we tried to train animals “automatically”? I imagine this would be a great line of research for someone just starting their academic career. I would expect:
1) It would provide nice, convincing examples of specification gaming.
2) It would outperform manual training in some cases. This could help show that animals are smarter than they’ve been shown to be, so far.