There seems to be an assumption in this post that a value learner will be learning utility functions directly; and since utility functions are something which is associated with behavior, this framing leads to a focus on learning utility functions from behavior, and hence this post.
There seems to be an assumption in this post that a value learner will be learning utility functions directly; and since utility functions are something which is associated with behavior, this framing leads to a focus on learning utility functions from behavior, and hence this post.
It seems to me that a value learner shouldn’t try to learn any given individual’s utility functions directly; rather it should first learn the psychological content corresponding to values, and then construct utility functions out of that. Among other positive features, this would allow a value learner to predict how the human would behave in a situation which the human hadn’t been exposed to yet (or even one which was totally alien to the human’s current conceptual landscape).