Traditionally, those techniques are focused on what the model is outputting, not what the model’s underlying motivations are. But I haven’t read all the literature. Am I missing something?
It’s confusing to me as well, perhaps because different people (or even the same person at different times) emphasize different things within the same approach, but here’s one post where someone said, “It is important that the overseer both knows which action the distilled AI wants to take as well as why it takes that action.”
It’s confusing to me as well, perhaps because different people (or even the same person at different times) emphasize different things within the same approach, but here’s one post where someone said, “It is important that the overseer both knows which action the distilled AI wants to take as well as why it takes that action.”