Not too sure about the downvotes either, but I’m curious how the last sentence misses the point? Are you aware of a formal definition of “interesting” or “curiosity” that isn’t based on novelty-seeking?
I think for all definitions of “curiosity” that make sense (that aren’t like “we just use this word to refer to something completely unrelated to what people usually understand by it”) maximally curious AI kills us, so it doesn’t matter how curiosity is defined in RL literature.
Not too sure about the downvotes either, but I’m curious how the last sentence misses the point? Are you aware of a formal definition of “interesting” or “curiosity” that isn’t based on novelty-seeking?
I think for all definitions of “curiosity” that make sense (that aren’t like “we just use this word to refer to something completely unrelated to what people usually understand by it”) maximally curious AI kills us, so it doesn’t matter how curiosity is defined in RL literature.