“Maximally curious” sounds somewhat similar to open-ended AI of Ken Stanley and Joel Lehman.
Right, so the most curious thing one can do is to self-modify in interesting ways and see how it feels.
So, this does sound like open-ended recursive self-modification (which, under reasonable assumptions, does imply recursive self-improvement, but without narrowly minded focus to squeeze as much “movement to a well-defined goal as possible”).
So, yes, safety problems here are formidable, one has to explicitly address all issues associated with open-ended recursive self-modification.
Right, so the most curious thing one can do is to self-modify in interesting ways and see how it feels.
So, this does sound like open-ended recursive self-modification (which, under reasonable assumptions, does imply recursive self-improvement, but without narrowly minded focus to squeeze as much “movement to a well-defined goal as possible”).
So, yes, safety problems here are formidable, one has to explicitly address all issues associated with open-ended recursive self-modification.