Our name for chain-of-thought interpretability and tuning is Guiding Externalized Monologues (GEM). It’s a technology currently in development … expect to hear more soon.
I’m not sure what GEM is, but I think it’s quite probable that inner monologues will be just as useful for AGI as they are for the human brain.
The key of human intelligence is language, which is a way for brains to compress thoughts sufficiently to communicate them to other brains. This inter-brain compression/communication mechanism then guides much of the brain’s high level connectivity and is naturally coadapted for intra-brain communication into the future.
So if that all also turns out to be true for large brain size ANN AGI, we should be able to get access to their inner monologues for free which seems pretty useful safety wise.
I’m not sure what GEM is, but I think it’s quite probable that inner monologues will be just as useful for AGI as they are for the human brain.
The key of human intelligence is language, which is a way for brains to compress thoughts sufficiently to communicate them to other brains. This inter-brain compression/communication mechanism then guides much of the brain’s high level connectivity and is naturally coadapted for intra-brain communication into the future.
So if that all also turns out to be true for large brain size ANN AGI, we should be able to get access to their inner monologues for free which seems pretty useful safety wise.