I asked Deep Research to see if there are existing treatments of this basic idea in the literature. It seems most closely related to the concept of “empowerment” in RL, which I’m surprised I hadn’t heard of: https://en.m.wikipedia.org/wiki/Empowerment_(artificial_intelligence)
The Wikipedia article makes it seem like this might also be how RL people think about instrumental convergence?
Current theme: default
Less Wrong (text)
Less Wrong (link)
I asked Deep Research to see if there are existing treatments of this basic idea in the literature. It seems most closely related to the concept of “empowerment” in RL, which I’m surprised I hadn’t heard of: https://en.m.wikipedia.org/wiki/Empowerment_(artificial_intelligence)
The Wikipedia article makes it seem like this might also be how RL people think about instrumental convergence?