Here are some more posts which might be also related, but less obviously so. I will leave them in this comment for now, but feel free to argue me into including or excluding any of these.
Agents Over Cartesian World Models
Empowerment is (almost) All We Need and LOVE in a simbox is all you need (by Jacob Cannell) ?
Announcing the Alignment of Complex Systems Research Group (2022 June) seems like this would be related?
Consequentialists: One-Way Pattern Traps
Other comments by Davidad: 1
Quintin Pope might think that boundaries arbitrary. Also see the google doc he links in this comment
Embedded Agency (full-text version)
Also, lmk if anything else should be linked in the main post.
Here are some more posts which might be also related, but less obviously so. I will leave them in this comment for now, but feel free to argue me into including or excluding any of these.
Agents Over Cartesian World Models
Empowerment is (almost) All We Need and LOVE in a simbox is all you need (by Jacob Cannell) ?
Announcing the Alignment of Complex Systems Research Group (2022 June) seems like this would be related?
Consequentialists: One-Way Pattern Traps
Other comments by Davidad: 1
Quintin Pope might think that boundaries arbitrary. Also see the google doc he links in this comment
Embedded Agency (full-text version)
Also, lmk if anything else should be linked in the main post.