I’m very excited to see the rest of this! Last spring I wrote the first post for a sequence that had very similar intents. You posting this has given me a nudge to move forward with mine. Here’s a brief outline of things I was going to look at (might be useful for you to further clarify to yourself the specific chunks of this topic you are trying to explore)
Give some computer architecture arguments for why it’s hard to get something to be agent like, and why those arguments might apply to our minds.
Explore how social pressure to “act like an agent” and conform to the person-hood interface makes it difficult to notice one’s own non-agentyness.
For me (and I’d guess others) a lot of my intentional S2 frames for valuing people seems to put a lot of weight on how “agenty” someone is. I would like to dwell on a “rescuing the utility function”like move for agency.
Sounds like our posts could be nicely complementary, I encourage you to continue posting yours! And huh, you scooped me on the “agenthood is a leaky abstraction” idea, I didn’t realize it had been previously used on LW. :)
I’m very excited to see the rest of this! Last spring I wrote the first post for a sequence that had very similar intents. You posting this has given me a nudge to move forward with mine. Here’s a brief outline of things I was going to look at (might be useful for you to further clarify to yourself the specific chunks of this topic you are trying to explore)
Give some computer architecture arguments for why it’s hard to get something to be agent like, and why those arguments might apply to our minds.
Explore how social pressure to “act like an agent” and conform to the person-hood interface makes it difficult to notice one’s own non-agentyness.
For me (and I’d guess others) a lot of my intentional S2 frames for valuing people seems to put a lot of weight on how “agenty” someone is. I would like to dwell on a “rescuing the utility function”like move for agency.
Sounds like our posts could be nicely complementary, I encourage you to continue posting yours! And huh, you scooped me on the “agenthood is a leaky abstraction” idea, I didn’t realize it had been previously used on LW. :)