each blob-of-atoms cares only about itself (not about similar/copied agents)
and the original blob-of-atoms is inserted (e.g. uniformly at random) into one of the rooms (along with 19 copy-agents)
it seems that there is in fact a temporal inconsistency: Before the experiment, original-blob would want all agents (including original-blob) in green rooms to accept the bet, but upon waking up and observing green, original-blob would reject the bet. Will update the post to reflect this.
In general it’s not necessary for each blob-of-atoms to care only about itself. It’s enough to have any distinction at all in utility of outcomes between itself and other similar blobs-of-atoms. Caring only about itself is just one of the more extreme examples.
Update: Upon considering the situation where
each blob-of-atoms cares only about itself (not about similar/copied agents)
and the original blob-of-atoms is inserted (e.g. uniformly at random) into one of the rooms (along with 19 copy-agents)
it seems that there is in fact a temporal inconsistency: Before the experiment, original-blob would want all agents (including original-blob) in green rooms to accept the bet, but upon waking up and observing green, original-blob would reject the bet. Will update the post to reflect this.
In general it’s not necessary for each blob-of-atoms to care only about itself. It’s enough to have any distinction at all in utility of outcomes between itself and other similar blobs-of-atoms. Caring only about itself is just one of the more extreme examples.