Yes, I don’t think this will let you get away with no specification bits in goal space at the top level like John’s phrasing might suggest. But it may let you get away with much less precision?
The things we care about aren’t convergent instrumental goals for all terminal goals, the kitchen chef’s constraints aren’t doing that much to keep the kitchen liveable to cockroaches. But it seems to me that this maybe does gesture at a method to get away with pointing at a broad region of goal space instead of a near-pointlike region.
Yes, I don’t think this will let you get away with no specification bits in goal space at the top level like John’s phrasing might suggest. But it may let you get away with much less precision?
The things we care about aren’t convergent instrumental goals for all terminal goals, the kitchen chef’s constraints aren’t doing that much to keep the kitchen liveable to cockroaches. But it seems to me that this maybe does gesture at a method to get away with pointing at a broad region of goal space instead of a near-pointlike region.