Under this framework, my analysis is that triangle-ness has a specification that is both compact and local; whereas L-opening-ness has a specification that is compact and nonlocal (“opens L”), and a specification that is local but noncompact (a full specification of what shapes it is and is not allowed to have), but no specification that is both local and compact. In other words, there is a short specification which refers to something external (L) and a long lookup-table specification that talks only about the key.
I think this is the sensible way of caching out your notion of intrinsicness. (Intrinsicity? Intrinsicitude?)
In this interpretation, I don’t think human morality should be judged as non-intrinsic. The shortest local specification of our values is not particularly compact; but neither can you resort to a nonlocal specification to find something more compact. “Whatever makes me happy” is not the sum of my morality, nor do I think you will find a simple specification along those lines that refers to the inner workings of humans. In other words, the specification of human morality is not something you can easily shorten by referring to humans.
There is an important sense in which goodness is more like being ∆-shaped than it is like being L-opening. Namely, goodness of a state of affairs is something that I can assess myself from outside a simulation of that state.
That is of course only true because human brains have complex brainware for judging morality, and do not have complex brainware for judging L-opening. For that reason, I don’t think “can humans simulate this in a local way” is a measure that is particularly relevant.
My interpretation of this thesis immediately remind me of Eliezer’s post on locality and compactness of specifications, among others.
Under this framework, my analysis is that triangle-ness has a specification that is both compact and local; whereas L-opening-ness has a specification that is compact and nonlocal (“opens L”), and a specification that is local but noncompact (a full specification of what shapes it is and is not allowed to have), but no specification that is both local and compact. In other words, there is a short specification which refers to something external (L) and a long lookup-table specification that talks only about the key.
I think this is the sensible way of caching out your notion of intrinsicness. (Intrinsicity? Intrinsicitude?)
In this interpretation, I don’t think human morality should be judged as non-intrinsic. The shortest local specification of our values is not particularly compact; but neither can you resort to a nonlocal specification to find something more compact. “Whatever makes me happy” is not the sum of my morality, nor do I think you will find a simple specification along those lines that refers to the inner workings of humans. In other words, the specification of human morality is not something you can easily shorten by referring to humans.