Definitions, characterizations, and hard-to-ground variables

[I am hoping this post is not too repetitive, does not spend too much time rehashing basics… also: What should this be tagged with?]

Systems are not always made to be understandable—especially if they were not designed in the first place, like the human brain. Thus, they can often contain variables that are hard to ground in an outside meaning (e.g. “status”, “gender”...). In this case, it may often be more appropriate to simply characterize how the variable behaves, rather than worry about attempting to see what it “represents” and “define” it thus. Ultimately, the variable is grounded in the effects it has on the outside world via the rest of the system. Meanwhile it may not represent anything more than “a flag I needed to make this hack work”.

I will refer to this as characterizing the object in question rather than defining it. Rather than say what something “is”, we simply specify how it behaves. Strictly speaking, characterization is of course a form of definition[0] - indeed, strictly speaking, nearly all definitions are of this form—but I expect you will forgive me if for now I allow a fuzzy notion of “characterization vs. definition” scale.

Let us consider a simple example where this is appropriate; consider the notion of “flying” in Magic: the Gathering. In this game, a player may have his creatures attack another player, who can then block them with creatures of his own. Some of these creatures have printed on them the text “flying”, which is defined by the game rules to expand to a larger block of explanatory text. What does “flying” mean? It means “this creature can’t be blocked except by creatures with flying”[1]. So the creature can only be blocked by creatures that can only be blocked by creatures that can only be blocked by… well, you see the problem. This is not the real definition at all; if you took a card with “flying” and instead actually replaced it with the text “this creature can’t be blocked except by creatures with flying”, you’d get a weaker card. (Such cards actually exist, too.)

The real definition isn’t what it nominally expands out to; really, it’s just a flag. Meanwhile it’s characterized by an external rule that says that creatures with the flag can only be blocked by other creatures with the flag. It may represent the ability to fly but that’s just a helpful reminder.

Now a description of anything is of no use unless it actually bottoms out somewhere, so such self-referential “definitions” will not typically occur by themselves in nature[2]. Once we establish our primitive physical notions by characterization, our more complex ones we should typically be able to describe by definition. And yet the fact remains that the notion of “flying” in Magic is meaningful, and does bottom out; it just didn’t appear to at first because I didn’t define it correctly. Once we have a substrate that allows us to add variables (like whether or not a creature has flying) and use these to control the actions of the system, these variables automatically obtain meaning from how they control the system. However, an attempt to define such a variable and simply state what it “is” may run into the problem of self-reference.

Typically we expect that the variables in a program correspond to some specific outside concept, that they each “represent” something. But how do you make this notion work when the program you’re analyzing has 5 distinct states, each with very distinct but seemingly arbitrary behavior? Then the central state variable represents… well, what state it’s in, and more than that is hard to say. A definition is the wrong notion to apply here.

Now perhaps that sort of thing shouldn’t occur in a well-written program, but if you’re reading an entry in an obfuscated code contest, it’ll be commonplace. And the human brain is a system that wasn’t written by an intelligent mind in the first place. So it shouldn’t be surprising that it is a mistake to attempt to define something like “status” by identifying with some outside phenomenon. Obviously this is technically possible—a meaningful notion must be grounded—but it is better to describe it in a way that takes account of the fact that status is a variable that is instantiated in human brains. As Vladimir_Nesov pointed out, status is not power, it is some sort of godshatter proxy for power. So we have to be willing to say: “Status is a variable kept track of in the human brain; it is read on the following occasions with the following effects; it is written to on the following occasions; it satisfies the following properties and invariants...”

(This is common in mathematics—what’s the tensor product of M and N? Well, it’s the thing such that a homomorphism from it is the same as a bilinear map from M×N. OK, but what is it? The answer to that question is rarely relevant.)

This is speculative, but given how transsexual people seem to talk about it I suspect something similar is true of “gender”. People report knowing from a young age that they were the “wrong” gender, they naturally imitated more closely those of this gender (the same way anyone naturally imitates more closely those of their own gender)… what does it mean that this person feels like a “female” despite being male in sex? I suspect the answer is: Nothing, it just means that the “gender” flag in her head has been set to female! A primitive “gender” flag exists, and has no intrinsic meaning except for how it influences our actions, such as by directing us to imitate more closely those who we perceive to have that flag in the same state as we do. A male imitates other males the same way a flying creature blocks other flying creatures, because there’s a computational substrate that allows us to turn these informal self-referential definitions into properly grounded characterizations. (Though obviously the statement about males should just be taken as one example statement, not a complete attempt at a characterization!) Note that this would mean that the answer to Eliezer’s question “If you know who you are apart from categorizations, why does it make so much difference whether it fits into a particular category?” is, “Well, if you’ve really pinned down everything downstream of it (which you probably haven’t), it doesn’t—but I’ve got this hanging node in my brain...”


[0]Usually; there is an exception. Whatever notions we take as primitive cannot be defined, and must be characterized instead. However these characterizations (“axiomatizations”) are not definitions because there is nothing for them to be defined on top of.

[1]Before anyone else points it out: Yes, I realize that as of Future Sight, it’s “this creature can’t be blocked except by creatures with flying or reach”. I’m keeping things simple here.

[2]Except, of course, at the level of the primitive laws of physics; at the primitive level, only characterizations can occur. What does it mean for a particle to be positively charged? It means it repels other positively charged particles and attracts negatively charged particles. You see where this is going. For this reason, ultimately we have to ground things in what we can detect and predict, rather than the fundamental laws of physics—after all, we don’t even know the latter yet!