Why do you think it is unlikely? I think any simple criterion which separates aliens from environment would suffice.
Personally, I think that the scenario is implausible for the other reason: human moral system would easily adapt to such aliens. People sometimes personify things that aren’t remotely sentient, let alone aliens who would actually act as sentient/conscious beings.
The other reason is that I consider sentience without consciousness relatively implausible.
Basically, the hierarchical control model of intelligence, which sees ‘intelligence’ as trying to maintain some perception at some reference level by actuating the environment. (Longer explanation here.) If you have multiple control systems, and they have different reference levels, then they will get into ‘conflict’, much like a tug of war.
That is, simple intelligence looks like it leads to rivalry rather than cooperation by default, and so valuing intelligence rather than alignment seems weird; there’s not a clear path that leads from nothing to there.
Anyway, any trait which isn’t consciousness (and obviously it wouldn’t be consciousness) would suffice, provided there is some reason to hide from Earth rather than destroy it.
Why do you think it is unlikely? I think any simple criterion which separates aliens from environment would suffice.
Personally, I think that the scenario is implausible for the other reason: human moral system would easily adapt to such aliens. People sometimes personify things that aren’t remotely sentient, let alone aliens who would actually act as sentient/conscious beings.
The other reason is that I consider sentience without consciousness relatively implausible.
Basically, the hierarchical control model of intelligence, which sees ‘intelligence’ as trying to maintain some perception at some reference level by actuating the environment. (Longer explanation here.) If you have multiple control systems, and they have different reference levels, then they will get into ‘conflict’, much like a tug of war.
That is, simple intelligence looks like it leads to rivalry rather than cooperation by default, and so valuing intelligence rather than alignment seems weird; there’s not a clear path that leads from nothing to there.
Makes sense.
Anyway, any trait which isn’t consciousness (and obviously it wouldn’t be consciousness) would suffice, provided there is some reason to hide from Earth rather than destroy it.