This is such a bizarre position that it’s hard for me to empathize. What would “the orthogonality thesis is false” even mean? Do you think aliens with different biology and evolutionary history “naturally” create humanoid societies?
One example of the orthogonality thesis being false would be “acting on terminal goals is instrumentally harmful in a wide range of situations, and having to maintain terminal goals that are not acted and track whether it is time to act on them on imposes costs, and so agents that have terminal goals will be outcompeted by ones that don’t”.
You might believe that the orthogonality thesis is probabilistically false, in that it is very unlikely for intelligent beings to arise that highly value paperclips or whatever. Aliens might not create humanoid societies but it seems plausible that they would likely be conscious, value positive valence, have some sort of social emotion suite, value exploration and curiosity, etc.
This is such a bizarre position that it’s hard for me to empathize. What would “the orthogonality thesis is false” even mean? Do you think aliens with different biology and evolutionary history “naturally” create humanoid societies?
One example of the orthogonality thesis being false would be “acting on terminal goals is instrumentally harmful in a wide range of situations, and having to maintain terminal goals that are not acted and track whether it is time to act on them on imposes costs, and so agents that have terminal goals will be outcompeted by ones that don’t”.
You might believe that the orthogonality thesis is probabilistically false, in that it is very unlikely for intelligent beings to arise that highly value paperclips or whatever. Aliens might not create humanoid societies but it seems plausible that they would likely be conscious, value positive valence, have some sort of social emotion suite, value exploration and curiosity, etc.