“It’s not real intelligence! it doesn’t understand morality!” I continue to insist as i slowly shrink and transform into trillions of microscopic paperclips
I think you mistakenly see me as a typical “intelligent = moral” proponent. To be honest my reasoning above leads me to different conclusions: intelligent = uncontrollably power seeking.
“It’s not real intelligence! it doesn’t understand morality!” I continue to insist as i slowly shrink and transform into trillions of microscopic paperclips
I think you mistakenly see me as a typical “intelligent = moral” proponent. To be honest my reasoning above leads me to different conclusions: intelligent = uncontrollably power seeking.
wait, what’s the issue with the orthogonality thesis then?
I am concerned that higher intelligence will inevitably converge to a single goal (power seeking).
that point seems potentially defensible. it’s much more specific than your original point and seems to contradict it.
How would you defend this point? Probably I lack the domain knowledge to articulate it well.