It doesn’t seem (ha!) that an AI could deduce our psychology from a video of a falling rock, not because of information bounds but because of uncorrelation—that video seems (ha!) equally likely to be from any number of alien species as from humans. Still, I really wouldn’t try it, unless I’d proven this (fat chance), or it was the only way to stop the world from blowing up tomorrow anyway.
I don’t know that there’s literally zero correlation between the two. If you can deduce the laws of physics the aliens are running on, you could have stronger and weaker hypotheses regarding the physics creating their mental processes and, if your simulation was powerful enough, maybe deduce some proto-hypotheses about their psychology. You could further examine these hypotheses in light of what you know they know, and what they choose to show you.
I do agree though that you will need more direct data (actually ask them questions) to home in on the correct hypothesis in good enough precision (necessary for the manipulation Eliezer mentions).
Mind you, if you get Internet access, it’s Game Over. That amount of information should be enough to derive any parameters relevant to any practical actions you may want to take.
Bravo.
It doesn’t seem (ha!) that an AI could deduce our psychology from a video of a falling rock, not because of information bounds but because of uncorrelation—that video seems (ha!) equally likely to be from any number of alien species as from humans. Still, I really wouldn’t try it, unless I’d proven this (fat chance), or it was the only way to stop the world from blowing up tomorrow anyway.
I don’t know that there’s literally zero correlation between the two. If you can deduce the laws of physics the aliens are running on, you could have stronger and weaker hypotheses regarding the physics creating their mental processes and, if your simulation was powerful enough, maybe deduce some proto-hypotheses about their psychology. You could further examine these hypotheses in light of what you know they know, and what they choose to show you.
I do agree though that you will need more direct data (actually ask them questions) to home in on the correct hypothesis in good enough precision (necessary for the manipulation Eliezer mentions). Mind you, if you get Internet access, it’s Game Over. That amount of information should be enough to derive any parameters relevant to any practical actions you may want to take.