Note that source code can’t be faked in the self modification case. Software agent A can set up a test environment (a virtual machine or simulated universe), create new agent B inside that, and then A has a very detailed and accurate view of B’s innards.
However, logical uncertainty is still an obstacle, especially with agents not verified by theorem-proving.
Note that source code can’t be faked in the self modification case. Software agent A can set up a test environment (a virtual machine or simulated universe), create new agent B inside that, and then A has a very detailed and accurate view of B’s innards.
However, logical uncertainty is still an obstacle, especially with agents not verified by theorem-proving.