Not disagreeing in principle, it depends on the degree of optimization and the set of data you expect the upload to have low error on. Eliza will succeed on a very small set of data but will fail quickly on anything close to real-life. It’s possible that there’s a more compact representation that results in “I see red” than the DAG with consciousness in it, but I don’t think it’s that easy to optimize out without breaking other tests.
BTW you’ve read Blindsight right? Great scifi on this topic basically (with aliens instead of uploads)
Not disagreeing in principle, it depends on the degree of optimization and the set of data you expect the upload to have low error on. Eliza will succeed on a very small set of data but will fail quickly on anything close to real-life. It’s possible that there’s a more compact representation that results in “I see red” than the DAG with consciousness in it, but I don’t think it’s that easy to optimize out without breaking other tests. BTW you’ve read Blindsight right? Great scifi on this topic basically (with aliens instead of uploads)