Yes and no. I think most of our disagreements are probably like “what is instinctual?” and “what is the type signature of human values?” etc. And not on “should we understand what people are doing?”.
The generators comes from evolution and human experience in our actual world
By “generators”, I mean “the principles by which the algorithm operates”, which means the generators are found by studying the within-lifetime human learning process.
potential analogy: humans have instinctive grasp of all numbers under five, due to various evolutionary pressures
Dubious to me due to information inaccessibility & random initialization of neocortex (which is a thing I am reasonably confident in). I think it’s more likely that our architecture&compute&learning process makes it convergent to learn this quick ⇐ 5 number-sense.
Yes and no. I think most of our disagreements are probably like “what is instinctual?” and “what is the type signature of human values?” etc. And not on “should we understand what people are doing?”.
By “generators”, I mean “the principles by which the algorithm operates”, which means the generators are found by studying the within-lifetime human learning process.
Dubious to me due to information inaccessibility & random initialization of neocortex (which is a thing I am reasonably confident in). I think it’s more likely that our architecture&compute&learning process makes it convergent to learn this quick ⇐ 5 number-sense.