If this turns out to be correct, as opposed to something more ‘principled’ or ‘organic’ like natural abstractions or AIXI
AIXI is just search over Turing machines, just computationally unbounded. I am pretty sure that Gwern kept in mind AIXI when he spoke about search over Turing machines.
I think that you can’t say anything “more principled” than AIXI if you don’t account for reality you are already in. Our reality is not generated by random Turing machine, it is generated by very specific program that creates 3+1 space-time with certain space-time symmetries and certain particle fields etc, and “intelligence” here is “how good you are at approximating algorithm for optimal problem-solving in this environment”.
AIXI is just search over Turing machines, just computationally unbounded. I am pretty sure that Gwern kept in mind AIXI when he spoke about search over Turing machines.
Upon reflection, agree with this
I think that you can’t say anything “more principled” than AIXI if you don’t account for reality you are already in.
Also agree with this, and I think this reinforces the point I was attempting to make in that comment. I.e. ‘search over turing machines’ is so general as to yield very little insight, and any further assumptions risk being invalid
‘sprint to the graph’
Refers to the mentality of ‘research sprints should aim to reach ASAP the first somewhat-shareable research result’, usually a single graph
AIXI is just search over Turing machines, just computationally unbounded. I am pretty sure that Gwern kept in mind AIXI when he spoke about search over Turing machines.
I think that you can’t say anything “more principled” than AIXI if you don’t account for reality you are already in. Our reality is not generated by random Turing machine, it is generated by very specific program that creates 3+1 space-time with certain space-time symmetries and certain particle fields etc, and “intelligence” here is “how good you are at approximating algorithm for optimal problem-solving in this environment”.
Can you elaborate what is it?
Upon reflection, agree with this
Also agree with this, and I think this reinforces the point I was attempting to make in that comment. I.e. ‘search over turing machines’ is so general as to yield very little insight, and any further assumptions risk being invalid
Refers to the mentality of ‘research sprints should aim to reach ASAP the first somewhat-shareable research result’, usually a single graph