(“well approximates AIXI” seems unlikely to be an accurate description to me. Maybe “closer to what AIXI is doing than to base GPT-4 without a sampling loop” or “dominates human competence” are more accurate.)
I think one major difference between AIXI and it’s variants and real world AI is to what extent they are trading off on compute/data, where real world AI will rely on way more data and way less compute than AIXI and it’s variants, for very important reasons.
(“well approximates AIXI” seems unlikely to be an accurate description to me. Maybe “closer to what AIXI is doing than to base GPT-4 without a sampling loop” or “dominates human competence” are more accurate.)
I think one major difference between AIXI and it’s variants and real world AI is to what extent they are trading off on compute/data, where real world AI will rely on way more data and way less compute than AIXI and it’s variants, for very important reasons.