By “describe a system from scratch”, I mean to describe it without referencing other systems. Describing one system in terms of its changes from some other system would reference another system.
If you had an AI that currently had zero knowledge of anything, and the AI then learned about the system in its world model, then that AI has specified the system from scratch.
Ah, I didn’t mean to ask about the designing part, but moreso about how you use the word optimize in your definition when it comes to ‘optimizing from scratch’, which might get a little recursive.
Oh, my mistake. I should have said my definition of “optimizer” was “something such that there is a method of describing a change to it to concretely describe a system that scores unusually highly on another function, for a wide range of functions, in a way that’s significantly shorter description length than specifying a system that achieves that score from scratch.”
Thanks for the link. I hadn’t seen that.
By “describe a system from scratch”, I mean to describe it without referencing other systems. Describing one system in terms of its changes from some other system would reference another system.
If you had an AI that currently had zero knowledge of anything, and the AI then learned about the system in its world model, then that AI has specified the system from scratch.
Ah, I didn’t mean to ask about the designing part, but moreso about how you use the word optimize in your definition when it comes to ‘optimizing from scratch’, which might get a little recursive.
Oh, my mistake. I should have said my definition of “optimizer” was “something such that there is a method of describing a change to it to concretely describe a system that scores unusually highly on another function, for a wide range of functions, in a way that’s significantly shorter description length than specifying a system that achieves that score from scratch.”
I’ve edited the post.