An optimizer is a very advanced meta-learning algorithm that can learn the rules of (effectively) any environment and perform well in it. It’s general by definition.
A square circle is square and circular by definition, but I still don’t believe in them. There has to be a trade off between generality and efficiency.
t can keep modeling things at the level of atoms; or, it can dump the overwhelming majority of that information, collapse sufficiently large objects into point masses, and use Cowell’s method.
Once it has dumped the overwhelming majority of the information, it is no longer general. It’s not (fully) general and (fully) efficient.
A square circle is square and circular by definition, but I still don’t believe in them. There has to be a trade off between generality and efficiency.
Once it has dumped the overwhelming majority of the information, it is no longer general. It’s not (fully) general and (fully) efficient.