Yeah. In general, if we want a machine to learn from data as well as we can, we need to give it a prior that’s as good as ours. And there’s no guarantee that such a prior can itself be learned from data, because we didn’t learn it from data (a lot of it came with our brain structure). We can try giving the machine more data, but we don’t know how much or what kind of data would be enough.
Yeah. In general, if we want a machine to learn from data as well as we can, we need to give it a prior that’s as good as ours. And there’s no guarantee that such a prior can itself be learned from data, because we didn’t learn it from data (a lot of it came with our brain structure). We can try giving the machine more data, but we don’t know how much or what kind of data would be enough.