To address your third point first, I’m sure you are right. I have only played around with simple NNs, and shouldn’t have spoken freely on how it would be easy to estimate a more complex one, when I don’t know much about it.
As a follow up question to your second point: The Kalman filter is a very aesthetically pleasing model, I agree. Something I wonder, but have no idea on, is whether there are mathematical concepts similar to the Kalman filter (in terms of aesthetics and usefulness) that are entirely outside of the understanding of the human brain. So, hypothetically, if we engineered humans with IQ 200+ (or whatever), they would uncover things like the Kalman Filter that normal humans couldn’t grasp.
If that’s true, does it stand to reason that we could still use those models with a sufficiently well optimized/built DNN? We would just never understand what’s going on inside the network?
I often think of self-driving cars as learning the dynamic interactions of a set of nonlinear equations that are beyond the scope of a human to ever derive.
I’ll note I realize some of my questions might be too vague or pseudo-philosophical to be answered.
PS: I did a little internet sleuthing and have read the first ~12 pages of your book so far, which is very interesting and similar to how I think of the world (yours is much more well developed). I am also incredibly interested in empirical philosci and read/write/think about it a ton.
To address your third point first, I’m sure you are right. I have only played around with simple NNs, and shouldn’t have spoken freely on how it would be easy to estimate a more complex one, when I don’t know much about it.
As a follow up question to your second point: The Kalman filter is a very aesthetically pleasing model, I agree. Something I wonder, but have no idea on, is whether there are mathematical concepts similar to the Kalman filter (in terms of aesthetics and usefulness) that are entirely outside of the understanding of the human brain. So, hypothetically, if we engineered humans with IQ 200+ (or whatever), they would uncover things like the Kalman Filter that normal humans couldn’t grasp.
If that’s true, does it stand to reason that we could still use those models with a sufficiently well optimized/built DNN? We would just never understand what’s going on inside the network?
I often think of self-driving cars as learning the dynamic interactions of a set of nonlinear equations that are beyond the scope of a human to ever derive.
I’ll note I realize some of my questions might be too vague or pseudo-philosophical to be answered.
PS: I did a little internet sleuthing and have read the first ~12 pages of your book so far, which is very interesting and similar to how I think of the world (yours is much more well developed). I am also incredibly interested in empirical philosci and read/write/think about it a ton.