Thanks for the comment, I’ll read some more on the distinction of inner and outer alignment, that sounds interesting.
I don’t think you would need to get anywhere near perfect simulation in order to begin to have extremely good predictive power over the world. We’re already seeing this in graphics and physics modeling.
I think this is a good point, although these are cases where lots of data is available. So I guess any case in which you don’t have the data ready would still have more difficulties. Off the top of my head I don’t know how limiting this would be in practice, but it should be in lots of cases.
Thanks for the comment, I’ll read some more on the distinction of inner and outer alignment, that sounds interesting.
I think this is a good point, although these are cases where lots of data is available. So I guess any case in which you don’t have the data ready would still have more difficulties. Off the top of my head I don’t know how limiting this would be in practice, but it should be in lots of cases.
I’m not so sure...another interesting/alarming thing is noting how these models are “grokking” concepts in a way that lets them generalize.