I have a hunch that semi-neat approaches to AI may come back as a layer on top of neural nets—consider the work on using neural net heuristics to decide the next step in theorem-proving (https://arxiv.org/abs/1606.04442). In such a system, the decision process is opaque, but the result is fully verifiable, at least in the world of math (in a powerful system the theorems may be being proved for ultimate use in some fuzzy interface with reality). The extent to which future systems might look like this, or what that means for safety, isn’t very clear yet (at least not to me), but it’s another paradigm to consider.
I have a hunch that semi-neat approaches to AI may come back as a layer on top of neural nets—consider the work on using neural net heuristics to decide the next step in theorem-proving (https://arxiv.org/abs/1606.04442). In such a system, the decision process is opaque, but the result is fully verifiable, at least in the world of math (in a powerful system the theorems may be being proved for ultimate use in some fuzzy interface with reality). The extent to which future systems might look like this, or what that means for safety, isn’t very clear yet (at least not to me), but it’s another paradigm to consider.