Safety is assurance of pursuit of some goals (Y) - some conditions. So, one thing that’s unlikely to have a paradigmatic shift, is search for actions to satisfy conditions:
1. Past: dots, line, regression
2. Present: objects, hyperplane, deep learning
3. Future: ?, ?, ?
Both 1. and 2. are just a way to satisfy conditions, that is, solve equation F(X)=Y (equation solving as processes (X) to model world (F), to satisfy conditions (Y)). The equation model had not changed for ages, and is so fundamental, that I would tend to assume, that world’s processes X will continue to parametrize world F by being part of it, to satisfy conditions Y, no matter what the 3. is.
I wouldn’t expect the fundamental goals (specific conditions Y) to change either: the world’s entropy (F) (which is how world manifests, hence world’s entropyisthe world) trains learning processes such as life (which is fundamentally mutating replicators) to pursue goal Y which may be formulated as just information about the entropy to counteract it (create world’s F model F’ to minimize change = reach stability).
Islands of stability exist for chemical elements, for life forms (mosquitoes are an island of stability among processes in existence, although they don’t have to be very intelligent to persist), and I believe they exist for the artificial life (AI/ML systems) too, just not clear where exactly these islands of stability will be.
Where the risk to civilization may lie, is in the emergence of processes evolving independently of the existing civilization (see symbiosis in coordination problem in biological systems), because of incorrect payoffs, making useful services parasitize our infrastructures (e.g., run more efficient economically self-sustaining processes on computers).
Safety is assurance of pursuit of some goals (Y) - some conditions. So, one thing that’s unlikely to have a paradigmatic shift, is search for actions to satisfy conditions:
1. Past: dots, line, regression
2. Present: objects, hyperplane, deep learning
3. Future: ?, ?, ?
Both 1. and 2. are just a way to satisfy conditions, that is, solve equation F(X)=Y (equation solving as processes (X) to model world (F), to satisfy conditions (Y)). The equation model had not changed for ages, and is so fundamental, that I would tend to assume, that world’s processes X will continue to parametrize world F by being part of it, to satisfy conditions Y, no matter what the 3. is.
I wouldn’t expect the fundamental goals (specific conditions Y) to change either: the world’s entropy (F) (which is how world manifests, hence world’s entropy is the world) trains learning processes such as life (which is fundamentally mutating replicators) to pursue goal Y which may be formulated as just information about the entropy to counteract it (create world’s F model F’ to minimize change = reach stability).
Islands of stability exist for chemical elements, for life forms (mosquitoes are an island of stability among processes in existence, although they don’t have to be very intelligent to persist), and I believe they exist for the artificial life (AI/ML systems) too, just not clear where exactly these islands of stability will be.
Where the risk to civilization may lie, is in the emergence of processes evolving independently of the existing civilization (see symbiosis in coordination problem in biological systems), because of incorrect payoffs, making useful services parasitize our infrastructures (e.g., run more efficient economically self-sustaining processes on computers).