Still, it can only mean ‘a whole lot less predictable than usual’, not ‘MAX ENTROPY ALL THE TIME’. Physics will still apply. Given that people survived and have lives worth writing stories about, we are at least within ‘critical failure’ distance of friendliness in AI. That narrows things very considerably.
A lot of the unpredictability of the singularity arises from a lack of proof of friendliness. One you’ve cleared that (or nearly), the range of possibilities isn’t singular in nature.
I think it is a poor term.
Still, it can only mean ‘a whole lot less predictable than usual’, not ‘MAX ENTROPY ALL THE TIME’. Physics will still apply. Given that people survived and have lives worth writing stories about, we are at least within ‘critical failure’ distance of friendliness in AI. That narrows things very considerably.
A lot of the unpredictability of the singularity arises from a lack of proof of friendliness. One you’ve cleared that (or nearly), the range of possibilities isn’t singular in nature.