Ok, the phrase was just an evocative alternative to “scary optimization process” or whatever term the secret society is using these days to avoid saying “AI”—because “AI” raises all sorts of (purportedly) irrelevant associations like consciousness and other anthropomorphisms. The thing that is feared here is really just the brute power of bayesian modeling and reasoning applied to self improvement (through self modeling) and world control (through world modeling).
If an already existing type of malware has claimed the term, invent your own colorful name. How about “Master”?
Ok, the phrase was just an evocative alternative to “scary optimization process” or whatever term the secret society is using these days to avoid saying “AI”—because “AI” raises all sorts of (purportedly) irrelevant associations like consciousness and other anthropomorphisms. The thing that is feared here is really just the brute power of bayesian modeling and reasoning applied to self improvement (through self modeling) and world control (through world modeling).
If an already existing type of malware has claimed the term, invent your own colorful name. How about “Master”?