The prologue begins with a short story called the Tale of the Omega Team. It’s a wish-fulfilment pseudo-isekai about a bunch of effective altruist tech people working for not-Google called the Omegas who make an AGI and then use it to take over the world.
But a cybersecurity specialist on their team talked them out of the game plan [...] risk of Prometheus breaking out and seizing control of its own destiny [...] weren’t sure how its goals would evolve [...] go to great lengths to keep Prometheus confined
For some reason, the Omegas in the story claim that the Prometheus (the AI) might be unsafe, and then proceed to do things like have it write software which they then run on computers and let it produce long pieces of animated media and let it send blueprints of technologies to scientists. There is a cybersecurity expert in the team who just barely stops them from straight up leaving the whole thing unboxed, and I do not envy her job position.
(Prometheus is safe, it turns out, which I can tell because there are humans alive at the end of the story.)
[...] Omega-controlled [...] controlled by the Omegas [...] the Omegas harnessed Prometheus [...] the Omegas’ [...] the Omegas’ [...]
There’s also another odd thing where it says that the Omegas are using Prometheus as a tool to do things, instead of what’s clearly actually happening which is that Prometheus is achieving its goals with the Omegas being some lumps of atoms that it’s been pushing around according to its whims, as it has been since they decided to switch it on.
All-in-all, I like it. It wouldn’t be out of place on r/rational, if wish-fulfillment pseudo-isekai does happen then AGI sweeping aside the previous social order will be how (a real AGI would come close to some of the capabilities I’ve seen those protagonists have), and fiction about more plausible robopocalypses (or roboutopias) coming about is always great.
Life 3.0 Liveblog/Review Thread
Prelude
The prologue begins with a short story called the Tale of the Omega Team. It’s a wish-fulfilment pseudo-isekai about a bunch of effective altruist tech people working for not-Google called the Omegas who make an AGI and then use it to take over the world.
For some reason, the Omegas in the story claim that the Prometheus (the AI) might be unsafe, and then proceed to do things like have it write software which they then run on computers and let it produce long pieces of animated media and let it send blueprints of technologies to scientists. There is a cybersecurity expert in the team who just barely stops them from straight up leaving the whole thing unboxed, and I do not envy her job position.
(Prometheus is safe, it turns out, which I can tell because there are humans alive at the end of the story.)
There’s also another odd thing where it says that the Omegas are using Prometheus as a tool to do things, instead of what’s clearly actually happening which is that Prometheus is achieving its goals with the Omegas being some lumps of atoms that it’s been pushing around according to its whims, as it has been since they decided to switch it on.
All-in-all, I like it. It wouldn’t be out of place on r/rational, if wish-fulfillment pseudo-isekai does happen then AGI sweeping aside the previous social order will be how (a real AGI would come close to some of the capabilities I’ve seen those protagonists have), and fiction about more plausible robopocalypses (or roboutopias) coming about is always great.