I think that’s less likely to break civilization than a status-maximizer or a money-maximizer—there are a lot of people who don’t want to get started with video games, and I think that an attention-maximizer would run into a lot of resistance as early adopters neglected their lives.
A clever attention maximizer which was aiming for the long run might not wreck civilization. I’m not as sure about status or money maximizers.
Brunner’s The Jagged Orbit is about some issues with maximizers, including who might be most likely to develop a stupid maximizer.
Gur rkrphgvirf ng n crefbany jrncbaf pbzcnal unir n pbzchgre cebtenz gb znkvzvmr cebsvgf (cbffvoyl fnyrf—V unira’g ernq gur obbx yngryl) va gur eryngviryl fubeg eha, erfhygvat va nqiregvfvat pnzcnvtaf juvpu penax hc cnenabvn gb gur cbvag jurer pvivyvmngvba vf jerpxrq.
Gurer’f n fbyhgvba juvpu vaibyirf gur pbzchgre vairagvat gvzr geniry, ohg V qba’g erzrzore gur qrgnvyf.
How about attention-maximizing AI, e.g. a game that optimizes for addictiveness — for the amount of person-hours humans spend playing it?
I think that’s less likely to break civilization than a status-maximizer or a money-maximizer—there are a lot of people who don’t want to get started with video games, and I think that an attention-maximizer would run into a lot of resistance as early adopters neglected their lives.
A clever attention maximizer which was aiming for the long run might not wreck civilization. I’m not as sure about status or money maximizers.
Brunner’s The Jagged Orbit is about some issues with maximizers, including who might be most likely to develop a stupid maximizer.
Gur rkrphgvirf ng n crefbany jrncbaf pbzcnal unir n pbzchgre cebtenz gb znkvzvmr cebsvgf (cbffvoyl fnyrf—V unira’g ernq gur obbx yngryl) va gur eryngviryl fubeg eha, erfhygvat va nqiregvfvat pnzcnvtaf juvpu penax hc cnenabvn gb gur cbvag jurer pvivyvmngvba vf jerpxrq.
Gurer’f n fbyhgvba juvpu vaibyirf gur pbzchgre vairagvat gvzr geniry, ohg V qba’g erzrzore gur qrgnvyf.