Does profit maximizing software eat the world and go darwinian ?
I don’t think that is a good description of what happened.
Konkvistador But that is a rather huge topic… it seems to me
Konkvistador that the arbitrary thing they optimize for may turn out to be something that makes them eat up a lot of reality
Konkvistador also the humans present a sort of starting anchor, what do humans want? They want information processing, they want energy, they want food, they want metal, finished products
Konkvistador What do companies trying to provide this want? Information processing, energy, maintenance, finished products and more CPU cycles
Konkvistador While of course there may be tragedy of the commons situations where local profit seeking is harmful enough that it destroys the market, but overall I think the market will probably prove more resilient than humans
Jello_Raptor no, not entirely accurate, but what happened was a classic bubble compounded by people manipulating the system so that the ratio of over deviated wildly, and sometimes even went negative.
Konkvistador also remember these are now replicators kind of
Konkvistador If I have a Robot that is trying to earn enough money so it can build more robots to earn more money
Konkvistador It is not hard to imagine a machine or a machine system just starting to self-replicate on its own if say the market crashes
Jello_Raptor right
Konkvistador As the economy gets worse and worse it realizes that building its own units is cheaper than making them on the market
Jello_Raptor right
Konkvistador as long as building more units with stuff it can’t monetize (since the market is now hypothetically chasing something not really tied to reality)
Konkvistador means those units earn a tiny bit more doing that stuff that can be monetized
Konkvistador he’ll probably build them in exchange for a share of their profits
Jello_Raptor right
Konkvistador If robot variation is low
Konkvistador it might be imaginable that the thing the untied to reality thing market optimizes for has huge returns
Konkvistador that make the cost of doing real world stuff too high from a opportunity cost perspective
Konkvistador not enough capital for it and the robots all being perfectly rational don’t make any mistakes investing into it
Jello_Raptor ok, you know how you memory dump whenever coding and lose track of what you’re doing, that just happened to me vis a vi this convo
Konkvistador as soon as some thing makes the mistake and it replicates that mistake in new units Darwin is back
Jello_Raptor also gotta go
Does profit maximizing software eat the world and go darwinian ?
I don’t think that is a good description of what happened. Konkvistador But that is a rather huge topic… it seems to me Konkvistador that the arbitrary thing they optimize for may turn out to be something that makes them eat up a lot of reality Konkvistador also the humans present a sort of starting anchor, what do humans want? They want information processing, they want energy, they want food, they want metal, finished products Konkvistador What do companies trying to provide this want? Information processing, energy, maintenance, finished products and more CPU cycles Konkvistador While of course there may be tragedy of the commons situations where local profit seeking is harmful enough that it destroys the market, but overall I think the market will probably prove more resilient than humans Jello_Raptor no, not entirely accurate, but what happened was a classic bubble compounded by people manipulating the system so that the ratio of over deviated wildly, and sometimes even went negative. Konkvistador also remember these are now replicators kind of Konkvistador If I have a Robot that is trying to earn enough money so it can build more robots to earn more money Konkvistador It is not hard to imagine a machine or a machine system just starting to self-replicate on its own if say the market crashes Jello_Raptor right Konkvistador As the economy gets worse and worse it realizes that building its own units is cheaper than making them on the market Jello_Raptor right Konkvistador as long as building more units with stuff it can’t monetize (since the market is now hypothetically chasing something not really tied to reality) Konkvistador means those units earn a tiny bit more doing that stuff that can be monetized Konkvistador he’ll probably build them in exchange for a share of their profits Jello_Raptor right Konkvistador If robot variation is low Konkvistador it might be imaginable that the thing the untied to reality thing market optimizes for has huge returns Konkvistador that make the cost of doing real world stuff too high from a opportunity cost perspective Konkvistador not enough capital for it and the robots all being perfectly rational don’t make any mistakes investing into it Jello_Raptor ok, you know how you memory dump whenever coding and lose track of what you’re doing, that just happened to me vis a vi this convo Konkvistador as soon as some thing makes the mistake and it replicates that mistake in new units Darwin is back Jello_Raptor also gotta go