I’ve struggled with the concept of how an orgasmium optimizing AI could come about or a paperclipper or a bucketmaker or any of the others but this clarifies things. It’s the programmer who passes the values on to the AI that is the cause, it’s not necessarioy going to be an emergent property.
That makes things easier I believe as it means the code for the seed AI needs to be screened for maximization functions.
I’ve struggled with the concept of how an orgasmium optimizing AI could come about or a paperclipper or a bucketmaker or any of the others but this clarifies things. It’s the programmer who passes the values on to the AI that is the cause, it’s not necessarioy going to be an emergent property.
That makes things easier I believe as it means the code for the seed AI needs to be screened for maximization functions.