If CEV has a serious bug, it won’t correctly implement anyone’s volition, and so someone’s volition saying that CEV shouldn’t have that bug won’t help.
Never mind, upvoted your comment. I wrote “then it won’t happen”. That was wrong, I don’t actually believe that. I meant to ask something different. Edited the comment to add a clarification.
If CEV has a serious bug, it won’t correctly implement anyone’s volition...
Obviously. A bug would be the inability to extrapolate volition correctly, not a certain outcome that is based on the correct extrapolated volition. So what did cousin_it mean by saying that outcome X is a failure mode? Does he mean that from his current perspective he doesn’t like outcome X or that outcome X would imply a bug in the process of extrapolating volition? (ETA I’m talking about CEV-humanity and not CEV-cousin-it. There would be no difference in the latter case.)
If CEV has a serious bug, it won’t correctly implement anyone’s volition, and so someone’s volition saying that CEV shouldn’t have that bug won’t help.
Never mind, upvoted your comment. I wrote “then it won’t happen”. That was wrong, I don’t actually believe that. I meant to ask something different. Edited the comment to add a clarification.
Obviously. A bug would be the inability to extrapolate volition correctly, not a certain outcome that is based on the correct extrapolated volition. So what did cousin_it mean by saying that outcome X is a failure mode? Does he mean that from his current perspective he doesn’t like outcome X or that outcome X would imply a bug in the process of extrapolating volition? (ETA I’m talking about CEV-humanity and not CEV-cousin-it. There would be no difference in the latter case.)