Elharo, which is more interesting? Wireheading—or “the interaction among conflicting values and competing entities that makes the world interesting, fun, and worth living”? Yes, I agree, the latter certainly sounds more exciting; but “from the inside”, quite the reverse. Wireheading is always enthralling, whereas everyday life is often humdrum. Likewise with so-called utilitronium. To humans, utilitronium sounds unimaginably dull and monotonous, but “from the inside” it presumably feels sublime.
However, we don’t need to choose between aiming for a utilitronium shockwave and conserving the status quo. The point of recalibrating our hedonic treadmill is that life can be fabulously richer - in principle orders of magnitude richer—for everyone without being any less diverse, and without forcing us to give up our existing values and preference architectures. (cf. “The catechol-O-methyl transferase Val158Met polymorphism and experience of reward in the flow of daily life.”: http://www.ncbi.nlm.nih.gov/pubmed/17687265) In principle, there is nothing to stop benign (super)intelligence from spreading such reward pathway enhancements across the phylogenetic tree.
Elharo, which is more interesting? Wireheading—or “the interaction among conflicting values and competing entities that makes the world interesting, fun, and worth living”? Yes, I agree, the latter certainly sounds more exciting; but “from the inside”, quite the reverse. Wireheading is always enthralling, whereas everyday life is often humdrum. Likewise with so-called utilitronium. To humans, utilitronium sounds unimaginably dull and monotonous, but “from the inside” it presumably feels sublime.
However, we don’t need to choose between aiming for a utilitronium shockwave and conserving the status quo. The point of recalibrating our hedonic treadmill is that life can be fabulously richer - in principle orders of magnitude richer—for everyone without being any less diverse, and without forcing us to give up our existing values and preference architectures. (cf. “The catechol-O-methyl transferase Val158Met polymorphism and experience of reward in the flow of daily life.”: http://www.ncbi.nlm.nih.gov/pubmed/17687265) In principle, there is nothing to stop benign (super)intelligence from spreading such reward pathway enhancements across the phylogenetic tree.