I don’t quite understand your confusion. An AGI is a computer program, and friendliness is a property of a computer program. Yes, these concepts allude to mental concepts on our maps, but these mental concepts are reducible to properties of the nonmental substrates that are our brains. In fact, the goal of FAI research is to find the reduction of friendliness to nonmental things.
Concepts of sin, or prayer, or karma, or intelligent design, and most other things considered “supernatural” can be reducible to properties of physical world with enough hand waving.
Karma scores in this thread suggest it falls in reference class of “arguing against groupthink”, which ironically increases estimates of Eliezer being a crackpot, and lesswrong turning into a cult, possibly via evaporative cooling.
Karma scores in this thread suggest it falls in reference class of “arguing against groupthink”, which ironically increases estimates of Eliezer being a crackpot, and lesswrong turning into a cult, possibly via evaporative cooling.
No, that’s really not borne out by the evidence. Multifolaterose’s posts have been strongly upvoted, it seems to me, by a significant group of readers who see themselves as defenders against groupthink. It’s just that you have been voted down for refusing to see a distinction that’s clearly there, between “here is a complicated thing which nevertheless must be reducible to simpler things, which is what we’re in the process of rigorously doing” and “here is a magical thing which we won’t ever have a mathematical understanding of, but it will work if we play by the right rules”.
Set your preferences to only hide comments below −5. Go to an old Open Thread or a particularly large discussion, and search for “comment score below threshold”.
“Karma” is the only definitionally supernatural item on that list—it is defined to be not reducible to nonmental mechanism. The others are merely elements of belief systems which contain elements that are supernatural (e.g. God).
Yes, the concept of “karma” can be reduced to naturalistic roots if you accept metaphysical naturalism, but the actual thing cannot be. It’s the quotation which you can reduce, not the referent.
You can reduce an AGI to the behavior of computer chips (or whatever fancy-schmancy substrate they end up running on), which are themselves just channels for the flow of electrons. Nothing mental there. Friendliness is a description of the utility function and decision theory of an AGI, both of which can be reduced to patterns of electrons on a computer chip.
It’s all electrons floating around. We just talk about ridiculous abstract things like AGI and Friendliness because it makes the math tractable.
By this definition isn’t “AGI” borderline supernatural and “friendliness” entirely supernatural?
This doesn’t feel like a right definition.
I don’t quite understand your confusion. An AGI is a computer program, and friendliness is a property of a computer program. Yes, these concepts allude to mental concepts on our maps, but these mental concepts are reducible to properties of the nonmental substrates that are our brains. In fact, the goal of FAI research is to find the reduction of friendliness to nonmental things.
Concepts of sin, or prayer, or karma, or intelligent design, and most other things considered “supernatural” can be reducible to properties of physical world with enough hand waving.
Karma scores in this thread suggest it falls in reference class of “arguing against groupthink”, which ironically increases estimates of Eliezer being a crackpot, and lesswrong turning into a cult, possibly via evaporative cooling.
No, that’s really not borne out by the evidence. Multifolaterose’s posts have been strongly upvoted, it seems to me, by a significant group of readers who see themselves as defenders against groupthink. It’s just that you have been voted down for refusing to see a distinction that’s clearly there, between “here is a complicated thing which nevertheless must be reducible to simpler things, which is what we’re in the process of rigorously doing” and “here is a magical thing which we won’t ever have a mathematical understanding of, but it will work if we play by the right rules”.
Is there a way to find random sample of threads with heavy downvoting? My experience on reddit suggests it’s usually groupthink.
Set your preferences to only hide comments below −5. Go to an old Open Thread or a particularly large discussion, and search for “comment score below threshold”.
“Karma” is the only definitionally supernatural item on that list—it is defined to be not reducible to nonmental mechanism. The others are merely elements of belief systems which contain elements that are supernatural (e.g. God).
Yes, the concept of “karma” can be reduced to naturalistic roots if you accept metaphysical naturalism, but the actual thing cannot be. It’s the quotation which you can reduce, not the referent.
You can reduce an AGI to the behavior of computer chips (or whatever fancy-schmancy substrate they end up running on), which are themselves just channels for the flow of electrons. Nothing mental there. Friendliness is a description of the utility function and decision theory of an AGI, both of which can be reduced to patterns of electrons on a computer chip.
It’s all electrons floating around. We just talk about ridiculous abstract things like AGI and Friendliness because it makes the math tractable.