It is not clear to me exactly what “belief regarding suffering” you are talking about, what you mean by “ordinary human values”/”your own personal unique values”.
Belief regarding suffering: the belief that s-risks are bad, independently of human values as would be represented in CEV.
Ordinary human values: what most people have.
Your own personal unique values: what you have, but others don’t.
Please read the paper, and if you have any specific points of disagreement cite the passages you would like to discuss. Thank you
In my other reply comment, I pointed out disagreements with particular parts of the paper you cited in favour of your views. My fundamental disagreement though, is that you are fundamentally relying on an unjustified assumption, repeated in your comment above:
even if s-risks are very morally undesirable (either in a realist or non-realist sense)
The assumption being that s-risks are “very morally undesirable”, independently of human desires (represented in CEV).
You ask: “Where does your belief regarding the badness of s-risks come from?”
And you provide 3 possible answers I am (in your view) able to choose between:
“From what most people value” 2. “From what I personally value but others don’t” or 3. “from pure logic that the rest of us would realize if we were smart enough”.
However, the first two answers do not seem to be answers to the question. My beliefs about what is or is not morally desirable do not come from “what most people value” or “what I personally value but others don’t”. In one sense my beliefs about ethics, as everyone’s beliefs about ethics, come from various physical causes (personal experiences, conversations I have had with other people, papers I have read) such as in the formation of all other kinds of beliefs. There is another sense in which my beliefs about ethics, seem to me to be justified by reasons/preferences. This second sense, I believe is the one you are interested in discussing. And what is exactly the nature of the reasons or preferences that make me have certain ethical views is what the discipline of meta-ethics is about. To figure out or argue for which is the right position in meta-ethics is outside the scope of this paper, which is why I have not addressed it in the paper. Below I will reply to your other comment and discuss more the meta-ethical issue.
Belief regarding suffering: the belief that s-risks are bad, independently of human values as would be represented in CEV.
Ordinary human values: what most people have.
Your own personal unique values: what you have, but others don’t.
In my other reply comment, I pointed out disagreements with particular parts of the paper you cited in favour of your views. My fundamental disagreement though, is that you are fundamentally relying on an unjustified assumption, repeated in your comment above:
The assumption being that s-risks are “very morally undesirable”, independently of human desires (represented in CEV).
Okay, I understand better now.
You ask: “Where does your belief regarding the badness of s-risks come from?”
And you provide 3 possible answers I am (in your view) able to choose between:
“From what most people value” 2. “From what I personally value but others don’t” or 3. “from pure logic that the rest of us would realize if we were smart enough”.
However, the first two answers do not seem to be answers to the question. My beliefs about what is or is not morally desirable do not come from “what most people value” or “what I personally value but others don’t”. In one sense my beliefs about ethics, as everyone’s beliefs about ethics, come from various physical causes (personal experiences, conversations I have had with other people, papers I have read) such as in the formation of all other kinds of beliefs. There is another sense in which my beliefs about ethics, seem to me to be justified by reasons/preferences. This second sense, I believe is the one you are interested in discussing. And what is exactly the nature of the reasons or preferences that make me have certain ethical views is what the discipline of meta-ethics is about. To figure out or argue for which is the right position in meta-ethics is outside the scope of this paper, which is why I have not addressed it in the paper. Below I will reply to your other comment and discuss more the meta-ethical issue.