When people call things like this post “rough to write/read”, and consider them to require a content warning, I wonder if most people are able to think clearly (or at all) about actually terrible scenarios, and worry that they aren’t. (I’m especially worried if those people have influence in a domain where there might be a tradeoff between mitigating X-risks vs mitigating S-risks.)
I liked the description of the good future, though. Thanks for the reminder that things can (maybe) go well, too.
My intended message might’ve been better worded as follows
If staring into abysses is difficult/rough, then adequately staring into the darker abysses might require counter-intuitively large amounts of effort/agency. And yet, I think it might be necessary to grok those darker abysses, if we are to avoid falling into them. That makes me worried.
OTOH, you seem exceptionally reflective, so perhaps that worry is completely unfounded in your case. Anyway, I’m grateful for the work you do; I wish there were more people like you in this world. (Also, your attention is extremely valuable, so please feel free to promptly drop/forget this conversation.)
A 10lb weight might be tough for one person to do a particular exercise with, but trivial for another person. Does that mean the weight shouldn’t be labeled?
How would we quantify relative weights if we didn’t have mass as a globally agreed-upon metric to order them by? I think we could do better-than-nothing by comparing relative weight: In a world without lbs and kg, a gym could still mark one dumbbell as being the smallest, the next one up as being above the smallest, the next as being above the second, and so on.
In the domain of content, we similarly lack an objective scale of absolute weight, but it’s still often better than nothing to flag “heavier than you might be expecting”.
Do you get annoyed at stores that put out a “wet floor” sign after mopping, if you personally happen to have good balance and be wearing non-slip shoes? Or do you accept that convention as existing to help people who are in a worse situation than yours, such as being infirm or poorly shod, avoid a kind of mishap that’s not relevant to you?
The problem is not that there is a distribution of X along a spectrum, more so a problem that X is arbitrarily defined by each imperfect agent with some non-zero degree of self-serving goals, and that each agent can secretly coordinate with other agents.
So readers will always have the lingering suspicion that some amount of secret coordination is going on behind the scenes.
Of course this general principle applies to nearly everything, including every internet essay ever written, but it’s especially noticeable when very high levels of trust are needed in a community.
There is no such problem with physical units of measurement, such as mass, because no amount of political power, social status, etc., can even slightly tilt the meaning of 1 kg without a worldwide consensus.
Since billions of people have enough resources to independently verify what’s 1 kg or not, the effective outcome is a billion+ strong unanimous consensus. A consensus of a few dozen LW accounts is microscopic in comparison.
When people call things like this post “rough to write/read”, and consider them to require a content warning, I wonder if most people are able to think clearly (or at all) about actually terrible scenarios, and worry that they aren’t. (I’m especially worried if those people have influence in a domain where there might be a tradeoff between mitigating X-risks vs mitigating S-risks.)
I liked the description of the good future, though. Thanks for the reminder that things can (maybe) go well, too.
Whenever people are sad for any reason except s-risk, I wonder if they’re able to think at all about important issues. /s
Right; that would be a silly thing to think.
My intended message might’ve been better worded as follows
OTOH, you seem exceptionally reflective, so perhaps that worry is completely unfounded in your case. Anyway, I’m grateful for the work you do; I wish there were more people like you in this world. (Also, your attention is extremely valuable, so please feel free to promptly drop/forget this conversation.)
A 10lb weight might be tough for one person to do a particular exercise with, but trivial for another person. Does that mean the weight shouldn’t be labeled?
How would we quantify relative weights if we didn’t have mass as a globally agreed-upon metric to order them by? I think we could do better-than-nothing by comparing relative weight: In a world without lbs and kg, a gym could still mark one dumbbell as being the smallest, the next one up as being above the smallest, the next as being above the second, and so on.
In the domain of content, we similarly lack an objective scale of absolute weight, but it’s still often better than nothing to flag “heavier than you might be expecting”.
Do you get annoyed at stores that put out a “wet floor” sign after mopping, if you personally happen to have good balance and be wearing non-slip shoes? Or do you accept that convention as existing to help people who are in a worse situation than yours, such as being infirm or poorly shod, avoid a kind of mishap that’s not relevant to you?
The problem is not that there is a distribution of X along a spectrum, more so a problem that X is arbitrarily defined by each imperfect agent with some non-zero degree of self-serving goals, and that each agent can secretly coordinate with other agents.
So readers will always have the lingering suspicion that some amount of secret coordination is going on behind the scenes.
Of course this general principle applies to nearly everything, including every internet essay ever written, but it’s especially noticeable when very high levels of trust are needed in a community.
There is no such problem with physical units of measurement, such as mass, because no amount of political power, social status, etc., can even slightly tilt the meaning of 1 kg without a worldwide consensus.
Since billions of people have enough resources to independently verify what’s 1 kg or not, the effective outcome is a billion+ strong unanimous consensus. A consensus of a few dozen LW accounts is microscopic in comparison.