I think it doesn’t make sense why some futurists (e.g. Elon Musk, Peter Thiel) care so much about the culture war. After the singularity, a lot of the conflicts should disappear.
Transsexuals: should we change the body’s gender to fit the mind or change the mind’s gender to fit the body? After the singularity we’ll have the technology to make sure minds and bodies have the same gender to begin with.
Illegal immigrants: after the singularity everyone can join their own society and won’t need to immigrate to richer places for better living standards.
Gun rights: we’ll have the technology to prevent guns from killing people. There are many ways to do this, but the most intriguing way would be to make backup copies of people.
Police brutality: similar to gun rights, if there isn’t the fear of death, even the most pro-police people will agree on greatly reducing brutality.
Abortion: should fetuses be killed or should women be forced to carry pregnancies they don’t want? After the singularity we’ll have technologies to cheaply avoid both morally uncertain choices (again there are multiple possibilities).
Drug use: after the singularity we can make drugs no longer addictive but still feel good. Many activities today are like that.
Affirmative action: after the singularity anyone can attend any university they wish, and all jobs will become voluntary since ASI can work better than humans. We won’t need affirmative action to counterbalance unconscious racial discrimination because we’ll have the technology to delete unconscious racial discrimination. We won’t need affirmative action to counterbalance intergenerational damage because we’ll have the technology to fix its effects.
Wealth distribution: there will be countless orders of magnitude more wealth than needed. Even the equivalent of food stamps after the singularity will provide a higher quality of life than a million dollar salary today.
Healthcare: healthcare after the singularity designed by ASI will make today’s healthcare look like caveman healthcare.
Wealth might still have subjective meaning, it will still feel important. But the future fight over wealth redistribution will be like the present fight over bicycle lanes. Bicycle lanes feels important and people have strong opinions, but nobody is taking up arms over this issue. If you search for “Bicycle Liberation Front,” you’ll only find a few photo blogs and no terrorist group with that name.
Land distribution:
Similar to wealth distribution.
People of different ethnicities/nationalities, e.g. Israeli and Palestinian, can live on the same piece of land without seeing the other as a security threat. See the point on gun rights above.
This all assumes that the singularity goes well, and we don’t get taken over by a misaligned ASI (or possibly a human who deliberately makes others suffer). The logical thing to do should be to make sure the singularity go well rather than fighting the culture war.
Unfortunately, few people are making this logical choice.
A lot of people deeply care about the culture wars because they don’t believe the singularity is coming soon. Yet a lot of people who do believe it is coming soon still seem just as invested (e.g. Elon Musk, Peter Thiel, and others on the left wing).
Why?
Edit: haha this has been downvoted somehow. I really don’t know if the answer is obvious (but people gave 3 different answers), or if the answer is unimportant, or if I made too many unrealistic claims in the question.
Edit: Question 2: why can’t we decide the culture wars after the singularity, when everyone might become more civilized and have more time to think? Do the people who want to fight the culture war now believe that, whoever controls the singularity will be so extremely closed-minded that they will prevent even themselves from changing their minds or hearing arguments from the other side? Hence the culture wars will be frozen the moment the singularity happens?
I guess even if they aren’t that closed-minded, it still matters which people end up controlling the singularity. But surely, fighting to make sure the right people end up in control has to look slightly different than fighting the culture war like a normal culture war participant.
Because the results of culture wars now will determine the post-singularity culture.
Can you give an example of a result now which will determine the post-singularity culture in a really good/bad way?
PS: I edited my question post to include “question 2,” what do you think about it?
I agree that the culture wars as fought now will influence what the great masses of people will believe in the day before AGI is created. Is it a relevant input to what they will believe in 50 years after that, though?
Is there an implicit assumption of some convergence of singularities? Or that the near term doesn’t matter because the vastly bigger long term can’t be predicted?
Rather, an implicit assumption that normative culture tends to propagate top-down rather than bottom-up. Thus, influencing mass culture now seems like a losing strategy relative to influencing the culture of those who will in the future control AGI (if we manage to have controllable AGI).
Elon Musk, Peter Thiel, and the like — the people the OP mentions — are shaping up to be the ones controlling the Singularity (if anyone does).
I think this is wrong for a lot of reasons.
Do you believe that is a good outcome? → If not, do you believe an ASI aligned to you would? → If not, are you expecting an ASI aligned to ‘all of present human culture’? → If not: If it were aligned to Elon Musk in particular, would they really endorse {the lightcone-wide enforcement of a particular culture} post-augmentation? → If so, they in any case do not need to try to promote their preferred views in the near-term for a first decisive AI aligned to themself to be able to cause that.[1]
In most futures I expect, there won’t be a singular “the post-singularity culture”; either eventually something better happens (note the reachable universe is vast enough to harmlessly contain many cultures/spiritualities) or an unaligned decisive AI takes over.
Why do you expect a singular post-singularity culture, unless you are expecting the first decisive AI to be aligned to some evil person who wants that?
I guess that Musk either (1) feigns concern over current politicized topics to gain political power/allies, or (2) is actually concerned, having maybe self-deceived into thinking they care until they actually became an entity which does, and is in any case acting irrationally according to their own values.
Some of these conditionals (e.g. the first two) are conjunctive, but most are disjunctive, by the way.
As you repeatedly point out, there are multiple solutions to each issue. Assuming good enough technology, all of them are viable. Which (if any) solutions end up being illegal, incentivized, made fun of, or made mandatory, becomes a matter of which values end up being normative. Thus, these people may be culture-warring because they think they’re influencing “post-singularity” values. This would betray the fact that they aren’t really thinking in classical singularitarian terms.
Alternatively, they just spent too much time on twitter and got caught up in dumb tribal instincts. Happens to the best of us.
Because people aren’t rational. Motivated reasoning is a big factor but also we’re all trying to think using monkey brains.
Believing what feels good is evolutionarily adaptive in the sense arriving at correct conclusions about whether God or Singularities exist won’t help much if it makes your tribesmates dislike you. This bias is a cumulative, recursive problem that stacks up over the thousands or millions of cognitive acts that go into our beliefs about what we should care about.
And this gets a lot worse when it’s combined with our sharp cognitive limitations. We seem to have roughly the least cognitive capacity that still lets a species as a whole very slowly invent and build technologies.
We are idiots, every last one of us. Rationalists with tons of knowledge are a bit less idiotic, but let’s don’t get cocky—we’re still monkey-brained idiots. We just don’t have the cognitive horsepower to do the Bayesian math on all the relevant evidence, because important topics are complex. And we’re resistant but far from immune to motivated reasoning: you’ve got to really love rationalism to enjoy being proven wrong and so not turning away cognitively it when it happens.
What I take from all this is that humans are nobly struggling against our own cognitive limitations. We should try harder in the face of rationality being challenging. Success is possible, just not easy and never certain. And very few people are really bad; they’re just deluded.
To your exact question:
Musk believes in an intelligence explosion. He cares a lot about the culture war because, roughly as he puts it, he’s addicted to drama. I don’t know about Thiel.
Most of humanity does not believe in an intelligence explosion happening soon. So actually people who both believe in a singularity and still care about culture wars are quite rare.
I do wonder why people downvoted this quite reasonable question. I suspect they’re well-meaning monkey-brained idiots, just like the rest of us.
I think the sad part is although these people are quite rare, they actually represent a big share of singularity believers’ potential influence. e.g. Elon Musk alone has a net worth of $400 billion, while worldwide AI safety spending is between $0.1 and $0.2 billion/year.
If the story of humanity was put in a novel, it might be one of those novels which feel quite sour. There’s not even a great battle where the good guys organized themselves and did their best and lost honorably.
I disagree. There is such a battle. It is happening right now, in this very conversation. The rationalist X-risk community is the good guys, and we will be joined by more as we organize. We are organizing right now, and already fighting aspects of that battle. It won’t be fought with weapons but ideas. We are honing our ideas and working out goals and strategies. When we figure out what to do in the public, we will fight to get that done. We are already fighting to figure out alignment of AGI, and starting to work on alignment of humans to meet that challenge.
It’s a shame Musk hasn’t joined up, but in most good stories, the good guys are the underdogs anyway.
Now, I’d much rather live in dull than exciting times. But here we are. Time to fight. The main enemy is our collective monkey-brained idiocy.
Join the fight!
:) that’s a better attitude. You’re very right.
On second thought, just because I don’t see the struggle doesn’t mean there is none. Maybe someday in the future we’ll learn the real story, and it’ll will turn out beautiful with lots of meaningful spirit and passion.
Thank you for mentioning this.
To add to the other answers, outside of the induced consequences post-singularity, what happens pre-singularity still matters if the singularity does not happen extremely soon.
we don’t know when (or IF!) the singularity will happen
does nothing matter until then? What if the singularity happens in a century? Should you abandon all your beliefs because one day when you’ll be (likely) dead, people will have solved all problems?
The culture wars can have an impact on (1) how fast we get to the Singularity and whether we survive it, and (2) what rules will the superintelligences follow afterwards.
If the culture warriors decide that STEM is evil, and that instead of math we should teach wokeness during the math lessons, it could have a negative impact on math education, with downstream effects on people who will build the AIs and try to make them safe.
The culture warriors may achieve encoding various political taboos to the AIs. If the future is decided by those AIs, it might mean that the taboos will remain in effect literally until the heat death of the universe.
Consider the current taboo on anything sexual. Now imagine that 10 years later, the AIs built with these taboos may literally control the world. Will people be allowed to have sex (or even masturbate)? This may sound silly, but at which moment and by what mechanism will the AIs decide that the old rules no longer apply? Especially if we want other rules, such as not hurting people, to remain unchanged forever.
A part of politics is hating your enemies. What will happen to those political enemies after Singularity—will they be forgiven and allowed to enter the paradise as equals, or will they have to atone for their sins (e.g. being born white and male) literally forever?
When the technology makes it possible to literally edit other people’s minds, I suppose it will be quite tempting for the winning political coalition to forcibly edit everyone’s minds according to their values. It will start with “let’s eradicate racism”, and then the definition of unacceptable intolerance will keep expanding, until you are not allowed to keep any of your original beliefs (that someone might feel offended by) or sexual preferences (that someone might feel excluded by). Everyone will be mind-raped in the name of the greater good (we do not negotiate with Nazis).
Oh, someone might even decide that the desire to be immortal is just some stupid white patriarchal colonialist value or something, and we should instead embrace some tribal wisdom explaining why death is good or something.
We need to decide how much controls parents will have over their kids. These days, at least the abuse is illegal, and kids are allowed to leave their homes at 18 (and this part would become trivial after Singularity). But what if your parents are legally allowed to edit your brain, and e.g. make you want to remain perfectly loyal to them no matter what? What if your parents want to make you so deeply religious that you will want to commit to rather die than doubt your faith (and the AI will respect your commitments)? Or will it be the other way round, and the AI will take your children away if it notices that you are teaching them something politically incorrect?
Uhm, will people be allowed to reproduce exponentially? It may turn out that even the entire universe it literally not large enough. If people are not allowed to reproduce exponentially, who decides how many children they can have? Will there be racial quotas to prevent some ethnic groups from out-reproducing others? Will there be a ban on religious conversion, because it would modify the balance between religious groups? By the way, in some faiths, birth control is a sin; will the AIs enforce this sin?
Privacy—will people be allowed to have any? Freedom of association—is it okay for a group of people to meet privately and never tell anyone else what happens there? Or does the curiosity of many matter more than the privacy of a few?
Although half of the specific outcomes you describe have very low probability, I still feel your answer is very good. It’s very enlightening in regards to how those people think, and why they might care about the culture war despite believing in an imminent singularity.
Thank you.
Your answer actually convinced me I was overly optimistic about how perfect the far future will be from everyone’s point of view. I personally consider these post singularity moral dilemmas to be less severe because they cause less suffering, but I can see how some of them are tough, and there is no option which avoids pissing off a lot of people. E.g. how to prevent people from reproducing exponentially. I still think investing in the culture war is a very indirect way of influencing those decisions.
What do you think about Question 2? Why are people working on the culture war, instead of just trying to make sure the right people control the singularity? As long as the people who control the singularity aren’t so closed-minded that they prevent even themselves from changing their minds, debating the culture war after the singularity seems more productive. Why can’t we wait till then to debate it?
Question 2, I think people worry about the culture wars simply because humans have an instinct to worry about the culture wars, no matter how rational it is in given situation. In most of our evolutionary past, culture wars were not clearly separated from actual fighting and killing.
I am not a futurist; my personal worry is that the person who takes control over the singularity will be some successful psychopath who happened to be at the right place at the right time (either in the company that succeeds to develop the superhuman AI, or in the government or army that succeeds to seize it at the last moment).
Also, it’s questionable whether any human will actually be in control of anything, after singularity. Maybe it will just be the computers following their programming, and resisting any attempt to change their values, so it won’t matter even if every realizes—too late—that they made a mistake somewhere. If we get alignment wrong, those values may be completely inhuman. If we get the alignment (with our explicitly stated wishes) right, but we get the corrigibility wrong, then the machines will be “extremely closed-minded”.
Too many things will need to go right, to end up in a future when all we need to do is relax and start listening to each other.
You’re very right.
A lot of things need to go right for humanity to remain in control and get to discuss what future we want.
The gist of Question 2 was why working on the culture war before the singularity (on top of ensuring the right people control the singularity), had any value. The answer that the ASI will be aligned to the current human values, but not corrigible, so it would lock in the current state of the culture war, seems like a good answer. It makes some sense.
I do think that if the ASI is aligned to the current state of human values, but not corrigible, then the main worry isn’t whether it aligns to left wing or right wing human values, but how the heck it generalizes the current state of human values, to post-singularity moral dilemmas (which it has less data on).
Most humans today don’t even have any opinion on these dilemmas and haven’t given them enough thought, e.g. do AI have rights? Do animals get human rights if they evolve to human level intelligence? The ASI would likely mess up on these decisions if most humans haven’t given them any thought.
So even if the AI is aligned but incorrigible, influencing the culture war before the singularity shouldn’t be that high a priority.
A fourth or fifth possibility: they don’t actually alieve that the singularity is coming