I wonder what the feasibility is for a group of LW-ers somehow putting on retainer a charter flight to NZ?
bokov
Karma: 101
How would a nuclear test demonstrate that Putin is not bluffing?
It only demonstrates that he has nukes, which we already know.
I’m also biting the bullet and saying that this is probably what we should aim for, barring pivotal acts because I see AGI development as mostly inevitable, and there are far worse outcomes than this.
Dead is dead, whether due to AGI or due to a sufficient percentage of smart people convincing themselves that destructive uploading is good enough and continuity is a philosophical question that doesn’t matter.
Now, if synchronizing minds is possible, it would address this problem.
But I don’t see nearly as much attention being put into that as into uploading. Why?
A copy of you ceases to exist and then another copy comes into existence with the exact same sense of memories/continuity of self etc. That’s like going to sleep and waking up.
Even when it becomes possible to do this at sufficient resolution, I see no reason it won’t be like going to sleep and never waking up.
It’s not as if there is a soul to transfer or share between the two instances. No way to sync the experiences of the two instances.
So I don’t see a fundamental difference between “You go to sleep and an uploaded you wakes up” vs “You go to sleep and an uploaded somebody else wakes up”. In either case it will be a life in which I am not a participant and experiences I will not be able to access.
Non-destructive uploads could be benign, provided they are not used as an excuse for not improving the lives of the original instances.
What I like about this story is that it makes more accessible the (to me) obvious fact that, in the absence of technology to synchronize/reintegrate memories from parallel instances, uploading does not solve any problems for you—it at best spawns a new instance of you that doesn’t have those problems, but you still do.
Yet uploading is so much easier than fixing death/illness/scarcity in the physical world that people want to believe it’s the holy grail. And may resist evidence to the contrary.
Destructive uploads are murder and/or suicide.
Are there any specific examples of anybody working on AI tools that autonomously look for new domains to optimize over?
If no, then doesn’t the path to doom still amount to a human choosing to apply their software to some new and unexpectedly lethal domain or giving the software real-world capabilities with unexpected lethal consequences? So then, shouldn’t that be a priority for AI safety efforts?
If yes, then maybe we should have a conversation about which of these projects is most likely to bootstrap itself, and the likely paths it will take?
Now we know more than nothing about the real-world operational details of AI risks. Albeit mostly banal everyday AI that we can’t imagine harming us at scale. So maybe that’s what we should try harder to imagine and prevent.
Maybe these solutions will not generalize out of this real-world already-observed AI risk distribution. But even if not, which of these is more dignified?
Being wiped out in a heartbeat by some nano-Cthulu in pursuit of some inscrutable goal that nobody genuinely saw coming
Being killed even before that by whatever is the most lethal thing you can imagine evolving from existing ad-click maximizers, bitcoin maximizers, up-vote maximizers, (oh, and military drones, those are kind of lethal) etc. because they seemed like too mundane a threat
You opinions count, though most of us disagree with you. Thus, the replies.
Let’s suppose that supporting Ukraine does further empower ‘our globe-spanning military-industrial complex’. But failing to support Ukraine empower the rival globe-spanning military-industrial complex that in addition to Russia includes Iran, Syria, and China.
A ceasefire that results in Russia keeping more Ukrainian land than it started will empower this rival military-industrial complex and set the precedent for rewarding aggression while weakening Ukraine militarily and strategically. Even letting Russia keep Don-Bas and Crimea will leave Ukraine vulnerable to future invasions.
So, which globe-spanning military-industrial complex do you oppose more?