Odd anon

Karma: 335

Odd anon 14 Oct 2024 3:56 UTC
1 point
−2
on: Most arguments for AI Doom are either bad or weak
Get a dozen AI risk skeptics together, and I suspect you’ll get majority support from the group for each and every point that the AI risk case depends on. You, in particular, seem to be extremely aligned with the “doom” arguments.
The “guy-on-the-street” skeptic thinks that AGI is science fiction, and it’s silly to worry about it. Judging by your other answers, it seems like you disagree, and fully believe that AGI is coming. Go deep into the weeds, and you’ll find Sutton and Page and the radical e/accs who believe that AI will wipe out humanity, and that’s a good thing, and that wanting to preserve humanity and human control is just another form of racism. A little further out, plenty of AI engineers believe that AGI would normally wipe out humanity, but they’re going to solve the alignment problem in time so no need to worry. Some contrarians like to argue that intelligence has nothing to do with power, and that superintelligence will permanently live under humanity’s thumb because we have better access to physical force. And then, some optimists believe that AI will inevitably be benevolent, so no need to worry.
If I’m understanding your comments correctly, your position is something like “ASI can and will take over the world, but we’ll be fine”, a position so unusual I didn’t even think to include it detail in my lengthy taxonomy of “everything turns out okay” arguments. I am unable to make even a basic guess as to how you arrived at the position (though I would be interested in learning).
Please notice that your position is extremely non-intuitive to basically everyone. If you start with expert consensus regarding the basis of your own position in particular, you don’t get 87% chance that you’re right, you get a look of incredulity and an arbitrarily small number. If you instead want to examine the broader case for AI risk, most of the “good arguments” are going to look more like “no really, AI keeps getting smarter, look at this graph” and things like Yudkowsky’s “The Power of Intelligence”, both of which (if I understand correctly) you already think are obviously correct.
If you want to find good arguments for “humanity is good, actually”, don’t ask AI risk people, ask random “normal” people.
My apologies if I’ve completely misunderstood your position.
(PS: Extinction markets do not work, since they can’t pay out after extinction.)

Odd anon 16 Sep 2024 8:05 UTC
0 points
0
in reply to: ech’s comment on: The two paragraph argument for AI risk
AIPI Poll:
- “86% of voters believe AI could accidentally cause a catastrophic event, and 70% agree that mitigating the risk of extinction from AI should be a global priority alongside other risks like pandemics and nuclear war”
- “76% of voters believe artificial intelligence could eventually pose a threat to the existence of the human race, including 75% of Democrats and 78% of Republicans”
Also, this:
- “Americans’ top priority is preventing dangerous and catastrophic outcomes from AI”—with relatively few prioritizing things like job loss, bias, etc.

Odd anon 24 May 2024 8:27 UTC
4 points
5
in reply to: keltan’s comment on: What mistakes has the AI safety movement made?
Make that clear. But make it clear is a way that your uncle won’t laugh at over Christmas dinner.
Most people agree with Pause AI. Most people agree that AI might be a threat to humanity. The protests may or may not be effective, but I don’t really think they could be counterproductive. It’s not a “weird” thing to protest.

Odd anon 21 May 2024 4:40 UTC
21 points
1
on: What’s Going on With OpenAI’s Messaging?
Meta’s messaging is clearer.
“AI development won’t get us to transformative AI, we don’t think that AI safety will make a difference, we’re just going to optimize for profitability.”
So, Meta’s messaging is actually quite inconsistent. Yann LeCun says (when speaking to certain audiences, at least) that current AI is very dumb, and AGI is so far away it’s not worth worrying about all that much. Mark Zuckerberg, on the other hand, is quite vocal that their goal is AGI and that they’re making real progress towards it, suggesting 5+ year timelines.

Odd anon 13 May 2024 20:52 UTC
13 points
0
on: Against Student Debt Cancellation From All Sides of the Political Compass
Almost all of these are about “cancellation” by means of transferring money from the government to those in debt. Are there similar arguments against draining some of the ~trillion dollars held by university endowments to return to students who (it could be argued) were implicitly promised an outcome they didn’t get? That seems a lot closer to the plain meaning of “cancelling debt”.

Odd anon 3 May 2024 10:11 UTC
3 points
0
on: List your AI X-Risk cruxes!
Relevant: My Taxonomy of AI-risk counterarguments, inspired by Zvi Mowshowitz’s The Crux List.

Odd anon 2 May 2024 3:30 UTC
1 point
0
on: “You’re the most beautiful girl in the world” and Wittgensteinian Language Games
This isn’t that complicated. The halo effect is real and can go to extremes when romantic relationships are involved, and most people take their sense data at face value most of the time. The sentence is meant completely literally.

Odd anon 1 May 2024 22:44 UTC
4 points
0
on: Why I’m doing PauseAI
GPT-5 training is probably starting around now
Sam Altman confirmed (paywalled, sorry) in November that GPT-5 was already under development. (Interestingly, the confirmation was almost exactly six months after Altman told a senate hearing (under oath) that “We are not currently training what will be GPT-5; we don’t have plans to do it in the next 6 months.”)

Odd anon 18 Apr 2024 3:08 UTC
1 point
0
in reply to: npostavs’s comment on: Mid-conditional love
The United States is an outlier in divorce statistics. In most places, the rate is nowhere near that high.

Odd anon 17 Apr 2024 10:19 UTC
13 points
6
on: Mid-conditional love
It is not that uncommon for people to experience severe dementia and become extremely needy and rapidly lose many (or all) of the traits that people liked about them. Usually, people don’t stop being loved just because they spend their days hurling obscenities at people, failing to preserve their own hygiene, and expressing zero affection.
I would guess that most parents do actually love their children unconditionally, and probably the majority of spouses unconditionally love their partners.
(Persistent identity is a central factor in how people relate to each other, so one can’t really say that “it is only conditions that separate me from the worms.”)

Odd anon 4 Jan 2024 6:02 UTC
9 points
2
on: Terminology: <something>-ware for ML?
Brainware.
Brains seem like the closest metaphor one could have for these. Lizards, insects, goldfish, and humans all have brains. We don’t know how they work. They can be intelligent, but are not necessarily so. They have opaque convoluted processes inside which are not random, but often have unexpected results. They are not built, they are grown.
They’re often quite effective at accomplishing something that would be difficult to do any other way. Their structure is based around neurons of some sort. Input, mystery processes, output. They’re “mushy” and don’t have clear lines, so much of their insides blur together.
AI companies are growing brainware in larger and larger scales, raising more powerful brainware. Want to understand why the chatbot did something? Try some new techniques for probing its brainware.
This term might make the topic feel more mysterious/magical to some than it otherwise would, which is usually something to avoid when developing terminology, but in this case, people have been treating something mysterious as not mysterious.

Odd anon 1 Jan 2024 4:11 UTC
11 points
4
in reply to: Shankar Sivarajan’s comment on: The proper response to mistakes that have harmed others?
(The precise text, from “The Andalite Chronicles”, book 3: “I have made right everything that can be made right, I have learned everything that can be learned, I have sworn not to repeat my error, and now I claim forgiveness.”)

Odd anon 6 Dec 2023 4:37 UTC
4 points
0
in reply to: TekhneMakre’s comment on: We’re all in this together
Larry Page (according to Elon Musk), want AGI to take the world from humanity
(IIRC, Tegmark, who was present for the relevant event, has confirmed that Page had stated his position as described.)

Odd anon 30 Nov 2023 23:34 UTC
1 point
1
in reply to: 1a3orn’s comment on: AI #40: A Vision from Vitalik
Ehhh, I get the impression that Schidhuber doesn’t think of human extinction as specifically “part of the plan”, but he also doesn’t appear to consider human survival to be something particularly important relative to his priority of creating ASI. He wants “to build something smarter than myself, which will build something even smarter, et cetera, et cetera, and eventually colonize and transform the universe”, and thinks that “Generally speaking, our best protection will be their lack of interest in us, because most species’ biggest enemy is their own kind. They will pay about as much attention to us as we do to ants.”
I agree that he’s not overtly “pro-extinction” in the way Rich Sutton is, but he does seem fairly dismissive of humanity’s long-term future in general, while also pushing for the creation of an uncaring non-human thing to take over the universe, so...

Odd anon 30 Nov 2023 8:46 UTC
2 points
1
on: Will AIs become self-interested?
Hendrycks goes into some detail on the issue of AI being affected by natural selection in this paper.

Odd anon 30 Nov 2023 8:27 UTC
1 point
0
on: Ethicophysics I
Please link directly to the paper, rather than requiring readers to click their way through the substack post. Ideally, the link target would be on a more convenient site than academia.edu, which claims to require registration to read the content. (The content is available lower down, but the blocked “Download” buttons are confusing and misleading.)

Odd anon 30 Nov 2023 8:23 UTC
2 points
1
on: The Alignment Agenda THEY Don’t Want You to Know About
When this person goes to post the answer to the alignment problem to LessWrong, they will have low enough accumulated karma that the post will be poorly received.
Does the author having lower karma actually cause posts to be received more poorly? The author’s karma isn’t visible anywhere on the post, or even in the hover-tooltip by the author’s name. (One has to click through to the profile to find out.) Even if readers did know the author’s karma, would that really cause people to not just judge it by its content? I would be surprised.

Odd anon 30 Nov 2023 1:51 UTC
7 points
0
on: Stupid Question: Why am I getting consistently downvoted?
I found some of your posts to be really difficult to read. I still don’t really know what some of them are even talking about, and on originally reading them I was not sure whether there was anything even making sense there.
Sorry if this isn’t all that helpful. :/

Odd anon 29 Nov 2023 23:27 UTC
1 point
0
in reply to: stochastic_parrot’s comment on: ChatGPT 4 solved all the gotcha problems I posed that tripped ChatGPT 3.5
Wild guess: It realised its mistake partway through, and followed through it anyway as sensibly as could be done, balancing between giving a wrong calculation (“+ 12 = 41“), ignoring the central focus of the question (” + 12 = 42”), and breaking from the “list of even integers” that it was supposed to be going through. I suspect it would not make this error when using chain-of-thought.

Odd anon 29 Nov 2023 8:59 UTC
3 points
0
on: Is there a word for discrimination against A.I.?
Such a word being developed would lead to inter-group conflict, polarisation, lots of frustration, and general bad things to society, regardless of which side you may be on. Also, it would move the argument in the wrong direction.
If you’re pro-AI-rights, you could recognize that bringing up “discrimination” (as in, treating AI at all differently from people) is very counterproductive. If you’re on this side, you probably believe that society will gradually understand that AIs deserve rights, and that there will be a path towards that. The path would likely start with laws prohibiting deliberately torturing AIs for its own sake, then something closer to animal rights (some minimal protections against putting AI through very bad experiences even when it would be useful, and perhaps against using AIs for sexual purposes since it can’t consent), then some basic restrictions on arbitrarily creating, deleting, and mindwiping AIs, and then against slavery, etc etc. Bringing up “discrimination” early would be pushing an end-game conflict point early, convincing some that they’re moving onto a slippery slope if they allow any movement down the path, even if they agree with the early steps on their own. The noise of argument would slow down the progress.
If you’re anti-AI-rights (being sure of AI non-sentience, or otherwise), then such a word is just a thing to make people feel bad, without any positives. People on this side would likely conclude that disagreement on “AI rights” is probably temporary, until either people understand the situation better or the situation changes. Suddenly “raising the stakes” on the argument would be harmful, bringing in more noise which would make it harder to hear the “signal” underneath, thus pushing the argument in the wrong direction. The word would make it take longer for the useless dispute to die down.