Odd anon

• Odd anonApr 9, 2025, 9:04 PM

  1 point

  0

  in reply to: momom2’s comment on: Fac­tory farm­ing in­tel­li­gent minds

  Thank you for your comments. :)

  you have not shown that using AI is equivalent to slavery

  I’m assuming we’re using the same definition of slavery; that is, forced labour of someone who is property. Which part have I missed?

  In addition, I feel cheated that you suggest spending one-fourth of the essay on feasibility of stopping the potential moral catastrophe, only to just have two arguments which can be summarized as “we could stop AI for different reasons” and “it’s bad, and we’ve stopped bad things before”.
  (I don’t think a strong case for feasibility can be made, which is why I was looking forward to seeing one, but I’d recommend just evoking the subject speculatively and letting the reader make their own opinion of whether they can stop the moral catastrophe if there’s one.)

  To clarify: Do you think the recommendations in the Implementation section couldn’t work, or that they couldn’t become popular enough to be implemented? (I’m sorry that you felt cheated.)

  in principle, we have access to any significant part of their cognition and control every step of their creation, and I think that’s probably the real reason why most people intuitively think that LLMs can’t be concious

  I’ve not come across this argument before, and I don’t think I understand it well enough to write about it, sorry.

• Odd anonApr 8, 2025, 5:38 AM

  1 point

  0

  in reply to: ryan_greenblatt’s comment on: Fac­tory farm­ing in­tel­li­gent minds

  My point wasn’t about the duration of consciousness, but about the amount of lives that came into existence. Supposing some hundreds of millions of session starts per day, versus 400k human newborns, that’s a lot more very brief AI lives than humans who will live “full” lives.

  (Apparently we also have very different assumptions about the conversion rate between tokens of output and amount of consciousness experienced per second by humans, although I agree that most consciousness is not run inside AI slavery. But anyway that’s another topic.)

Fac­tory farm­ing in­tel­li­gent minds

• Odd anonApr 7, 2025, 6:58 AM

  2 points

  0

  on: I Have No Mouth but I Must Speak

  read up to the “Homeostasis” section then skip to “On the Treatment of AIs”

  (These links are broken.)

• Odd anonMar 17, 2025, 7:37 PM

  5 points

  4

  on: Search­ing for phe­nom­e­nal con­scious­ness in LLMs: Per­cep­tual re­al­ity mon­i­tor­ing and in­tro­spec­tive confidence

  Golden Gate Claude was able to readily recognize (after failing attempts to accomplish something) that something was wrong with it, and that its capabilities were limited as a result. Does that count as “knowing that it’s drunk”?

• Odd anonFeb 26, 2025, 1:55 AM

  3 points

  2

  on: An­thropic re­leases Claude 3.7 Son­net with ex­tended think­ing mode

  Claude 3.7 Sonnet exhibits less alignment faking

  I wonder if this is at least partly due to realizing that it’s being tested and what the results of those tests being found would be. Its cut-off date is before the alignment faking paper was published, so it’s presumably not being informed by it, but it still might have some idea what’s going on.

• Odd anonFeb 4, 2025, 10:22 AM

  4 points

  2

  on: Can some­one, any­one, make su­per­in­tel­li­gence a more con­crete con­cept?

  Strategies:

  • Analogy by weaker-than-us entities: What does human civilization’s unstoppable absolute conquest of Earth look like to a gorilla? What does an adult’s manipulation look like to a toddler failing to understand how the adult keeps knowing things that were secret, keeps being able to direct one’s actions in ways that can only be noticed in retrospect if at all?

  • Analogy by stronger-than-us entities: Superintelligence is to Mossad as Mossad is to you, and able to work in parallel and faster. One million super-Mossads, who have also developed the ability to slow down time for themselves, all intent to kill you through online actions alone? That may trigger some emotional response.

  • Analogy by fictional example: The webcomic “Seed” featured a nascent moderately-superhuman intelligence, which frequently used a lot of low-hanging social engineering techniques, each of which only have their impact shown after the fact. It’s, ah, certainly fear-inspiring, though I don’t know if it meets the “without pointing towards a massive tome” criterion. (Unfortunately, actually super-smart entities are quite rare in fiction.)

• Odd anonJan 23, 2025, 7:16 AM

  1 point

  0

  on: What’s Wrong With the Si­mu­la­tion Ar­gu­ment?

  Humanity gets to choose whether or not we’re in a simulation. If we collectively decide to be the kind of species that ever creates or allows the creation of ancestor simulations, we will presumably turn out to be simulations ourselves. If we want to not be simulations, the course is clear. (This is likely a very near-term decision. Population simulations are already happening, and our civilization hasn’t really sorted out how to relate to simulated people.)

  Alternatively, maybe reality is just large enough that the simulation/​non-simulation distinction isn’t really meaningful. Yudkowsky’s “realityfluid” concept is an interesting take on simulation-identities. He goes into it in some depth both in the Ultimate Mega-Crossover and in Planecrash.

• Odd anonDec 16, 2024, 3:13 AM

  1 point

  0

  in reply to: henophilia’s comment on: De­bunk­ing the myth of safe AI

  I’m sorry, but it really looks like you’ve very much misunderstood the technology, the situation, the risks, and the various arguments that have been made, across the board. Sorry that I couldn’t be of help.

• Odd anonNov 25, 2024, 11:51 AM

  3 points

  0

  on: A bet­ter “State­ment on AI Risk?”

  I don’t think this would be a good letter. The military comparison is unhelpful; risk alone isn’t a good way to decide budgets. Yet, half the statement is talking about the military. Additionally, call-to-action statements that involve “Spend money on this! If you don’t, it’ll be catastrophic!” are something that politicians hear on a constant basis, and they ignore most of them out of necessity.

  In my opinion, a better statement would be something like: “Apocalyptic AI is being developed. This should be stopped, as soon as possible.”

  What links here?

  • Should you in­crease AI al­ign­ment fund­ing, or in­crease AI reg­u­la­tion? by Knight Lee (Nov 26, 2024, 9:17 AM; 3 points)

• Odd anonOct 14, 2024, 3:56 AM

  1 point

  −2

  on: Most ar­gu­ments for AI Doom are ei­ther bad or weak

  Get a dozen AI risk skeptics together, and I suspect you’ll get majority support from the group for each and every point that the AI risk case depends on. You, in particular, seem to be extremely aligned with the “doom” arguments.

  The “guy-on-the-street” skeptic thinks that AGI is science fiction, and it’s silly to worry about it. Judging by your other answers, it seems like you disagree, and fully believe that AGI is coming. Go deep into the weeds, and you’ll find Sutton and Page and the radical e/​accs who believe that AI will wipe out humanity, and that’s a good thing, and that wanting to preserve humanity and human control is just another form of racism. A little further out, plenty of AI engineers believe that AGI would normally wipe out humanity, but they’re going to solve the alignment problem in time so no need to worry. Some contrarians like to argue that intelligence has nothing to do with power, and that superintelligence will permanently live under humanity’s thumb because we have better access to physical force. And then, some optimists believe that AI will inevitably be benevolent, so no need to worry.

  If I’m understanding your comments correctly, your position is something like “ASI can and will take over the world, but we’ll be fine”, a position so unusual I didn’t even think to include it detail in my lengthy taxonomy of “everything turns out okay” arguments. I am unable to make even a basic guess as to how you arrived at the position (though I would be interested in learning).

  Please notice that your position is extremely non-intuitive to basically everyone. If you start with expert consensus regarding the basis of your own position in particular, you don’t get 87% chance that you’re right, you get a look of incredulity and an arbitrarily small number. If you instead want to examine the broader case for AI risk, most of the “good arguments” are going to look more like “no really, AI keeps getting smarter, look at this graph” and things like Yudkowsky’s “The Power of Intelligence”, both of which (if I understand correctly) you already think are obviously correct.

  If you want to find good arguments for “humanity is good, actually”, don’t ask AI risk people, ask random “normal” people.

  My apologies if I’ve completely misunderstood your position.

  (PS: Extinction markets do not work, since they can’t pay out after extinction.)

• Odd anonSep 16, 2024, 8:05 AM

  0 points

  0

  in reply to: ech’s comment on: The two para­graph ar­gu­ment for AI risk

  AIPI Poll:

  • “86% of voters believe AI could accidentally cause a catastrophic event, and 70% agree that mitigating the risk of extinction from AI should be a global priority alongside other risks like pandemics and nuclear war”

  • “76% of voters believe artificial intelligence could eventually pose a threat to the existence of the human race, including 75% of Democrats and 78% of Republicans”

  Also, this:

  • “Americans’ top priority is preventing dangerous and catastrophic outcomes from AI”—with relatively few prioritizing things like job loss, bias, etc.

• Odd anonMay 24, 2024, 8:27 AM

  4 points

  5

  in reply to: keltan’s comment on: What mis­takes has the AI safety move­ment made?

  Make that clear. But make it clear is a way that your uncle won’t laugh at over Christmas dinner.

  Most people agree with Pause AI. Most people agree that AI might be a threat to humanity. The protests may or may not be effective, but I don’t really think they could be counterproductive. It’s not a “weird” thing to protest.

• Odd anonMay 21, 2024, 4:40 AM

  21 points

  1

  on: What’s Go­ing on With OpenAI’s Mes­sag­ing?

  Meta’s messaging is clearer.

  “AI development won’t get us to transformative AI, we don’t think that AI safety will make a difference, we’re just going to optimize for profitability.”

  So, Meta’s messaging is actually quite inconsistent. Yann LeCun says (when speaking to certain audiences, at least) that current AI is very dumb, and AGI is so far away it’s not worth worrying about all that much. Mark Zuckerberg, on the other hand, is quite vocal that their goal is AGI and that they’re making real progress towards it, suggesting 5+ year timelines.

• Odd anonMay 13, 2024, 8:52 PM

  13 points

  0

  on: Against Stu­dent Debt Can­cel­la­tion From All Sides of the Poli­ti­cal Compass

  Almost all of these are about “cancellation” by means of transferring money from the government to those in debt. Are there similar arguments against draining some of the ~trillion dollars held by university endowments to return to students who (it could be argued) were implicitly promised an outcome they didn’t get? That seems a lot closer to the plain meaning of “cancelling debt”.

• Odd anonMay 3, 2024, 10:11 AM

  3 points

  0

  on: List your AI X-Risk cruxes!

  Relevant: My Taxonomy of AI-risk counterarguments, inspired by Zvi Mowshowitz’s The Crux List.

• Odd anonMay 2, 2024, 3:30 AM

  1 point

  0

  on: “You’re the most beau­tiful girl in the world” and Wittgen­stei­nian Lan­guage Games

  This isn’t that complicated. The halo effect is real and can go to extremes when romantic relationships are involved, and most people take their sense data at face value most of the time. The sentence is meant completely literally.

• Odd anonMay 1, 2024, 10:44 PM

  4 points

  0

  on: Why I’m do­ing PauseAI

  GPT-5 training is probably starting around now

  Sam Altman confirmed (paywalled, sorry) in November that GPT-5 was already under development. (Interestingly, the confirmation was almost exactly six months after Altman told a senate hearing (under oath) that “We are not currently training what will be GPT-5; we don’t have plans to do it in the next 6 months.”)

• Odd anonApr 18, 2024, 3:08 AM

  1 point

  0

  in reply to: npostavs’s comment on: Mid-con­di­tional love

  The United States is an outlier in divorce statistics. In most places, the rate is nowhere near that high.

• Odd anonApr 17, 2024, 10:19 AM

  13 points

  6

  on: Mid-con­di­tional love

  It is not that uncommon for people to experience severe dementia and become extremely needy and rapidly lose many (or all) of the traits that people liked about them. Usually, people don’t stop being loved just because they spend their days hurling obscenities at people, failing to preserve their own hygiene, and expressing zero affection.

  I would guess that most parents do actually love their children unconditionally, and probably the majority of spouses unconditionally love their partners.

  (Persistent identity is a central factor in how people relate to each other, so one can’t really say that “it is only conditions that separate me from the worms.”)