David Althaus

Karma: 1,661

David Althaus 9 Feb 2025 15:22 UTC
2 points
0
in reply to: John Peng`’s comment on: What is malevolence? On the nature, measurement, and distribution of dark traits
So I guess the conundrum is, are bad people nessescary to do good things?
Hm, I don’t think so. What about Lincoln, JFK, Roosevelt, Marcus Aurelius, Adenauer, etc.?

David Althaus 27 Oct 2024 8:42 UTC
7 points
3
in reply to: cousin_it’s comment on: What is malevolence? On the nature, measurement, and distribution of dark traits
Thanks, I mostly agree.

But even in colonialism, individual traits played a role. For example, compare King Leopold II’s rule over the Congo Free State vs. other colonial regimes.

While all colonialism was exploitative, under Leopold’s personal rule the Congo saw extraordinarily brutal policies, e.g., his rubber quota system led soldiers to torture and cut off the hands of workers, including children, who failed to meet quotas. Under his rule,1.5-15 million Congolese people died—the total population was only around 15 to 20 million. The brutality was so extreme that it caused public outrage which led other colonial powers to intervene until the Belgian government took control over the Congo Free State from Leopold.

Compare this to, say, British colonial administration during certain periods which, while still overall morally reprehensible, saw much less barbaric policies under some administrators who showed basic compassion for indigenous people. For instance, Governor William Bentinck in India abolished practices like sati (widows burning themselves alive) and implemented other humanitarian reforms.

One can easily find other examples (e.g. sadistic slave owners vs. more compassionate slave owners).

In conclusion, I totally agree that power imbalances enabled systemic exploitation regardless of individual temperament. But individual traits significantly affected how much suffering and death that exploitation created in practice.^[1]
1. ^
  Also, slavery and colonialism were ultimately abolished (in the Western world). My guess is that those who advocated for these reforms were, on average, more compassionate and less malevolent than those who tried to preserve these practices. Of course, the reformers were also heavily influenced by great ideas like the Enlightenment / classic liberalism.

David Althaus 24 Oct 2024 9:20 UTC
2 points
0
in reply to: David Gross’s comment on: What is malevolence? On the nature, measurement, and distribution of dark traits
Thanks, good point! I suppose it’s a balancing act and depends on the specifics in question and the amount of shame we dole out. My hunch would be that a combination of empathy and shame (“carrot and stick”) may be best.

David Althaus 24 Oct 2024 9:18 UTC
8 points
3
in reply to: cousin_it’s comment on: What is malevolence? On the nature, measurement, and distribution of dark traits
I agree that the problem of “evil” is multifactorial with individual personality traits being only one of several relevant factors, with others like “evil/fanatical ideologies” or misaligned incentives/organizations plausibly being overall more important. Still, I think that ignoring the individual character dimension is perilous.
It seems to me that most people become much more evil when they aren’t punished for it. [...] So if we teach AIs to be as “aligned” as the average person, and then AIs increase in power beyond our ability to punish them, we can expect to be treated as a much-less-powerful group in history—which is to say, not very well.
Makes sense. On average, power corrupts / people become more malevolent if no one holds them accountable—but again, there seem to exist interindividual differences with some people behaving much better than others even when having enormous power (cf. this section).

David Althaus 1 Jul 2024 9:46 UTC
2 points
0
in reply to: Presley Graham’s comment on: David Althaus’s Shortform
Thanks. Sorry for not being more clear, I pasted a screenshot (I’m reading the book on Kindle and can’t copy-paste) and asked Claude to transcribe the image into written text.

Again, this is not the first time this happened. Claude refused to help me translate a passage from the Quran (I wanted to check which of two translations was more accurate), refused to transcribe other parts of the above-mentioned Kindle book, and refused to provide me with details about what happened at Tuol Sleng prison. I eventually could persuade Claude in all of these cases but I grew tired of wasting my time and found it frustrating to deal with Claude’s obnoxious holier-than-thou attitude.

David Althaus 30 Jun 2024 11:52 UTC
9 points
0
in reply to: Nathan Helm-Burger’s comment on: David Althaus’s Shortform
I downvoted Claude’s response (i.e., clicked the thumbs-down symbol below the response) and selected “overactive refusal” as the reason. I didn’t get in contact with Anthropic directly.

David Althaus 28 Jun 2024 12:22 UTC
31 points
13
on: David Althaus’s Shortform
I had to cancel my Claude subscription (and signed up for ChatGPT) because Claude (3.5 Sonnet) constantly refuses to transcribe or engage with texts that discuss extremism or violence, even if it’s clear that this is done in order to better understand and prevent extremist violence.

Example text Claude refuses to transcribe below. For context, the text discusses the motivations and beliefs of Yigal Amir who assassinated the Israeli Prime Minister in 1995.
God gave the land of Israel to the Jewish People,” he explained, and he, Yigal Amir, was making certain that God’s promises, which he believed in with all his heart and to which he had committed his life, were not to be denied. He could not fathom, he declared, how a Jewish state would dare renege on the Jewish birthright, and he could not passively stand by as this terrifying religious tragedy took place. In Amir’s thinking, his action was not a personal matter or an act of passion but a solution, albeit an extreme one, to a religious and psychological trauma brought about by the actions of the Rabin government. Though aware of the seriousness of his action, Amir explained that his fervent faith encouraged and empowered him to commit this act of murder. He told his interrogators, “Without believing in God and an eternal world to come, I would never have had the power to do this.” Rabin deserved to die because he was facilitating, in Amir’s and other militants’ view, the possible mass murder of Jews by consenting to the Oslo peace agreements. This made Rabin, according to halacha, or Jewish law, a rodef, someone about to kill an innocent person and whom a bystander may therefore execute without a trial. Rabin was also a moser, a Jew who willingly betrays his brethren, and guilty of treason for cooperating with Yasser Arafat and the Palestinian Authority in surrendering rights to the Holy Land. Jewish jurisprudence considers the actions of the rodef and moser among the most pernicious crimes; persons guilty of such acts are to be killed at the first opportunity.
This type of refusal has happened numerous times. Claude doesn’t change its behavior when I provide arguments (unless I spend a lot of time on this).

I haven’t used ChatGPT as much but it so far has never refused.

I hope Anthropic changes Claude so I can continue using it again; I certainly don’t like the idea of supporting OpenAI.
What links here?
- AI #71: Farewell to Chevron by Zvi (4 Jul 2024 13:40 UTC; 53 points)

David Althaus 29 Sep 2023 12:19 UTC
11 points
3
on: Making AIs less likely to be spiteful
Really great post!

It’s unclear how much human psychology can inform our understanding of AI motivations and relevant interventions but it does seem relevant that spitefulness correlates highly (Moshagen et al., 2018, Table 8, N 1,261) with several other “dark traits”, especially psychopathy (r = .74), sadism (r = .59), and Machiavellianism (r = .59).

(Moshagen et al. (2018) therefore suggest that “[...] dark traits are specific manifestations of a general, basic dispositional behavioral tendency [...] to maximize one’s individual utility— disregarding, accepting, or malevolently provoking disutility for others—, accompanied by beliefs that serve as justifications.”)

Plausibly there are (for instance, evolutionary) reasons for why these traits correlate so strongly with each other, and perhaps better understanding them could inform interventions to reduce spite and other dark traits (cf. Lukas’ comment).

If this is correct, we might suspect that AIs that will exhibit spiteful preferences/behavior will also tend to exhibit other dark traits (and vice versa!), which may be action guiding. (For example, interventions that make AIs less likely to be psychopathic, sadistic, Machiavellian, etc. would also make them less spiteful, at least in expectation.)

David Althaus 16 Feb 2023 15:46 UTC
8 points
4
on: Please don’t throw your mind away
Great post, thanks for writing!

Most of this matches my experience pretty well. I think I had my best ideas during phases (others seem to agree) when I was unusually low on guilt- and obligation-driven EA/impact-focused motivation and was just playfully exploring ideas for fun and out of curiosity.

One problem with letting your research/ideas be guided by impact-focused thinking is that you basically train your mind to immediately ask yourself after entertaining a certain idea for a few seconds “well, is that actually impactful?”. And basically all of the time, the answer is “well, probably not”. This makes you disinclined to further explore the neighboring idea space.

However, even really useful ideas / research angles start out being somewhat unpromising and full of hurdles and problems and need a lot of refinement. If you allow yourself to just explore idea space for fun, you might overcome these problems and stumble on something truly promising. But if you had been in an “obsessing about maximizing impact” mindset you would have given up too soon because, in this mindset, spending hours or even days without having any impact feels too terrible to keep going.

David Althaus 13 Jan 2023 11:03 UTC
2 points
0
in reply to: DanielFilan’s comment on: On Blogging and Podcasting
Lol, thanks. :)

David Althaus 12 Jan 2023 16:58 UTC
2 points
0
on: On Blogging and Podcasting
Thanks for this post, I thought this was useful.
I needed a writing buddy to pick up the momentum to actually write it
I’d be interested in knowing more how this worked in practice (no worries if you don’t feel like elaborating/don’t have the time!).

David Althaus 6 Jan 2023 14:29 UTC
13 points
8
in reply to: habryka’s comment on: Let’s think about slowing down AI
I think mostly I expect us to continue to overestimate the sanity and integrity of most of the world, then get fucked over like we got fucked over by OpenAI or FTX. I think there are ways to relating to the rest of the world that would be much better, but a naive update in the direction of “just trust other people more” would likely make things worse.

[...]
Again, I think the question you are raising is crucial, and I have giant warning flags about a bunch of the things that are going on (the foremost one is that it sure really is a time to reflect on your relation to the world when a very prominent member of your community just stole 8 billion dollars of innocent people’s money and committed the largest fraud since Enron), [...]
I very much agree with the sentiment of the second paragraph.

Regarding the first paragraph, my own take is that (many) EAs and rationalists might be wise to trust themselves and their allies less.^[1]

The main update of the FTX fiasco (and other events I’ll describe later) I’d make is that perhaps many/most EAs and rationalists aren’t very good at character judgment. They probably trust other EAs and rationalists too readily because they are part of the same tribe and automatically assume that agreeing with noble ideas in the abstract translates to noble behavior in practice.

(To clarify, you personally seem to be good at character judgment, so this message is not directed at you. (I base that mostly on your comments I read about the SBF situation, big kudos for that, btw!)

It seems like a non-trivial fraction of people that joined the EA and rationalist community very early turned out to be of questionable character, and this wasn’t noticed for years by large parts of the community. I have in mind people like Anissimov, Helm, Dill, SBF, Geoff Anders, arguably Vassar—these are just the known ones. Most of them were not just part of the movement, they were allowed to occupy highly influential positions. I don’t know what the base rate for such people is in other movements—it’s plausibly even higher—but as a whole our movements don’t seem to be fantastic at spotting sketchy people quickly. (FWIW, my personal experiences with a sketchy, early EA (not on the above list) inspired this post.)

My own takeaway is that perhaps EAs and rationalists aren’t that much better in terms of integrity than the outside world and—given that we probably have to coordinate with some people to get anything done—I’m now more willing to coordinate with “outsiders” than I was, say, eight years ago.
1. ^
  Though I would be hesitant to spread this message; the kinds of people who should trust themselves and their character judgment less are more likely the ones who will not take this message to heart, and vice versa.

David Althaus 19 Sep 2022 10:22 UTC
8 points
0
in reply to: Metaphysicist’s comment on: Many therapy schools work with inner multiplicity (not just IFS)
This is mentioned in the introduction.

I’m biased, of course, but it seems fine to write a post like this. (Similarly, it’s fine for CFAR staff members to write a post about CFAR techniques. In fact, I prefer if precisely these people write such posts because they have the relevant expertise.)

Would you like us to add a more prominent disclaimer somewhere? (We worried that this might look like advertising.)

David Althaus 18 Sep 2022 10:37 UTC
6 points
2
in reply to: Shmi’s comment on: Many therapy schools work with inner multiplicity (not just IFS)
A quick look through https://www.goodtherapy.org/learn-about-therapy/types/compassion-focused-therapy gives an impression of yet another mix of CBT, DBT and ACT, nothing revolutionary or especially new, though maybe I missed something.
In my experience, ~nothing in this area is downright revolutionary. Most therapies are heavily influenced by previous concepts and techniques. (Personally, I’d still say that CFT brings something new to the table.)

I guess what matters if it works for you or not.
Is this assertion borne out by twin studies? Or is believing it a test for CFT suitability only?
To some extent. Most human traits have a genetic component, including (Big-Five) personality traits, depressive tendencies, anxiety disorders, conduct disorders, personality disorders, and so on. (e.g., Polderman et al., 2015). This is also true for (self-)destructive tendencies like malevolent personality traits (citing my own summary of some studies here because I’m lazy, sorry).

(Also agree with Kaj’s warning about misinterpreting heritability.)

More generally speaking, I’d say this belief is borne out of understanding evolutionary psychology/history. Basically, all of our motivations and fears have an evolutionary basis. We fear death, because the ancestors who didn’t were eaten by lions. We fear being ostracized and care about being respected because in the Environment of Evolutionary Adaptedness our survival and reproductive success was dependent on our social status. Therefore, it’s to be expected that most humans, at some point or another, worry about death or health problems or feel emotions like jealousy or envy. They don’t have to be rooted in some trauma or early life experience—though they are usually exacerbated by them. In most cases, it’s not realistic to eliminate such emotions entirely. This doesn’t mean that one is an “abnormal” or “defective” person that experienced irreversible harm inflicted by another human sometime in one’s development. (Just to be clear, as mentioned in the main text, no one believes that life experiences don’t matter. Of course, they matter a great deal!)

But yeah, if you are skeptical of the above, it’s a good reason to not seek a CFT therapist.

David Althaus 18 Sep 2022 9:52 UTC
6 points
0
in reply to: waveman’s comment on: Many therapy schools work with inner multiplicity (not just IFS)
From studying and using all of the above my conclusion is that IFS offers the most tractable approach to this issue of competing ‘parts’. And in many ways the most powerful.
In our experience, different people respond to different therapies. I know several people for whom, say, CFT worked better than IFS. Glad to hear that IFS worked for you!
When you read about modern therapies, they all borrow from one another in a way that did not occur say 50 years ago where there were very entrenched schools of thought.
Yes, that’s definitely the case. My sense is that many people overestimate how revolutionary various therapies are because their founders downplay how many concepts and techniques they took from other modalities. (Though this can be advantageous because the “hype” increases motivation and probably fuels various self-fulfilling prophecies.)

David Althaus 27 May 2022 12:37 UTC
4 points
in reply to: Rafael Harth’s comment on: A guide to Iterated Amplification & Debate
For what it’s worth, I read/skimmed all of the listed IDA explanations and found this post to be the best explanation of IDA and Debate (and how they relate to each other). So thanks a lot for writing this!

David Althaus 16 Dec 2021 13:21 UTC
11 points
on: Book summary: Unlocking the Emotional Brain
Thanks a lot for this post (and the whole sequence), Kaj! I found it very helpful already.

Below a question I first wanted to ask you via PM but others might also benefit from an elaboration on this.

You describe the second step of the erasure sequence as follows (emphasis mine):

>Activating, at the same time, the contradictory belief and having the experience of simultaneously believing in two different things which cannot both be true.

When I try this myself, I feel like I cannot actually experience two things simultaneously. There seems to be at least half a second or so between trying to hold the target schema in consciousness and focusing my attention on disconfirming knowledge or experiences.

(Generally, I’d guess it’s not actually possible to hold two distinct things in consciousness simultaneously, at least that’s what I heard various meditation teachers (and perhaps also neuroscientists) claim; you might have even mentioned this in this sequence yourself, if I remember correctly. Relatedly, I heard the claim that multitasking actually involves rapid cycling of one’s attention between various tasks, even though it feels from the inside like one is doing several things simultaneously.)

So should I try to minimize the duration between holding the target schema and disconfirming knowledge in consciousness (potentially aiming to literally feel as though I experience both things at once) or is it enough to just keep cycling back and forth between the two every few seconds? (If yes, what about, say, 30 seconds?)

One issue I suspect I have is that there is a tradeoff between how vividly I can experience the target schema and how rapidly I’m cycling back to the disconfirming knowledge.

Or maybe I’m doing something wrong here? Admittedly, I haven’t tried this for more than a minute or so before immediately proceeding to spending 5 minutes on formulating this question. :)

David Althaus 27 Apr 2021 10:53 UTC
7 points
on: Malicious non-state actors and AI safety
The post Reducing long-term risks from malevolent actors is somewhat related and might be of interest to you.

David Althaus 10 Nov 2020 11:05 UTC
9 points
on: Tweet markets for impersonal truth tracking?
Cool post! Daniel Kokotajlo and I have been exploring somewhat similar ideas.

In a nutshell, our idea was that a major social media company (such as Twitter) could develop a feature that incentivizes forecasting in two ways. First, the feature would automatically suggest questions of interest to the user, e.g., questions thematically related to the user’s current tweet or currently trending issues. Second, users who make more accurate forecasts than the community will be rewarded with increased visibility.

Our idea is different in two major ways:

I.
First, you suggest to directly bet on Tweets whereas as we envisioned that people would bet/forecast on questions that are related to Tweets.

This seems to have some advantages: There would only be one question related to many thousands of Tweets. Rather than resolving thousands of Tweets, one would only have to resolve one question. Most Tweets are also very imprecise. In contrast, these questions (and their resolution criteria) could be formulated very precisely (partly because one could spend much more time refining them because they are much fewer in number). The drawback is that this might feel less “direct” and “fun” in some ways.

II.
Second, contrary to your idea, we had in mind that the questions would be resolved by employees and not voted on by the public. Our worry is that the public voting would dissolve in easily manipulated popularity contest that might also lead to increased polarization and/or distrust of the whole platform. But it is true that users might not trust employees of Twitter—potentially for good reason!

Maybe one could combine these two ideas. Maybe the resolution of questions could be done by a committee or court that consists of employees and members of the public (and maybe other people that enjoy a high level of trust such as maybe popular judges or scientists?). Members of this committee could even undergo a selection and training process, maybe somewhat similar to the selection and training process of US juries which seem to be widely trusted to make reasonable decisions.

David Althaus 31 Mar 2019 18:12 UTC
2 points
on: Melatonin: Much More Than You Wanted To Know
Regarding how melatonin might cause more vivid dreams. I found the theory put forward here quite plausible:
There are user reports that melatonin causes vivid dreams. Actually, all sleep aids appear to some users to produce more vivid dreams.

What is most likely happening is that the drug modifies the sleep cycle so the person emerges from REM sleep (when dreams are most vivid) to waking quickly – more quickly that when no drug is used. The user subjectively reports the drug as producing vivid dreams.