RSS

Dark Arts

TagLast edit: Nov 24, 2021, 10:12 PM by Gordon Seidoh Worley

Dark Arts is a colloquial term for techniques or methods which involve deception and/​or manipulation of others or oneself into believing things for non-truth-seeking reasons. These techniques may prey on human cognitive biases.

Some use the term to refer more narrowly to techniques that work equally well to compel both true and false beliefs, i.e., they are symmetric weapons. Some focus more on the Dark Arts as applied to oneself (self-deception) vs applied to manipulating others.

An example from the Dark Arts of Rationality:

Today, we’re going to talk about Dark rationalist techniques: productivity tools which seem incoherent, mad, and downright irrational. These techniques include:

  1. Willful Inconsistency

  2. Intentional Compartmentalization

  3. Modifying Terminal Goals

Art vs. Technology

Sometimes these arts are further augmented by the use of persuasion technology, such as broadcast advertising or PowerPoint slides. Persuasion technology may prevent the person who is being targeted from carefully deliberating on the intended message, or thinking up an effective response to it in real time.

Such effects can be caused by something as benign as the use of a specialist vocabulary which the target is unfamiliar with, or an institutional vocabulary with high-status connotations: this is one reason why many specialist professions employ ethical codes to regulate their unbalanced power relationship with customers.

The use of such techniques as whiteboards or PowerPoint slides brings additional concerns, since these tend to connote a single party as the one “in charge” of the presentation: this makes it even more difficult for the intended audience to raise any effective objection, and encourages them to focus their attention on the content of the whiteboard or slides. Said content is often presented as a list of abrupt “bullet points”, further connoting it as factual, objective and neutral. One outspoken critic of PowerPoint, management professor David R. Beatty, states: “It is like a disease. It’s the AIDS of management.” Beatty further states that Powerpoint “removes subtlety and thinking”.

Many futurists expect that a technological singularity of even a very mild character will lead to an explosion in the use of radically effective persuasive technology, or “cognotechnology”—a term coined by American military researchers at the Lawrence Livermore Laboratories. The collection and distribution of information about people may spiral out beyond any feasible control, perhaps even comprising their inner thought processes; cognitive monitoring may range from non-intrusive body monitoring as seen in a polygraph to outright brain emulation. In this scenario, persuasion technology may easily blend over into outright mind control. This is clearly a rather paranoiac and dystopian scenario; nevertheless, the fact that it is being seriously discussed has persuasive potential in itself, such as for directing funding for research into guaranteed Friendly AI, as opposed to naïvely pursuing expanded funding for neuroscience or artificial intelligence.

Notable Posts

Other Links

See Also

Dark Arts of Rationality

So8resJan 19, 2014, 2:47 AM
261 points
193 comments18 min readLW link

The Dark Arts

Dec 19, 2023, 4:41 AM
133 points
49 comments9 min readLW link

Law of No Evidence

ZviDec 20, 2021, 1:50 PM
122 points
20 comments4 min readLW link1 review
(thezvi.wordpress.com)

Dark Side Epistemology

Eliezer YudkowskyOct 17, 2008, 11:55 PM
123 points
155 comments5 min readLW link

A few mis­con­cep­tions sur­round­ing Roko’s basilisk

Rob BensingerOct 5, 2015, 9:23 PM
91 points
135 comments5 min readLW link

Say­ing no to the Appleman

Johannes C. MayerApr 29, 2022, 10:39 AM
47 points
12 comments3 min readLW link

Game The­ory As A Dark Art

Scott AlexanderJul 24, 2012, 3:27 AM
169 points
108 comments13 min readLW link

Defense Against The Dark Arts: An Introduction

LyrongolemDec 25, 2023, 6:36 AM
24 points
36 comments20 min readLW link

The Dark Arts—Preamble

AuriniOct 11, 2010, 2:01 PM
65 points
140 comments6 min readLW link

The Dark Arts: A Begin­ner’s Guide

faul_snameJan 21, 2012, 7:05 AM
62 points
43 comments4 min readLW link

How the­ism works

Paul CrowleyApr 10, 2009, 4:16 PM
59 points
39 comments1 min readLW link

Set­ting the Zero Point

Duncan Sabien (Deactivated)Dec 9, 2022, 6:06 AM
91 points
43 comments20 min readLW link1 review

How to Bounded Distrust

ZviJan 9, 2023, 1:10 PM
120 points
17 comments4 min readLW link1 review
(thezvi.wordpress.com)

Par­a­sitic Lan­guage Games: main­tain­ing am­bi­guity to hide con­flict while burn­ing the commons

HazardMar 12, 2023, 5:25 AM
115 points
17 comments13 min readLW link

Defense Against The Dark Arts: Case Study #1

Scott AlexanderMar 28, 2009, 2:31 AM
148 points
54 comments6 min readLW link

[Question] Us­ing false but in­stru­men­tally ra­tio­nal be­liefs for your ca­reer?

Tim LiptrotNov 23, 2020, 7:18 PM
7 points
29 comments1 min readLW link

Dark Arts 101: Us­ing presuppositions

PhilGoetzDec 27, 2010, 5:16 PM
102 points
87 comments1 min readLW link

[Question] Has there been any work done on the ethics of chang­ing peo­ple’s minds?

mcorvinFeb 3, 2021, 1:03 AM
1 point
1 comment1 min readLW link

Two Dark Side Statis­tics Papers

Scott AlexanderJan 2, 2014, 5:51 AM
41 points
4 comments7 min readLW link

Ex­cerpts from Veyne’s “Did the Greeks Believe in Their Myths?”

Rob BensingerNov 8, 2021, 8:23 PM
24 points
1 comment16 min readLW link

At­ten­tion! Fi­nan­cial scam tar­get­ing Less Wrong users

Viliam_BurMay 14, 2016, 5:38 PM
38 points
92 comments2 min readLW link

Speak­ing off-meta

EpiritoJun 5, 2023, 1:56 PM
4 points
0 comments1 min readLW link

Func­tional silence: com­mu­ni­ca­tion that min­i­mizes change of re­ceiver’s beliefs

chaosmageFeb 12, 2019, 9:32 PM
27 points
5 comments2 min readLW link

ChatGPT ? Forbes Billion­heir No­bil­ity Rank

Michael JohnAug 8, 2023, 11:45 AM
1 point
0 comments1 min readLW link

Ha­bit­ual Productivity

So8resJan 9, 2014, 6:44 AM
90 points
36 comments6 min readLW link

Great Product. Lousy Mar­ket­ing.

BenAlbahariFeb 28, 2010, 9:33 AM
18 points
71 comments2 min readLW link

Dis­tract­ing wolves and real es­tate agents

PhilGoetzJul 7, 2011, 1:49 PM
34 points
32 comments3 min readLW link

Re­quests to the Right Ear Are More Suc­cess­ful Than to the Left

CannibalSmithJun 25, 2009, 12:09 PM
4 points
2 comments1 min readLW link

Har­ness­ing Your Biases

swestrupJul 2, 2009, 8:45 PM
13 points
14 comments3 min readLW link

The Bunny: An EA Short Story

JohnGreerAug 21, 2022, 8:59 PM
15 points
0 comments6 min readLW link

Dark Art: Inception

Abu IbrahimDec 31, 2023, 9:09 PM
11 points
0 comments3 min readLW link

Chap­ter 1 of How to Win Friends and In­fluence People

gullJan 28, 2024, 12:32 AM
51 points
5 comments17 min readLW link
(www.google.com)

Win Friends and In­fluence Peo­ple Ch. 2: The Bombshell

gullJan 28, 2024, 9:40 PM
37 points
13 comments17 min readLW link
(www.google.com)

[Question] hyp­no­sis question

KvmanThinkingFeb 6, 2025, 2:41 AM
3 points
5 comments1 min readLW link

Is Rhetoric Worth Learn­ing?

sarahconstantinApr 6, 2018, 10:03 PM
66 points
56 comments2 min readLW link

The Art of the Ar­tifi­cial: In­sights from ‘Ar­tifi­cial In­tel­li­gence: A Modern Ap­proach’

TurnTroutMar 25, 2018, 6:55 AM
31 points
8 comments15 min readLW link

Re­quire con­tri­bu­tions in advance

ViliamFeb 8, 2016, 12:55 PM
96 points
27 comments7 min readLW link

Poli­ti­cal Skills which In­crease Income

XodarapMar 2, 2014, 5:56 PM
103 points
19 comments4 min readLW link

What I Tell You Three Times Is True

Scott AlexanderMay 2, 2009, 11:47 PM
60 points
32 comments4 min readLW link

Blue- and Yel­low-Tinted Choices

Scott AlexanderMay 13, 2010, 10:35 PM
75 points
57 comments4 min readLW link

Evalua­bil­ity (And Cheap Holi­day Shop­ping)

Eliezer YudkowskyNov 28, 2007, 12:37 AM
87 points
63 comments4 min readLW link

Rhetoric for the Good

lukeprogOct 26, 2011, 6:52 PM
85 points
292 comments4 min readLW link

Scarcity

Eliezer YudkowskyMar 27, 2008, 8:07 AM
87 points
20 comments3 min readLW link

Know­ing I’m Be­ing Tricked is Barely Enough

ElizabethFeb 26, 2019, 5:50 PM
37 points
10 comments2 min readLW link
(acesounderglass.com)

Be­ware Triv­ial Inconveniences

Scott AlexanderMay 6, 2009, 10:04 PM
283 points
107 comments4 min readLW link

Striv­ing to Accept

Eliezer YudkowskyMar 9, 2009, 11:29 PM
48 points
38 comments4 min readLW link