Se­cu­rity Mind­set: Les­sons from 20+ years of Soft­ware Se­cu­rity Failures Rele­vant to AGI Alignment

elspoodJun 21, 2022, 11:55 PM
362 points
42 comments7 min readLW link1 review

A Quick List of Some Prob­lems in AI Align­ment As A Field

Nicholas / Heather KrossJun 21, 2022, 11:23 PM
75 points
12 comments6 min readLW link
(www.thinkingmuchbetter.com)

[Question] What is the differ­ence be­tween AI mis­al­ign­ment and bad pro­gram­ming?

puzzleGuzzleJun 21, 2022, 9:52 PM
6 points
2 comments1 min readLW link

What I mean by the phrase “get­ting in­ti­mate with re­al­ity”

LuiseJun 21, 2022, 7:42 PM
6 points
0 comments2 min readLW link
(forum.effectivealtruism.org)

What I mean by the phrase “tak­ing ideas se­ri­ously”

LuiseJun 21, 2022, 7:42 PM
5 points
2 comments1 min readLW link
(forum.effectivealtruism.org)

Hy­dropho­bic Glasses Coat­ing Review

jefftkJun 21, 2022, 6:00 PM
16 points
6 comments1 min readLW link
(www.jefftk.com)

Progress links and tweets, 2022-06-20

jasoncrawfordJun 21, 2022, 5:12 PM
12 points
2 comments1 min readLW link
(rootsofprogress.org)

De­bat­ing Whether AI is Con­scious Is A Dis­trac­tion from Real Problems

sidhe_theyJun 21, 2022, 4:56 PM
2 points
10 comments1 min readLW link
(techpolicy.press)

Miti­gat­ing the dam­age from un­al­igned ASI by co­op­er­at­ing with aliens that don’t ex­ist yet

MSRayneJun 21, 2022, 4:12 PM
−8 points
7 comments6 min readLW link

The in­or­di­nately slow spread of good AGI con­ver­sa­tions in ML

Rob BensingerJun 21, 2022, 4:09 PM
173 points
62 comments8 min readLW link

Get­ting from an un­al­igned AGI to an al­igned AGI?

Tor Økland BarstadJun 21, 2022, 12:36 PM
13 points
7 comments9 min readLW link

Com­mon but ne­glected risk fac­tors that may let you get Paxlovid

DirectedEvolutionJun 21, 2022, 7:34 AM
29 points
8 comments4 min readLW link

Dag­ger of De­tect Evil

lsusrJun 21, 2022, 6:23 AM
45 points
22 comments3 min readLW link

[Question] How easy/​fast is it for a AGI to hack com­put­ers/​a hu­man brain?

Noosphere89Jun 21, 2022, 12:34 AM
0 points
1 comment1 min readLW link

[Question] What is the most prob­a­ble AI?

Zeruel017Jun 20, 2022, 11:26 PM
−2 points
0 comments3 min readLW link

Eval­u­at­ing a Corsi-Rosen­thal Filter Cube

jefftkJun 20, 2022, 7:40 PM
13 points
4 comments1 min readLW link
(www.jefftk.com)

Sur­vey re AIS/​LTism office in NYC

RyanCareyJun 20, 2022, 7:21 PM
7 points
0 comments1 min readLW link

Is This Thing Sen­tient, Y/​N?

Thane RuthenisJun 20, 2022, 6:37 PM
4 points
10 comments7 min readLW link

Steam

abramdemskiJun 20, 2022, 5:38 PM
149 points
13 comments5 min readLW link1 review

Parable: The Bomb that doesn’t Explode

Lone PineJun 20, 2022, 4:41 PM
14 points
5 comments2 min readLW link

On cor­rigi­bil­ity and its basin

Donald HobsonJun 20, 2022, 4:33 PM
16 points
3 comments2 min readLW link

An­nounc­ing the DWATV Discord

ZviJun 20, 2022, 3:50 PM
20 points
9 comments1 min readLW link
(thezvi.wordpress.com)

Key Papers in Lan­guage Model Safety

aogJun 20, 2022, 3:00 PM
40 points
1 comment22 min readLW link

Re­la­tion­ship Ad­vice Repository

RubyJun 20, 2022, 2:39 PM
109 points
36 comments38 min readLW link

Adap­ta­tion Ex­ecu­tors and the Telos Margin

PlinthistJun 20, 2022, 1:06 PM
2 points
8 comments5 min readLW link

Are we there yet?

theflowerpotJun 20, 2022, 11:19 AM
2 points
2 comments1 min readLW link

Causal con­fu­sion as an ar­gu­ment against the scal­ing hypothesis

Jun 20, 2022, 10:54 AM
86 points
30 comments15 min readLW link

An AI defense-offense sym­me­try thesis

Chris van MerwijkJun 20, 2022, 10:01 AM
10 points
9 comments3 min readLW link

Let’s See You Write That Cor­rigi­bil­ity Tag

Eliezer YudkowskyJun 19, 2022, 9:11 PM
125 points
70 comments1 min readLW link

Half-baked al­ign­ment idea: train­ing to generalize

Aaron BergmanJun 19, 2022, 8:16 PM
10 points
2 comments4 min readLW link

Where I agree and dis­agree with Eliezer

paulfchristianoJun 19, 2022, 7:15 PM
900 points
223 comments18 min readLW link2 reviews

[Question] AI mis­al­ign­ment risk from GPT-like sys­tems?

fiso64Jun 19, 2022, 5:35 PM
10 points
8 comments1 min readLW link

[Link-post] On Defer­ence and Yud­kowsky’s AI Risk Estimates

bmgJun 19, 2022, 5:25 PM
29 points
8 comments1 min readLW link

Heb­bian Learn­ing Is More Com­mon Than You Think

Aleksi LiimatainenJun 19, 2022, 3:57 PM
8 points
2 comments1 min readLW link

The Malthu­sian Trap: An Ex­tremely Short Introduction

Davis KedroskyJun 19, 2022, 3:25 PM
5 points
0 comments6 min readLW link
(daviskedrosky.substack.com)

Par­li­a­ments with­out the Parties

Yair HalberstadtJun 19, 2022, 2:06 PM
18 points
18 comments2 min readLW link

Lamda is not an LLM

KevinJun 19, 2022, 11:13 AM
7 points
10 comments1 min readLW link
(www.wired.com)

Get­ting stuck in lo­cal minima

louis030195Jun 19, 2022, 8:50 AM
3 points
1 comment1 min readLW link
(brain.louis030195.com)

[Linkpost] The im­por­tance of stu­pidity in sci­en­tific research

PatternJun 19, 2022, 5:17 AM
17 points
1 comment1 min readLW link
(journals.biologists.com)

ETH is prob­a­bly un­der­val­ued right now

mukashiJun 19, 2022, 2:20 AM
−7 points
22 comments1 min readLW link

Juneberry Cake

jefftkJun 19, 2022, 1:40 AM
29 points
0 comments1 min readLW link
(www.jefftk.com)

Agent level parallelism

Johannes C. MayerJun 18, 2022, 8:56 PM
5 points
5 comments1 min readLW link

What are our outs to play to?

HastingsJun 18, 2022, 7:32 PM
7 points
0 comments2 min readLW link

[Question] What’s the in­for­ma­tion value of gov­ern­ment hear­ings?

KennyJun 18, 2022, 5:13 PM
6 points
4 comments2 min readLW link

The best ‘free solo’ (rock climb­ing) video

KennyJun 18, 2022, 3:29 PM
14 points
4 comments2 min readLW link

[Question] What’s the name of this fal­lacy/​rea­son­ing an­tipat­tern?

David GrossJun 18, 2022, 2:04 PM
9 points
6 comments1 min readLW link

“Brain en­thu­si­asts” in AI Safety

Jun 18, 2022, 9:59 AM
63 points
5 comments10 min readLW link
(universalprior.substack.com)

To what ex­tent have ideas and sci­en­tific dis­cov­er­ies got­ten harder to find?

lsusrJun 18, 2022, 7:15 AM
33 points
10 comments6 min readLW link

[Question] What’s the goal in life?

Konstantin WeitzJun 18, 2022, 6:09 AM
5 points
6 comments1 min readLW link

Can DALL-E un­der­stand sim­ple ge­om­e­try?

Isaac KingJun 18, 2022, 4:37 AM
25 points
2 comments1 min readLW link