Thomas Kwa

Karma: 5,642

Engineer at METR.

Previously: Vivek Hebbar’s team at MIRI → Adrià Garriga-Alonso on various empirical alignment projects → METR.

I have signed no contracts or agreements whose existence I cannot mention.

Should CA, TX, OK, and LA merge into a giant swing state, just for elections?

Thomas KwaNov 6, 2024, 11:01 PM

115 points

35 comments1 min readLW link

The murderous shortcut: a toy model of instrumental convergence

Thomas KwaOct 2, 2024, 6:48 AM

37 points

0 comments2 min readLW link

Goodhart in RL with KL: Appendix

Thomas KwaMay 18, 2024, 12:40 AM

12 points

0 comments6 min readLW link

Catastrophic Goodhart in RL with KL penalty

Thomas Kwa and Adrià Garriga-alonso

May 15, 2024, 12:58 AM

62 points

10 comments7 min readLW link

[Question] Is a random box of gas predictable after 20 seconds?

Thomas Kwa and habryka

Jan 24, 2024, 11:00 PM

37 points

35 comments1 min readLW link

[Question] Will quantum randomness affect the 2028 election?

Thomas Kwa and habryka

Jan 24, 2024, 10:54 PM

66 points

52 comments1 min readLW link

Thomas Kwa’s research journal

Thomas Kwa and Adrià Garriga-alonso

Nov 23, 2023, 5:11 AM

79 points

1 comment6 min readLW link

Thomas Kwa’s MIRI research experience

Thomas Kwa, peterbarnett, Vivek Hebbar, Jeremy Gillen, Bird Concept and Raemon

Oct 2, 2023, 4:42 PM

172 points

53 comments1 min readLW link

Catastrophic Regressional Goodhart: Appendix

Thomas Kwa and Drake Thomas

May 15, 2023, 12:10 AM

25 points

1 comment9 min readLW link

When is Goodhart catastrophic?

Drake Thomas and Thomas Kwa

May 9, 2023, 3:59 AM

180 points

29 comments8 min readLW link 1 review

Challenge: construct a Gradient Hacker

Thomas Larsen and Thomas Kwa

Mar 9, 2023, 2:38 AM

39 points

10 comments1 min readLW link

Failure modes in a shard theory alignment plan

Thomas KwaSep 27, 2022, 10:34 PM

26 points

2 comments7 min readLW link

Utility functions and probabilities are entangled

Thomas KwaJul 26, 2022, 5:36 AM

15 points

5 comments1 min readLW link

Deriving Conditional Expected Utility from Pareto-Efficient Decisions

Thomas KwaMay 5, 2022, 3:21 AM

24 points

1 comment6 min readLW link

Most problems don’t differ dramatically in tractability (under certain assumptions)

Thomas KwaMay 4, 2022, 12:05 AM

8 points

0 comments3 min readLW link

The case for turning glowfic into Sequences

Thomas KwaApr 27, 2022, 6:58 AM

86 points

29 comments5 min readLW link

[Question] (When) do high-dimensional spaces have linear paths down to local minima?

Thomas KwaApr 22, 2022, 3:35 PM

12 points

7 comments1 min readLW link

How dath ilan coordinates around solving alignment

Thomas KwaApr 13, 2022, 4:22 AM

65 points

46 comments5 min readLW link

5 Tips for Good Hearting

Thomas KwaApr 1, 2022, 7:47 PM

25 points

10 comments1 min readLW link

Can we simulate human evolution to create a somewhat aligned AGI?

Thomas KwaMar 28, 2022, 10:55 PM

21 points

6 comments7 min readLW link

Keyboard shortcuts

Keys shown in yellow (e.g., ]) are accesskeys, and require a browser-specific modifier key (or keys).

Keys shown in grey (e.g., ?) do not require any modifier keys.

General
? Show keyboard shortcuts
Esc Hide keyboard shortcuts

Site navigation
h Go to Home (a.k.a. “Frontpage”) view
f Go to Featured (a.k.a. “Curated”) view
a Go to All (a.k.a. “Community”) view
m Go to Meta view
v Go to Tags view
c Go to Recent Comments view
r Go to Archive view
q Go to Sequences view
t Go to About page
u Go to User or Login page
o Go to Inbox page

Page navigation
, Jump up to top of page
. Jump down to bottom of page
/ Jump to top of comments section
s Search

Page actions
n New post or comment
e Edit current post

Post/comment list views
. Focus next entry in list
, Focus previous entry in list
; Cycle between links in focused entry
Enter Go to currently focused entry
Esc Unfocus currently focused entry
] Go to next page
[ Go to previous page
\ Go to first page
e Edit currently focused post

Editor
k Bold text
i Italic text
l Insert hyperlink
q Blockquote text

Appearance
= Increase text size
- Decrease text size
0 Reset to default text size
′ Cycle through content width settings
1 Switch to default theme [A]
2 Switch to dark theme [B]
3 Switch to grey theme [C]
4 Switch to ultramodern theme [D]
5 Switch to simple theme [E]
6 Switch to brutalist theme [F]
7 Switch to ReadTheSequences theme [G]
8 Switch to classic Less Wrong theme [H]
9 Switch to modern Less Wrong theme [I]
; Open theme tweaker
Enter Save changes and close theme tweaker
Esc Close theme tweaker (without saving)

Slide shows
l Start/resume slideshow
Esc Exit slideshow
→↓ Next slide
←↑ Previous slide
Space Reset slide zoom

Miscellaneous
x Switch to next view on user page
z Switch to previous view on user page
` Toggle compact comment list view
g Toggle anti-kibitzer