Compute

TagLast edit: Sep 6, 2022, 7:13 PM by Raemon

Compute is a generic term for resources necessary to run software computation. It includes processing power, memory, networking, storage, etc.

How a chip is designed

YMJun 28, 2024, 8:04 AM

65 points

4 comments5 min readLW link

What would a compute monitoring plan look like? [Linkpost]

Orpheus16Mar 26, 2023, 7:33 PM

158 points

10 comments4 min readLW link

(arxiv.org)

Zen and The Art of Semiconductor Manufacturing

RecurrentedDec 9, 2024, 5:19 PM

64 points

2 comments9 min readLW link

(futuring.substack.com)

Will compute bottlenecks prevent a software intelligence explosion?

Tom DavidsonApr 4, 2025, 5:41 PM

67 points

2 comments12 min readLW link

We are headed into an extreme compute overhang

devrandomApr 26, 2024, 9:38 PM

53 points

34 comments2 min readLW link

Scaling of AI training runs will slow down after GPT-5

Maxime RichéApr 26, 2024, 4:05 PM

40 points

5 comments3 min readLW link

Reasons compute may not drive AI capabilities growth

Tristan HDec 19, 2018, 10:13 PM

42 points

10 comments8 min readLW link

Sam Altman’s Chip Ambitions Undercut OpenAI’s Safety Strategy

garrisonFeb 10, 2024, 7:52 PM

198 points

52 comments1 min readLW link

(garrisonlovely.substack.com)

What o3 Becomes by 2028

Vladimir_NesovDec 22, 2024, 12:37 PM

146 points

15 comments5 min readLW link

Estimates of GPU or equivalent resources of large AI players for 2024/5

CharlesDNov 28, 2024, 11:01 PM

54 points

7 comments9 min readLW link

Can a finite physical device be Turing equivalent?

Noosphere89Mar 6, 2025, 3:02 PM

0 points

10 comments2 min readLW link

(lifeiscomputation.com)

Memory bandwidth constraints imply economies of scale in AI inference

Ege ErdilSep 17, 2023, 2:01 PM

79 points

34 comments4 min readLW link

Super-Exponential versus Exponential Growth in Compute Price-Performance

moridinamaelOct 6, 2023, 4:23 PM

37 points

25 comments2 min readLW link

No, human brains are not (much) more efficient than computers

Jesse HooglandSep 6, 2022, 1:53 PM

22 points

21 comments3 min readLW link

(www.jessehoogland.com)

Compute Trends Across Three eras of Machine Learning

Jsevillamol, Pablo Villalobos, lennart, Marius Hobbhahn, Tamay Besiroglu and anson.ho

Feb 16, 2022, 2:18 PM

94 points

13 comments2 min readLW link

Compute Governance: The Role of Commodity Hardware

JanMar 26, 2022, 10:08 AM

14 points

7 comments7 min readLW link

(universalprior.substack.com)

Compute Trends — Comparison to OpenAI’s AI and Compute

lennart, Jsevillamol, Pablo Villalobos, Marius Hobbhahn, Tamay Besiroglu and anson.ho

Mar 12, 2022, 6:09 PM

23 points

3 comments3 min readLW link

Compute Research Questions and Metrics—Transformative AI and Compute [4/4]

lennartNov 28, 2021, 10:49 PM

7 points

0 comments16 min readLW link

Predicting GPU performance

Marius Hobbhahn and Tamay

Dec 14, 2022, 4:27 PM

60 points

26 comments1 min readLW link

(epochai.org)

AI Governance & Strategy: Priorities, talent gaps, & opportunities

Orpheus16Mar 3, 2023, 6:09 PM

56 points

2 comments4 min readLW link

Trading off compute in training and inference (Overview)

Pablo VillalobosJul 31, 2023, 4:03 PM

42 points

2 comments7 min readLW link

(epochai.org)

Avoid the abbreviation “FLOPs” – use “FLOP” or “FLOP/s” instead

Daniel_EthJul 10, 2022, 10:44 AM

70 points

13 comments1 min readLW link

Compute Governance and Conclusions—Transformative AI and Compute [3/4]

lennartOct 14, 2021, 8:23 AM

13 points

0 comments5 min readLW link

Forecasting Compute—Transformative AI and Compute [2/4]

lennartOct 2, 2021, 3:54 PM

17 points

0 comments19 min readLW link

What is Compute? - Transformative AI and Compute [1/4]

lennartSep 23, 2021, 4:25 PM

27 points

9 comments19 min readLW link

Transformative AI and Compute [Summary]

lennartSep 26, 2021, 11:41 AM

14 points

0 comments9 min readLW link

[Question] How do top AI labs vet architecture/algorithm changes?

Jemal YoungMay 8, 2024, 4:47 PM

3 points

5 comments1 min readLW link

Announcing Epoch: A research organization investigating the road to Transformative AI

Jsevillamol, Pablo Villalobos, Tamay, lennart, Marius Hobbhahn and anson.ho

Jun 27, 2022, 1:55 PM

97 points

2 comments2 min readLW link

(epochai.org)

Calculance: A “Core” Ability

milanroskoJun 12, 2024, 7:21 AM

4 points

0 comments1 min readLW link

AI as a computing platform: what to expect

JonasbJun 22, 2024, 7:55 PM

−3 points

0 comments7 min readLW link

(www.denominations.io)

New LLM Scaling Law

wrmedfordFeb 19, 2025, 8:21 PM

2 points

0 comments1 min readLW link

(github.com)

AGI Timelines in Governance: Different Strategies for Different Timeframes

simeon_c and AmberDawn

Dec 19, 2022, 9:31 PM

65 points

28 comments10 min readLW link

The Compute Conundrum: AI Governance in a Shifting Geopolitical Era

octavoSep 28, 2024, 1:05 AM

−3 points

1 comment17 min readLW link

Optimization Markets

StrivingForLegibilityDec 30, 2023, 1:24 AM

13 points

2 comments2 min readLW link

Example of GPU-accelerated scientific computing with PyTorch

TahpJan 1, 2025, 11:01 PM

6 points

0 comments6 min readLW link

(passwordpaper.com)

[Incomplete] What is Computation Anyway?

DragonGodDec 14, 2022, 4:17 PM

16 points

1 comment13 min readLW link

(arxiv.org)

Finite Field Assembly : A CUDA alternative rooted in NumberTheory and Pure Mathematics

murage kibichoJan 12, 2025, 9:36 PM

1 point

0 comments3 min readLW link

Nvidia doesn’t just sell shovels

winstonBosanJan 28, 2025, 4:56 AM

13 points

4 comments2 min readLW link

No comments.

Keyboard shortcuts

Keys shown in yellow (e.g., ]) are accesskeys, and require a browser-specific modifier key (or keys).

Keys shown in grey (e.g., ?) do not require any modifier keys.

General
? Show keyboard shortcuts
Esc Hide keyboard shortcuts

Site navigation
h Go to Home (a.k.a. “Frontpage”) view
f Go to Featured (a.k.a. “Curated”) view
a Go to All (a.k.a. “Community”) view
m Go to Meta view
v Go to Tags view
c Go to Recent Comments view
r Go to Archive view
q Go to Sequences view
t Go to About page
u Go to User or Login page
o Go to Inbox page

Page navigation
, Jump up to top of page
. Jump down to bottom of page
/ Jump to top of comments section
s Search

Page actions
n New post or comment
e Edit current post

Post/comment list views
. Focus next entry in list
, Focus previous entry in list
; Cycle between links in focused entry
Enter Go to currently focused entry
Esc Unfocus currently focused entry
] Go to next page
[ Go to previous page
\ Go to first page
e Edit currently focused post

Editor
k Bold text
i Italic text
l Insert hyperlink
q Blockquote text

Appearance
= Increase text size
- Decrease text size
0 Reset to default text size
′ Cycle through content width settings
1 Switch to default theme [A]
2 Switch to dark theme [B]
3 Switch to grey theme [C]
4 Switch to ultramodern theme [D]
5 Switch to simple theme [E]
6 Switch to brutalist theme [F]
7 Switch to ReadTheSequences theme [G]
8 Switch to classic Less Wrong theme [H]
9 Switch to modern Less Wrong theme [I]
; Open theme tweaker
Enter Save changes and close theme tweaker
Esc Close theme tweaker (without saving)

Slide shows
l Start/resume slideshow
Esc Exit slideshow
→↓ Next slide
←↑ Previous slide
Space Reset slide zoom

Miscellaneous
x Switch to next view on user page
z Switch to previous view on user page
` Toggle compact comment list view
g Toggle anti-kibitzer