RSS

Liam Carroll

Karma: 507

Mathematician, musician, hiking guide. Researcher residing in Australia jointly funded by Timaeus and the Gradient Institute. I am focused on understanding the generalisation properties of models based on Singular Learning Theory and Developmental Interpretability and relating this to alignment.

Website: https://​​www.liamcarroll.au/​​

Aus­tralian AI Safety Fo­rum 2024

Sep 27, 2024, 12:40 AM
42 points
0 comments2 min readLW link

Stage­wise Devel­op­ment in Neu­ral Networks

Mar 20, 2024, 7:54 PM
96 points
1 comment11 min readLW link

Growth and Form in a Toy Model of Superposition

Nov 8, 2023, 11:08 AM
89 points
7 comments14 min readLW link

DSLT 4. Phase Tran­si­tions in Neu­ral Networks

Liam CarrollJun 24, 2023, 5:22 PM
30 points
3 comments16 min readLW link

DSLT 3. Neu­ral Net­works are Singular

Liam CarrollJun 20, 2023, 8:20 AM
29 points
5 comments19 min readLW link

DSLT 2. Why Neu­ral Net­works obey Oc­cam’s Razor

Liam CarrollJun 18, 2023, 12:23 AM
24 points
14 comments17 min readLW link

DSLT 0. Distill­ing Sin­gu­lar Learn­ing Theory

Liam CarrollJun 16, 2023, 9:50 AM
80 points
7 comments5 min readLW link

DSLT 1. The RLCT Mea­sures the Effec­tive Di­men­sion of Neu­ral Networks

Liam CarrollJun 16, 2023, 9:50 AM
54 points
10 comments13 min readLW link