Fact Finding: Attempting to Reverse-Engineer Factual Recall on the Neuron Level

Neel Nanda
Dec 20, 2023, 3:35 PM

Fact Find­ing: At­tempt­ing to Re­v­erse-Eng­ineer Fac­tual Re­call on the Neu­ron Level (Post 1)

Neel Nanda, Senthooran Rajamanoharan, János Kramár and Rohin Shah
Dec 23, 2023, 2:44 AM
106 points
10 comments22 min readLW link2 reviews

Fact Find­ing: Sim­plify­ing the Cir­cuit (Post 2)

Senthooran Rajamanoharan, Neel Nanda, János Kramár and Rohin Shah
Dec 23, 2023, 2:45 AM
25 points
3 comments14 min readLW link

Fact Find­ing: Try­ing to Mechanis­ti­cally Un­der­stand­ing Early MLPs (Post 3)

Neel Nanda, Senthooran Rajamanoharan, János Kramár and Rohin Shah
Dec 23, 2023, 2:46 AM
10 points
1 comment16 min readLW link

Fact Find­ing: How to Think About In­ter­pret­ing Me­mori­sa­tion (Post 4)

Senthooran Rajamanoharan, Neel Nanda, János Kramár and Rohin Shah
Dec 23, 2023, 2:46 AM
22 points
0 comments9 min readLW link

Fact Find­ing: Do Early Lay­ers Spe­cial­ise in Lo­cal Pro­cess­ing? (Post 5)

Neel Nanda, Senthooran Rajamanoharan, János Kramár and Rohin Shah
Dec 23, 2023, 2:46 AM
18 points
0 comments4 min readLW link