Fact Finding: Attempting to Reverse-Engineer Factual Recall on the Neuron Level

Neel Nanda
20 Dec 2023 15:35 UTC

Fact Find­ing: At­tempt­ing to Re­v­erse-Eng­ineer Fac­tual Re­call on the Neu­ron Level (Post 1)

Neel Nanda, Senthooran Rajamanoharan, János Kramár and Rohin Shah
23 Dec 2023 2:44 UTC
108 points
8 comments22 min readLW link

Fact Find­ing: Sim­plify­ing the Cir­cuit (Post 2)

Senthooran Rajamanoharan, Neel Nanda, János Kramár and Rohin Shah
23 Dec 2023 2:45 UTC
25 points
3 comments14 min readLW link

Fact Find­ing: Try­ing to Mechanis­ti­cally Un­der­stand­ing Early MLPs (Post 3)

Neel Nanda, Senthooran Rajamanoharan, János Kramár and Rohin Shah
23 Dec 2023 2:46 UTC
10 points
0 comments16 min readLW link

Fact Find­ing: How to Think About In­ter­pret­ing Me­mori­sa­tion (Post 4)

Senthooran Rajamanoharan, Neel Nanda, János Kramár and Rohin Shah
23 Dec 2023 2:46 UTC
22 points
0 comments9 min readLW link

Fact Find­ing: Do Early Lay­ers Spe­cial­ise in Lo­cal Pro­cess­ing? (Post 5)

Neel Nanda, Senthooran Rajamanoharan, János Kramár and Rohin Shah
23 Dec 2023 2:46 UTC
18 points
0 comments4 min readLW link