KevinRoWang

Some Les­sons Learned from Study­ing Indi­rect Ob­ject Iden­ti­fi­ca­tion in GPT-2 small

Gears-Level Men­tal Models of Trans­former Interpretability

• KevinRoWangMar 27, 2022, 9:43 PM

  2 points

  in reply to: eeegnu’s comment on: Les­sons After a Cou­ple Months of Try­ing to Do ML Research

  Hm, I think this tool would’ve been really helpful for me in the past for a couple of occasions. Usually if I want to save a cell output, I just won’t edit that cell and I’ll create a new one, even if it means redundant code.
  
  Also +1 on keeping track of bugs! I should’ve added to the og post that one thing I do that’s really helpful for me is keeping track of procedural knowledge (i.e. how to setup a GPU, how to fix common issue X, etc.) in a personal Slack that I’ve created as a second brain basically. I found that I used the message-yourself-in-slack feature a lot to keep track of small notes for myself, and since I did it so much, I created a whole private, personal Slack and that’s been pretty useful in keeping track of bugs, etc.

• KevinRoWangMar 27, 2022, 9:36 PM

  1 point

  in reply to: Joe Kwon’s comment on: Les­sons After a Cou­ple Months of Try­ing to Do ML Research

  Let’s definitely catch up!

• KevinRoWangMar 27, 2022, 9:35 PM

  1 point

  in reply to: ViktoriaMalyasova’s comment on: Les­sons After a Cou­ple Months of Try­ing to Do ML Research

  Yes! Especially if you show you have can provide relevant thoughts about their work, a lot of people will be happy to call or at least reply to some questions via email

Les­sons After a Cou­ple Months of Try­ing to Do ML Research