amirrahnama comments on Decoding intermediate activations in llama-2-7b

[amirrahnama]

Thanks, Nina, for sharing the forward pass of Hugging face. I now realize I was skipping the input layer norm calculations. Now, I can reproduce your numbers :)