MiguelDev comments on Activation adding experiments with llama-7b

[MiguelDev]

I like how your posts are similar to what I am doing recently. I find that you are only using the final layer’s output -but have you had the chance to inspect the other layers? let me know if you did and your ideas.