transformer_lens doesn’t seem to be updated for Llama 3? Was trying to replicate Llama 3 results, would be grateful for any pointers. Thanks
It was added recently and just added to a new release, so pip install transformer_lens should work now/soon (you want v1.16.0 I think), otherwise you can install from the Github repo
pip install transformer_lens
+1 to Neel. We just fixed a release bug and now pip install transformer-lens should install 1.16.0 (worked in a colab for me)
pip install transformer-lens
A good incentive to add Llama 3 to TL ;)
We run our experiments directly using PyTorch hooks on HuggingFace models. The linked demo is implemented using TL for simplicity and clarity.
transformer_lens doesn’t seem to be updated for Llama 3? Was trying to replicate Llama 3 results, would be grateful for any pointers. Thanks
It was added recently and just added to a new release, so
pip install transformer_lensshould work now/soon (you want v1.16.0 I think), otherwise you can install from the Github repo+1 to Neel. We just fixed a release bug and now
pip install transformer-lensshould install 1.16.0 (worked in a colab for me)A good incentive to add Llama 3 to TL ;)
We run our experiments directly using PyTorch hooks on HuggingFace models. The linked demo is implemented using TL for simplicity and clarity.