Andy Arditi comments on Refusal in LLMs is mediated by a single direction

[Andy Arditi]

A good incentive to add Llama 3 to TL ;)

We run our experiments directly using PyTorch hooks on HuggingFace models. The linked demo is implemented using TL for simplicity and clarity.