Sheikh Abdur Raheem Ali comments on Efficient Dictionary Learning with Switch Sparse Autoencoders

Sheikh Abdur Raheem Ali 23 Jul 2024 18:49 UTC
2 points
0
I haven’t read the full post yet, but I’m wondering if it’s possible to train Switch SAEs for ViT?
- Anish Mudide 23 Jul 2024 20:47 UTC
  3 points
  0
  Parent
  Yes, you can train a Switch SAE in any scenario where you can train a standard SAE. @hugofry has a nice blog post on training SAEs for ViT.