Peter Boos

• Peter BoosDec 22, 2023, 7:20 AM

  1 point

  0

  on: Dis­cus­sion: Challenges with Un­su­per­vised LLM Knowl­edge Discovery

  I think you might apply this to the hot neurons, the neurons who are most used.
  Some recent models allready handle those diffrent for speedup reason.