KhromeM

• KhromeM 22 Jul 2024 22:33 UTC

  1 point

  0

  in reply to: gwern’s comment on: Us­ing an LLM per­plex­ity filter to de­tect weight exfiltration

  My last statement was totally wrong. Thanks for catching that.
  
  In theory its probably even possible to get the approximate weights by expending insane amounts of compute, but you could use those resources much more efficiently.

• KhromeM 22 Jul 2024 0:35 UTC

  2 points

  −5

  on: Us­ing an LLM per­plex­ity filter to de­tect weight exfiltration

  I do not understand how you can extract weights through just conversing with an LLM any more than you can get information on how my neurons are structured by conversing with me. Extracting training data it has seen is one thing, but presumably it has never seen its weights. If the system prompts did not tell it it was an LLM, it should not even be able to figure out that.