Oliver Clive-Griffin

• Oliver Clive-GriffinApr 16, 2025, 10:17 PM

  1 point

  0

  in reply to: Lucius Bushnaq’s comment on: Lu­cius Bush­naq’s Shortform

  Is the central point here that a given input will activate it’s representation in both the size 1000 and size 50 sub-dictionaries, meaning the reconstruction will be 2x too big?

[Repli­ca­tion] Cross­coder-based Stage-Wise Model Diffing

• Oliver Clive-GriffinFeb 26, 2025, 8:57 PM

  1 point

  0

  in reply to: StefanHex’s comment on: Ste­fanHex’s Shortform

  Thanks. Also, in the case of crosscoders, where you have multiple output spaces, do you have any thoughts on the best way to aggregate across these? currently I’m just computing them separately and taking the mean. But I could see imagine it perhaps being better to just concat the spaces and do fvu on that, using l2 norm of the concated vectors.

• Oliver Clive-GriffinFeb 26, 2025, 8:11 PM

  1 point

  0

  in reply to: StefanHex’s comment on: Ste­fanHex’s Shortform

  This was really helpful, thanks! just wanting to clear up my understanding:

  This is the wikipedia entry for FVU:

  

  where:

  

  There’s no mention of norms because (as I understand) $y$ and $\hat{y}$ are assumed to be scalar values so $S{S}_{\text{err}}$ and $S{S}_{\text{tot}}$ are scalar. Do I understand it correctly that you’re treating $\parallel x_n-x_{n,\text{pred}}{\parallel }^2$ as the multi-dimensional equivalent of $S{S}_{\text{err}}$ and $\parallel x_n-\mu {\parallel }^2$ as the multi-dimensional equivalent of $S{S}_{\text{tot}}$? This would make sense as using the squared norms of the differences makes it basis /​ rotation invariant.

• Oliver Clive-GriffinJan 28, 2025, 9:22 PM

  2 points

  0

  on: SAE reg­u­lariza­tion pro­duces more in­ter­pretable models

  produce a new set of SAE features using a different set of training parameters

  By this do you mean training a new SAE on the activations of the “regularized weights”

• Oliver Clive-GriffinMay 16, 2024, 11:19 PM

  1 point

  0

  on: Deep Q-Net­works Explained

  The target network has access to more information than the Q-network does, and thus is a better predictor

  Some additional context for anyone confused by this (as I was): “more information” is not a statement about training data, but instead about which prediction task the target network has to do.

  In other words, the target network has an “easier” prediction task: predicting the return from a state further in the future. I was confused because I thought the suggestion was that the target network has been trained for longer, but it hasn’t, it’s just an old checkpoint of the Q-network.

  The differentiation between the Q- and target-networks here is actually not very important, the key point would hold even if you were using the Q-network instead. That is: predicting $Q(s^{\prime },a^{\prime };{\theta }_i^{-})$ is “easier” than predicting $Q(s,a;{\theta }_i)$ for any network, as the first is in some sense a subset of the second task.