What CCS does conceptually is finds a direction in latent space that distinguishes between true and false statements. That doesn’t have to be truth (restricted to stored model knowledge, etc.), and the paper doesn’t really test for false positives so it’s hard to know how robust the method is. In particular I want to know that the probe doesn’t respond to statements that aren’t truth-apt. It seems worth brainstorming on properties that true/false statements could mostly share that are not actually truth. A couple examples come to mind.
common opinions. “Chocolate is tasty/gross” doesn’t quite make sense without a subject, but may be treated like a fact.
Likelihood of completion. In normal dialogue correct answers are more likely to come up than wrong ones, so the task is partly solvable on those grounds alone. The CCS direction should be insensitive to alternate completions of “Take me out to the ball ___” and similar things that are easy to complete by recognition.
The last one seems more pressing, since it’s a property that isn’t “truthy” at all, but I’m struggling to come up with more examples like it.
What CCS does conceptually is finds a direction in latent space that distinguishes between true and false statements. That doesn’t have to be truth (restricted to stored model knowledge, etc.), and the paper doesn’t really test for false positives so it’s hard to know how robust the method is. In particular I want to know that the probe doesn’t respond to statements that aren’t truth-apt. It seems worth brainstorming on properties that true/false statements could mostly share that are not actually truth. A couple examples come to mind.
common opinions. “Chocolate is tasty/gross” doesn’t quite make sense without a subject, but may be treated like a fact.
Likelihood of completion. In normal dialogue correct answers are more likely to come up than wrong ones, so the task is partly solvable on those grounds alone. The CCS direction should be insensitive to alternate completions of “Take me out to the ball ___” and similar things that are easy to complete by recognition.
The last one seems more pressing, since it’s a property that isn’t “truthy” at all, but I’m struggling to come up with more examples like it.