One thing I like to do is regularly assert something I know to be false to keep track of whether the LLM is ready to push back.
Maybe it is helpful to be more specific. When I am uncertain about something, I rarely ask the LLM “Is <most likely answer> true?”. Instead I assert “<Less likely answer> is true.”.
One thing I like to do is regularly assert something I know to be false to keep track of whether the LLM is ready to push back.
Maybe it is helpful to be more specific. When I am uncertain about something, I rarely ask the LLM “Is <most likely answer> true?”. Instead I assert “<Less likely answer> is true.”.