note that the Brier score at the bottom is a few percentage points lower than what’s shown in the chart; the probability distributions GPT outputs differ a bit between runs despite a temperature of 0
It’s now possible to get mostly deterministic outputs if you set the seed parameter to an integer of your choice, the other parameters are identical, and the model hasn’t been updated.
seed
Oh thanks, I’d missed that somehow & thought that only the temp mattered for that.
It’s now possible to get mostly deterministic outputs if you set the
seedparameter to an integer of your choice, the other parameters are identical, and the model hasn’t been updated.Oh thanks, I’d missed that somehow & thought that only the temp mattered for that.