I was assuming no feedback, like the test looks identical to an ordinary math test in every way.
The “no free lunch” theorem also applies in the case where you get feedback, but there it is harder to construct. Basically in such a case the task would need to be anti-inductive, always providing feedback that your prior gets mislead by.
Of course these sorts of situations are kind of silly, which is why the no free lunch theorem is generally considered to be only of academic interest.
I was assuming no feedback, like the test looks identical to an ordinary math test in every way.
The “no free lunch” theorem also applies in the case where you get feedback, but there it is harder to construct. Basically in such a case the task would need to be anti-inductive, always providing feedback that your prior gets mislead by.
Of course these sorts of situations are kind of silly, which is why the no free lunch theorem is generally considered to be only of academic interest.