Hmm, I think you’re right. I’m not sure what I was thinking when I wrote that. (Though I give it like 50% that if past-me could explain his reasons, I’d agree with him.)
Possibly I was thinking of epochal double descent, but that shouldn’t matter because we’re comparing the final outcome of SGD to random sampling, so epochal double descent doesn’t come into the picture.
Hmm, I think you’re right. I’m not sure what I was thinking when I wrote that. (Though I give it like 50% that if past-me could explain his reasons, I’d agree with him.)
Possibly I was thinking of epochal double descent, but that shouldn’t matter because we’re comparing the final outcome of SGD to random sampling, so epochal double descent doesn’t come into the picture.
OK, thanks!