Don—the “sleight of hand”, as you put it is that (as I think has been said before) we’re examining worst-case. We explicitly are allowing the string of 1s and 0s to be picked by an adversarial superintelligence who knows our strategy. Scott’s algorithm only needs to sample 4 bits on average to answer the question even when the universe it out to get him—the deterministic version will need to sample exactly n/4+1.
Basically, Eliezer seems to be claiming that BPP = P (or possibly something stronger), which most people think is probably true, but, as has been said, no-one can prove. I for one accept his intuitive arguments as, I think, do most people who’ve thought about it, but proving this intuition rigorously is a major outstanding problem in computational complexity.
My supervior’s intuitive argument for why you can never get anything from randomness is that in any particular case where randomness appears to help you can just pick a pseudo-random source which is “random enough” (presumably a formalisation of this intuition is what Scott’s talking about when he says that BPP = P if “realy good pseudorandom generators exist”).
Don, if n is big enough then sure, I’m more than willing to play your game (assuming I get something out of it if I win).
My randomised algorithm will get the right answer within 4 tries in expectation. If I’m allowed to sample a thousand bits then the probability that it won’t have found the answer by then is .75^1000 which I think is something like 10^-120. And this applies even if you’re allowed to choose the string after looking at my algorithm.
If you play the game this way with your deterministic algorithm you will always need to sample n/4 + 1 bits—I can put the ones where you’ll never find them. If you don’t like this game, fine don’t do computational complexity, but there’s nothing wrong with Scott’s argument.
Yes, we assume that you can’t predict what random bits I will generate before I generate them, but that’s pretty much what random means, so I don’t see why it’s such a big deal.