How did you solve the data leakage issue? It seems quite gnarly, though not impossible, so am curious what you did.
I believe the approach is to forecast questions that resolve in the future and allow arbitrary internet access. I’m not totally sure though.
Ah, sure, I guess forecasting things in the future is of course a way to “solve the data leakage issues”, but that sure feels like a weird way of phrasing that. Like, there isn’t really a data leakage issue for future predictions.
Maybe “sidestep the data leakage issue” then. The series was designed with these issues in mind. (I work at Metaculus.)
Yeah, I mean, I think it’s fine and am glad about this work, I just definitely misunderstood (but it’s all a very harmless misunderstanding).
How did you solve the data leakage issue? It seems quite gnarly, though not impossible, so am curious what you did.
I believe the approach is to forecast questions that resolve in the future and allow arbitrary internet access. I’m not totally sure though.
Ah, sure, I guess forecasting things in the future is of course a way to “solve the data leakage issues”, but that sure feels like a weird way of phrasing that. Like, there isn’t really a data leakage issue for future predictions.
Maybe “sidestep the data leakage issue” then. The series was designed with these issues in mind. (I work at Metaculus.)
Yeah, I mean, I think it’s fine and am glad about this work, I just definitely misunderstood (but it’s all a very harmless misunderstanding).