I’m not surprised my submission did badly since it was the easiest thing I could quickly come up with after seeing that I was already late. I wasn’t quite expecting to be unable to come up with anything better though. After looking at other people’s comments I’m particularly disappointed that it never once crossed my mind to try analyzing single-soldier combats. I was explicitly trying to figure out the effect of one soldier of each weapon, and I had a histogram of the number of soldiers per combat from which I could have easily gleaned that there were lots of single-soldier combats to investigate had I thought to do so, but instead I tried to analyze the win rates of (some combination of weapons) vs (some combination of weapons) + (1 more of the weapon I’m trying to investigate) and running into trouble with the fact that that extra soldier is also correlated with an increased alien threat and didn’t know how to tease the two effects apart.
I’m not surprised my submission did badly since it was the easiest thing I could quickly come up with after seeing that I was already late. I wasn’t quite expecting to be unable to come up with anything better though. After looking at other people’s comments I’m particularly disappointed that it never once crossed my mind to try analyzing single-soldier combats. I was explicitly trying to figure out the effect of one soldier of each weapon, and I had a histogram of the number of soldiers per combat from which I could have easily gleaned that there were lots of single-soldier combats to investigate had I thought to do so, but instead I tried to analyze the win rates of (some combination of weapons) vs (some combination of weapons) + (1 more of the weapon I’m trying to investigate) and running into trouble with the fact that that extra soldier is also correlated with an increased alien threat and didn’t know how to tease the two effects apart.