This is exciting to see. I think this solution is impressive, and I think the case for the structure you find is compelling. It’s also nice that this solution goes a little further in one aspect than the previous one. The analysis with bars seems to get a little closer to a question I have still had since the last solution:
My one critique of this solution is that I would have liked to see an understanding of why the transformer only seems to make mistakes near the parts of the domain where there are curved boundaries between regimes (see fig above with the colored curves). Meanwhile, the network did a great job of learning the periodic part of the solution that led to irregularly-spaced horizontal bars. Understanding why this is the case seems interesting but remains unsolved.
I think this work gives a bit more of a granular idea of what might be happening. And I think it’s an interesting foil to the other one. Both came up with some fairly different pictures for the same process. The differences between these two projects seem like an interesting case study in MI. I’ll probably refer to this a lot in the future.
Overall, I think this is great, and although the challenge is over, I’m adding this to the github readme. And If you let me know a high-impact charity you’d like to support, I’ll send $500 to it as a similar prize for the challenge :)
The differences between these two projects seem like an interesting case study in MI. I’ll probably refer to this a lot in the future.
Excited to see case studies comparing and contrasting our works. Not that you need my permission, but feel free to refer to this post (and if it’s interesting, this comment) as much or as little as desired.
One thing that I don’t think came out in my post is that my initial reaction to the previous solution was that it was missing some things and might even have been mostly wrong. (I’m still not certain that it’s not at least partially wrong, but this is harder to defend and I suspect might be a minority opinion).
Contrast this to your first interp challenge—I had a hypothesis of “slightly slant-y (top left to bottom right)” images for one of the classes. After reading the first paragraph of the tl;dr of their written solution to the first challenge - I was extremely confident they were correct.
This is exciting to see. I think this solution is impressive, and I think the case for the structure you find is compelling. It’s also nice that this solution goes a little further in one aspect than the previous one. The analysis with bars seems to get a little closer to a question I have still had since the last solution:
I think this work gives a bit more of a granular idea of what might be happening. And I think it’s an interesting foil to the other one. Both came up with some fairly different pictures for the same process. The differences between these two projects seem like an interesting case study in MI. I’ll probably refer to this a lot in the future.
Overall, I think this is great, and although the challenge is over, I’m adding this to the github readme. And If you let me know a high-impact charity you’d like to support, I’ll send $500 to it as a similar prize for the challenge :)
Excited to see case studies comparing and contrasting our works. Not that you need my permission, but feel free to refer to this post (and if it’s interesting, this comment) as much or as little as desired.
One thing that I don’t think came out in my post is that my initial reaction to the previous solution was that it was missing some things and might even have been mostly wrong. (I’m still not certain that it’s not at least partially wrong, but this is harder to defend and I suspect might be a minority opinion).
Contrast this to your first interp challenge—I had a hypothesis of “slightly slant-y (top left to bottom right)” images for one of the classes. After reading the first paragraph of the tl;dr of their written solution to the first challenge - I was extremely confident they were correct.
Thank you for the kind words and the offer to donate (not necessary but very much appreciated). Please donate to https://strongminds.org/ which is listed on Charity Navigator’s list of high impact charities ( https://www.charitynavigator.org/discover-charities/best-charities/effective-altruism/ )
I will respond to the technical parts of this comment tomorrow or Tuesday.