I haven’t really digged into Gelman’s blog, but the format you mention is a perfect example of the expertise of understanding some research. Very important skill, but not the same as actually conducting the research that goes into a paper.
Research consists of many skills put together. Understanding prior work and developing the taste to judge it is one of the more important individual skills in research (moreso than programming, at least in most fields). So I think the blog example is indeed a central one.
In research, especially in a weird new field like alignment, it’s rare to find another researcher who want to conduct precisely the same research. But that’s the basis of every sport and game: people want to win the same game. It make the whole “learning from other” slightly more difficult IMO. You can’t just look for what works, you constantly have to repurpose ideas that work in slightly different field and/or approaches and check for the loss in translation.
I agree with this, although I think creative new ideas often come from people who have also mastered the “standard” skills. And indeed, most research is precisely about coming up with new ideas, which is a skill that you can cultivate my studying how others generate ideas.
More tangentially, you may be underestimating the amount of innovation in sports. Harden and Jokic both innovate in basketball (among others), but I am pretty sure they also do lots of film study. Jokic’s innovation probably comes from having mastered other sports like water polo and the resulting skill transfer. I would guess that mastery of fruitfully adjacent fields is a productive way to generate ideas.
Research consists of many skills put together. Understanding prior work and developing the taste to judge it is one of the more important individual skills in research (moreso than programming, at least in most fields). So I think the blog example is indeed a central one.
I completely agree that it is a relevant and important skill, but there are many people with good understanding of prior work who are completely unable of producing interesting new research. Non-exhaustively, this includes being able to have new ideas, to develop them, to test them, to get feedback and adapt to the feedback. And given that understanding prior work emerges pretty naturally once you read a lot of papers, I’m personally more interested in training for these other skills. My argument was that blogs don’t really help for that.
I agree with this, although I think creative new ideas often come from people who have also mastered the “standard” skills. And indeed, most research is precisely about coming up with new ideas, which is a skill that you can cultivate my studying how others generate ideas.
Difference of opinion: for me, coming with ideas is incredibly cheap. I also have piles of promising ideas that I will never have the time to explore, and I keep having new ideas. I never needed any help in that, and so I am completely uninterested in any way to generate more ideas. The other skills of research require way more effort to me (not even sure how to disentangle them TBH), so I focus on those. And I have trouble finding any actual standard skills that translate directly between research field: even things like doing experiments have very different meaning and related skills depending on the field.
More tangentially, you may be underestimating the amount of innovation in sports. Harden and Jokic both innovate in basketball (among others), but I am pretty sure they also do lots of film study. Jokic’s innovation probably comes from having mastered other sports like water polo and the resulting skill transfer. I would guess that mastery of fruitfully adjacent fields is a productive way to generate ideas.
Didn’t want to imply that athletes never innovate. And that’s an interesting example of the innovation from adjacent field. That’s definitely how I get a lot of ideas. But that’s still made incredibly more potent by being able to study and master the skills from your actual field. Which is really hard to do when there is no film study analogy for it.
Thanks for the feedback!
Research consists of many skills put together. Understanding prior work and developing the taste to judge it is one of the more important individual skills in research (moreso than programming, at least in most fields). So I think the blog example is indeed a central one.
I agree with this, although I think creative new ideas often come from people who have also mastered the “standard” skills. And indeed, most research is precisely about coming up with new ideas, which is a skill that you can cultivate my studying how others generate ideas.
More tangentially, you may be underestimating the amount of innovation in sports. Harden and Jokic both innovate in basketball (among others), but I am pretty sure they also do lots of film study. Jokic’s innovation probably comes from having mastered other sports like water polo and the resulting skill transfer. I would guess that mastery of fruitfully adjacent fields is a productive way to generate ideas.
Sorry for taking so long to answer!
I completely agree that it is a relevant and important skill, but there are many people with good understanding of prior work who are completely unable of producing interesting new research. Non-exhaustively, this includes being able to have new ideas, to develop them, to test them, to get feedback and adapt to the feedback. And given that understanding prior work emerges pretty naturally once you read a lot of papers, I’m personally more interested in training for these other skills. My argument was that blogs don’t really help for that.
Difference of opinion: for me, coming with ideas is incredibly cheap. I also have piles of promising ideas that I will never have the time to explore, and I keep having new ideas. I never needed any help in that, and so I am completely uninterested in any way to generate more ideas. The other skills of research require way more effort to me (not even sure how to disentangle them TBH), so I focus on those. And I have trouble finding any actual standard skills that translate directly between research field: even things like doing experiments have very different meaning and related skills depending on the field.
Didn’t want to imply that athletes never innovate. And that’s an interesting example of the innovation from adjacent field. That’s definitely how I get a lot of ideas. But that’s still made incredibly more potent by being able to study and master the skills from your actual field. Which is really hard to do when there is no film study analogy for it.