I think it’s true that the easiest thing to do is legibly improve on currently used metrics. I guess my take is that in academia you want to write a short paper that people can see is valuable, which biases towards “I did thing X and now the number is bigger”. But, for example, if you reframe the alignment problem and show some interesting thing about your reframing, that can work pretty well as a paper (see The Off-Switch Game, Optimal Policies Tend to Seek Power). My guess is that the bigger deal is that there’s some social pressure to publish frequently (in part because that’s a sign that you’ve done something, and a thing that closes a feedback loop).
I think it’s true that the easiest thing to do is legibly improve on currently used metrics. I guess my take is that in academia you want to write a short paper that people can see is valuable, which biases towards “I did thing X and now the number is bigger”. But, for example, if you reframe the alignment problem and show some interesting thing about your reframing, that can work pretty well as a paper (see The Off-Switch Game, Optimal Policies Tend to Seek Power). My guess is that the bigger deal is that there’s some social pressure to publish frequently (in part because that’s a sign that you’ve done something, and a thing that closes a feedback loop).
Maybe a bigger deal is that by the nature of a paper, you can’t get too many inferential steps away from the field.