Biomedical research, superstars, and innovation
As part of my work for Cognito Mentoring reviewing biomedical research as a career option (not much at the link there right now), I came across an interview with biomedical researcher John Todd of Cambridge University published by 80,000 Hours.
The whole interview is interesting, but one part of it struck me as interesting and somewhat hard to believe:
John would prefer a good person in his lab to an extra £0.5mn in annual funding. Generally, there are enough grants, so finding good people is a bigger constraint than money.
Here’s the full context:
Our candidate does data analysis in finance, earning over $100,000 per year. They have an Economics degree for Chicago, and an Masters in Financial Engineering from University of California, LA, and reasonable programming skills. They’re planning to do an MD then PhD.
“This guy looks great. I’d love to hire him.” (when he has his MD, or even before).
“The MD and programming/statistics combo is lethal. Top of the world. There’s major demand.”
He probably wouldn’t need to do a PhD, because of the programming. After his MD, he could just apply to a lab. He should go into genomic medicine, which is what I do. Tailored therapeutics or stratified medicine will be played out for major health and economic benefits over the next 30 years. Check out Atul Butte at Stanford. He’s the perfect profile for this guy. He could be the new Butte”
£0.5mn is about USD 830,000 according to current foreign exchange rates. In other words, John Todd, the interviewee, indicated that a sufficiently good researcher was worth that much. Now, the question was framed in terms of additional funding, rather than reallocation of existing funds. But assuming that the existing funding for the biomedical research lab is at least one order of magnitude greater than the amount (£0.5mn) under discussion, I don’t think it matters whether we’re talking of using additional funding or reallocating existing funds. Essentially, I read John Todd as saying that he’d be willing to pay £0.5mn to attract a “good person” to his lab (actually, as framed, it could be interpreted as even more: he’s willing to pay an ordinary salary for the person, plus forgo £0.5mn in additional funds, to hire the person). Note: I clarified with Ben Todd, the interviewer, that the additional grants were per-year rather than one-time grants, so the relevant comparison is indeed between the grant amount and annual income.
I haven’t surveyed the biomedical research community, so I’m not sure how representative John Todd’s opinion here is. Andrew McMichael offers a more guarded response, suggesting that 200,000 pounds are not as good as a great researcher, but he’s less sure at half a million pounds, and in any case, good researchers bring in their own grant money, so it’s a false dichotomy. But I’ve heard that there are other people at biomedical research labs who place even higher value on hiring good people than John Todd does. So in the absence of more detailed information, I’ll take John Todd’s view as a representative median view of a segment of biomedical research labs.
So, question: why don’t there exist high-paid positions of that sort in biomedical research for entry-level people? For comparison, one list of the top ten professors in the US lists the tenth highest paid professor as earning slightly under US$500,000. The list is probably far from complete (Douglas Knight points in the comments to Chicago having at least 5 salaries over $700K, one in the business school and four in the medical school). Glassdoor list salaries at the J. Craig Venter Institute, and the highest listed salary is for professors (about $200,000), with all other salaries near or below $100,000.
I asked a slightly more general version of the question in this blog post. I’ll briefly list below the general explanations provided there, with some comments on the applicability of those to the context of biomedical research as I understand it.
Talent constraint because of cash constraint: I don’t think this applies to biomedical research. It’s not that I think they are adequately funded, but rather, they do have enough funds that there shouldn’t be a great different between how they would use additional funds and how they would reallocate existing funds.
Genuine absence of talented people: I think that this does apply in the very short run—it’s hard for somebody to acquire a M.D. and experience with programming at short notice. But this raises a whole host of questions: why not advertise for such positions prominently, promising high pay, so that people can use the existence of such positions to make more long-term plans of what subjects to study while they’re still in college?
Talented people would or should be willing to work for low pay: While this argument works well in the context of effective altruism (because of the altruistic orientation needed for top work), I’m not sure it works for biomedical research. I don’t see biomedical research as qualitatively different from computer programming or finance in terms of how altruistic people need to be to work productively.
Workplace egalitarianism and morale: There may be friction in labs if some people get paid a lot more, particularly if other workers aren’t convinced that the people getting paid more are really working harder. This is a problem everywhere, including in the programming world. One solution that the programming world has come up with is to offer different levels of stock compensation. Another solution is acquihires: rather than paying huge salaries to star programmers, companies buy startups that have collected a large number of star programmers under their roof, and the programmers cash in on the huge amount of money reaped through the sale. Neither of these specific solutions works in the context of nonprofit, university, or government research.
Irrationality of funders: Employers and their funders are reluctant to pay large amounts. Biomedical research labs are often affiliated with universities and need to use the payscales of the universities. Even those that rely on other donations may be afraid that their donors will balk if they pay huge salaries.
Of course, one possibility is that none of these explanations really matter and I’m overinterpreting offhand remarks that were not intended to be taken literally. But before jumping to that conclusion, I’d like to get a clearer sense of the dynamics at play.
The nature of the explanation could also affect the social value of going into biomedical research in the following sense: if (3), (4), or (5) are big issues, that could be an indicator that perhaps superstars aren’t valued much by their peers and funders (relative to the need to make people conform to norms of taking low pay). This suggests (though it doesn’t prove) that perhaps the workplace doesn’t offer enough flexibility for the sort of ambitious changes that superstars may bring about, so the marginal value of superstars in practice isn’t as high as it could be in principle. In other words, if your bosses don’t value your work enough in practice to pay you what they say you’re worth, maybe they won’t give you the autonomy to actually achieve that. On a related note, this GiveWell blog post hints that many experts think that bureaucracy, paperwork, and a bias in favor of older, established scientists, all get in the way of accomplishment for young, talented researchers:
The existing system favors researchers with strong track records, and is not good at supporting young investigators. This was the most commonly raised concern, and is mentioned in all three of our public interviews.
The existing system favors a particular brand of research – generally incremental testing of particular hypotheses – and is less suited to supporting research that doesn’t fit into this mold. Research that doesn’t fit into this mold may include:
Very high-risk research representing a small chance of a big breakthrough.
Research that focuses on developing improved tools and techniques (for example, better microscopy or better genome sequencing), rather than on directly investigating particular hypotheses.
“Translational research” aiming to improve the transition between basic scientific discoveries and clinical applications, and not focused on traditionally “academic” topics (for example, research focusing on predicting drug toxicity).
The existing system focuses on time-consuming, paperwork-heavy grant applications for individual investigators; more attention to differently structured grants and grant applications would be welcome. These could include mechanisms focused on providing small amounts of funding, along with feedback on ideas, quickly and with minimal paperwork, as well as mechanisms focused on supporting larger-scale projects that require collaboration between multiple investigators.
This could be a framing issue. Did you ask “Would you pay $500k annual salary (which probably comes out to about $800k fully loaded for the employer) to a qualified candidate?” I’d be surprised if this didn’t give him a pause.
If it’s a framing issue, which framing do you think is the correct one, i.e., which one reveals his real preferences, or the path he genuinely considers optimal?
but he would prefer not having that good person over paying her £0.5mn annually. His real preference is to pay only a “fair” salary over getting the job done. In fact, he’d, in all likelihood, rather contract out a £0.5mn job to an external company than pay the same amount as a salary internally.
I find it a bit peculiar that you post two such similar posts within such a short time span.
Anyhow, I answered in the other thread, saying that 5 is a huge thing here.
See also this post on this topic:
About half of all recent (non-meetup) Discussion posts are what feel like rather similar articles posted by Cognito Mentoring people, all of them with a prominent link to Cognito Mentoring’s website. I dare say it’s not fair, but I am beginning to get the same mental-flinch reaction to them as I do to comment spam in blogs. (“Hi! I love your blog and hope you will post more. Cognito Mentoring”)
I’ve liked their posts. I think if they’re trying to promote themselves optimally they ought to stagger their posts more to increase their visibility over a longer period of time, but I’m happy to see that they’ve gotten on an apparent “lets post all of our thoughts to Less Wrong” kick.
I dunno; I might think that if I found their posts more interesting. Perhaps it’s just because of the aforementioned mental flinch, but so far they’ve all seemed rather same-y and superficial. “Here’s a highly successful group of people! Here’s something about high IQ! Statistically it turns out that some people are highly successful and get rich. Perhaps it’s something to do with high IQ. Cognito Mentoring!” Of course I know that is a desperately unfair caricature, but none the less that’s the kind of impression I get.
[EDITED to add: And I agree with Stefan_Schubert about how very similar the two ones asking “why aren’t superstars paid much more?” were.]
It is to an established biomedical researcher’s favor to promote the impression that they have a rare and valuable skillset, and to imply that there is a shortage of people like him. As you pointed out, for 200,000 you could have your pick of top employees, so he obviously doesn’t actually believe that one is worth that. When I was considering a career in biomedical research, these are the factors that swayed me away from it:
Frequent layoffs and closing of research centers by industry.
An abundance of highly qualified people—when I talked to post-docs and grad students in various departments those in biomedical research had more publications, had gone to higher status schools, and had the most difficulty finding positions. This could be because I talked to those on the low end, but the average age of R01 recipients has climbed—indicating that its taking longer for everyone to become an established researcher.
Several articles have come out claiming a large portion of published research is wrong. Up to 50% of academic studies can’t be replicated by industry.
Thanks, this is useful inside information.
Research positions should be considered like professional sports positions. Few slots, lots of varying levels of interns, farm teams, and semi pro teams, and all of them being funneled to the “real” professional ranks. Huge supply of applicants for limited slots. Not a great position to put yourself in, unless you have some basis for believing that you’re just better than the rest at some combination of researching and lobbying for a position.
Not completely wrong, but the difference is of course that even though it is true that the academic bigshots are much more productive as others, the situation is not quite as extreme as in professional sports (where, e.g. no one wants to watch tennis players that aren’t at least in the top 100 in the world). Hence the pay structure or the institutional structure should hardly be as extreme either.
Well, strangers don’t. There’s a built-in audience for things like high school football games, though.
I agree. The research pyramid isn’t quite as pointy as professional sports, but you still need to do the math on applicants vs. positions, and factor in that researchers at the top have much longer careers.
I don’t know how relevant it is, but the claim that there are only 9 professors in America with salaries over $500k seems like a wide underestimate. Chicago has at least 5 with salaries over $700k, one in the business school and four in the medical school (p10).
Good point. I’ll update the post later today to reflect this.
So he says. What does he do? Does he offer such a salary? Does he spend even a tenth of that in the candidate search?
There is a difference between value and price.
Air is very valuable, but the price is usually quite low. People pay what they have to; they don’t pay according to value.
Is that the same as the explanation (3) that I proffered? Or is your thinking closer to explanation (2)? Or am I missing some difference between what you’re saying and the possibilities that I raised?
It is operable in my sentence you quoted—the market doesn’t require him to offer 0.5mil. He can probably have his pick of 99% of people with the needed skills for half that. His target market would work for that.
But I don’t know that I’d call that low pay. Low, by what standard? You’ve mixed a moral justification (should) with a predictive justification (would) and a judgment (low pay).
I’m pointing out:
You seem to be asserting that there is some mystery to solve—if they claim to value people so much, why don’t they pay that price. I’m saying that’s no mystery—people don’t pay according to value, they pay according to the best price they can get.
But 5 is also operable.
There are pay constraints associated with funded research grants. They can’t pay 0.5mil. The funding agent just wouldn’t put up with it, nor would his research org. Like middle management everywhere, the research director is bound by constraints from others; he isn’t the theoretical market agent maximizing his own preferences with his own dollars, he’s maximizing his preferences within the constraints of his research organization and his funding organization.
Thanks for the clarification.
If indeed it were the case that biomedical research isn’t facing a talent-constraint, i.e., they’re able to get as many people as they want with these awesome qualifications, then I would agree with you.
But the impression I got is that they aren’t able to find “enough” such people (at the low prices they currently offer). Which raises the question of whether there simply don’t exist more such people at the margin (that was my explanation 1) or that even if they did find more people, every such person would be willing to work for low pay.
(5) seems more convincing to me, and your elaboration of it makes sense.