I’ve no real insight to add, but would just like to comment that this generally lines up with the picture Steven Pinker paints in books like “Better Angels of Our Nature” and “Enlightenment Now”.
Rob Lucas
Bayesian Punishment
Thanks for a good comment. My oversimplified thought process was that a 10x increase in energy usage for the brain would equate to a ~2x increase in total energy usage. Since we’re able to maintain that kind of energy use during exercise, and elite athletes can maintain that for many hours/day, it seems reasonable that the heart and other organs could maintain this kind of output.
However, the issue you bring up, of actually getting that much blood to the brain, evacuating waste products, doing the necessary metabolism there, and dealing with so much heat localized in the small area of the brain, are all valid. While it seems like the rest of the body wouldn’t be constrained by this level of energy use, a 10x power output in the brain probably might be a problem.
It’s worth a more detailed analysis of exactly where the max. power output constraint on the brain, without any major changes, lie.
The biological intelligence explosion
“Extrapolating the historic 10x fall in $/FLOP every 7.7 years for 372 years yields a 10^48x increase in the amount of compute that can be purchased for that much money (we recognize that this extrapolation goes past physical limits).”
If you are aware that this extrapolation goes past physical limits, why are you using it in your models? Why not use a model where compute plateaus after it reaches those physical limits? That seems more useful than a model that knowingly breaks the laws of physics.
Related to this topic, with a similar outlook but also more discussion of specific approaches going forward, is Vitalik’s recent post on techno-optimism:
https://vitalik.eth.limo/general/2023/11/27/techno_optimism.html
There is a lot at the link, but just to give a sense of the message here’s a quote:
“To me, the moral of the story is this. Often, it really is the case that version N of our civilization’s technology causes a problem, and version N+1 fixes it. However, this does not happen automatically, and requires intentional human effort. The ozone layer is recovering because, through international agreements like the Montreal Protocol, we made it recover. Air pollution is improving because we made it improve. And similarly, solar panels have not gotten massively better because it was a preordained part of the energy tech tree; solar panels have gotten massively better because decades of awareness of the importance of solving climate change have motivated both engineers to work on the problem, and companies and governments to fund their research. It is intentional action, coordinated through public discourse and culture shaping the perspectives of governments, scientists, philanthropists and businesses, and not an inexorable “techno-capital machine”, that had solved these problems.”