Maybe Nate has something in mind like Bostrom’s “strong superintelligence”, defined in Superintelligence as “a level of intelligence vastly greater than contemporary humanity’s combined intellectual wherewithal”?
(Whereas Bostrom defines “superintelligence” as “any intellect that greatly exceeds the cognitive performance of humans in virtually all domains of interest”, where “exceeding the performance of humans” means outperforming the best individual human, not necessarily outperforming all of humanity working together.)
Maybe Nate has something in mind like Bostrom’s “strong superintelligence”, defined in Superintelligence as “a level of intelligence vastly greater than contemporary humanity’s combined intellectual wherewithal”?
(Whereas Bostrom defines “superintelligence” as “any intellect that greatly exceeds the cognitive performance of humans in virtually all domains of interest”, where “exceeding the performance of humans” means outperforming the best individual human, not necessarily outperforming all of humanity working together.)