Me: I think it’s possible that we might not need to figure out biotechnological advances for how we can create superbabies through embryo selection or so, but that actually they might already be around 1000 or more superbabies born on earth per year, only they happen to be born into an environment where they don’t get educated and don’t learn the necessary skills to advance science. By superbabies I mean genetic potential for intelligence of >=+7std on the human distribution.
Imaginary person (IP): What, how could that be true? There being some hunter tribe of genetical supergeniuses which are almost not communicating with the rest of humanity?
IP: Ok but it’s actually just a fun relatively unlikely possibility right?
Me: No. My current guess would 50% that orcas could do superhuman scientific problem solving (aka >=+7std[1]) if they actually trained themselves at it for human equivalent amounts and had human equivalent interfaces for research (e.g. BCI for using a computer). Though I don’t know that much about orcas so please tell me more evidence and considerations. Though even if we tried significantly[2] I’d only give it like 15% chance that within the next 30 years, orcas could in one year solve theory-bottlenecked problems for which science would’ve taken 20 years. (Yeah I know 15% is still ridiculously high considering how crazy the plan sounds.) E.g. orcas might want to rather do orca stuff, or there might be orca-cultural pressure against spending a large chunk of a day studying, or communicating with orcas turns out to be much harder than my median expectation[3]. (Please comment if you have more considerations on why it might (not) work.)
Can someone please look into this?
I think conditional on orcas being >=+7std intelligent, I’d be about as excited about this as about trying to get human superbabies soon.[4]
I’d guess it might not be all that hard to get a better guess on how smart orcas are in comparison to humans. E.g. get a guess on how sophisticated their language is, see how good they are at pattern recognition or learning to solve simple math or other problems[5]. (Though in the cases where orcas perform well we’d still have some uncertainty about how well it’s going to generalize to hard science problems I guess.)
Can people (you?) please look into this, and if it seems like orcas might be superhumanly smart work to become able to communicate well with them etc?[6]
Cautionary notes
There’s a lot of important questions to think through which I haven’t thought through at all. Here’s a very non-exhaustive list:
How aligned are orcas with humans?
How well could we trade with orcas if we e.g. give them power by having them try to solve the alignment problem?
How would people react if there was significant evidence of orcas being (a) human-level intelligent or (b) singificantly smarter than humans?
I feel sorta relatively optimistic here though.
Also the the plan here would obviously NOT be to keep orcas in captivity and try to train and extract useful cognitive work from them, but to build study places for orcas where they can come to of their own accord and communicate with humans and be taught.
Sidenote on how orcas (and pilot whales) could be useful datapoints for AI alignment
(feel free to skip this if you’re not interested in alignment.)
Steven Byrnes is trying to reverse engineer the steering subsystem in human brains. My uncertain guess is that this probably is not directly amazingly useful for aligning AI, but I’m still a big fan of his agenda. A major reason for this is that understanding the steering subsystem might help us to better understand how human values form, and that we might be able to generalize the understanding a bit to see how we might align AIs.
If there are other intelligent species on earth, we could reverse their steering subsystems too and observe and understand how their values form, and we’d thereby have multiple datapoints which seems like a lot better basis for forming good generalizing models of what alignment-machinery we need for shaping the (values of the) AI as we want.
Though with better understanding we might of course be able to predict much better what approach is more promising, rather than thinking they are similarly promising.
Tbc, I’d not expect current orcas to be able to compete with current humans in abstract problem solving, because orcas are probably basically not trained in it at all. But we could see how fast they learn it and maybe compare how fast a human who didn’t get education can learn it.
I’m currently not quite yet excited enough myself / I am more excited about my current agenda (which I am unusually excited about—the orca thing is still among the top contenders). Also I have much higher irreplaceability on my agenda whereas I might not have that great of a competetive advantage on the orca stuff.
An alternative approach to superbabies
Me: I think it’s possible that we might not need to figure out biotechnological advances for how we can create superbabies through embryo selection or so, but that actually they might already be around 1000 or more superbabies born on earth per year, only they happen to be born into an environment where they don’t get educated and don’t learn the necessary skills to advance science. By superbabies I mean genetic potential for intelligence of >=+7std on the human distribution.
Imaginary person (IP): What, how could that be true? There being some hunter tribe of genetical supergeniuses which are almost not communicating with the rest of humanity?
Me: Sorta yeah.
IP: And where would those superbabies be?
Me: Here:
.
.
.
.
.
IP: Are you joking?
Me: No. See this excellent reddit post (or my wrapper post around it) for why it’s IMO a pretty reasonable guess. Actually just read this right now before continuing. It takes only 5min.
IP: Ok but it’s actually just a fun relatively unlikely possibility right?
Me: No. My current guess would 50% that orcas could do superhuman scientific problem solving (aka >=+7std[1]) if they actually trained themselves at it for human equivalent amounts and had human equivalent interfaces for research (e.g. BCI for using a computer). Though I don’t know that much about orcas so please tell me more evidence and considerations.
Though even if we tried significantly[2] I’d only give it like 15% chance that within the next 30 years, orcas could in one year solve theory-bottlenecked problems for which science would’ve taken 20 years. (Yeah I know 15% is still ridiculously high considering how crazy the plan sounds.)
E.g. orcas might want to rather do orca stuff, or there might be orca-cultural pressure against spending a large chunk of a day studying, or communicating with orcas turns out to be much harder than my median expectation[3]. (Please comment if you have more considerations on why it might (not) work.)
Can someone please look into this?
I think conditional on orcas being >=+7std intelligent, I’d be about as excited about this as about trying to get human superbabies soon.[4]
I’d guess it might not be all that hard to get a better guess on how smart orcas are in comparison to humans. E.g. get a guess on how sophisticated their language is, see how good they are at pattern recognition or learning to solve simple math or other problems[5]. (Though in the cases where orcas perform well we’d still have some uncertainty about how well it’s going to generalize to hard science problems I guess.)
Can people (you?) please look into this, and if it seems like orcas might be superhumanly smart work to become able to communicate well with them etc?[6]
Cautionary notes
There’s a lot of important questions to think through which I haven’t thought through at all. Here’s a very non-exhaustive list:
How aligned are orcas with humans?
How well could we trade with orcas if we e.g. give them power by having them try to solve the alignment problem?
How would people react if there was significant evidence of orcas being (a) human-level intelligent or (b) singificantly smarter than humans?
I feel sorta relatively optimistic here though.
Also the the plan here would obviously NOT be to keep orcas in captivity and try to train and extract useful cognitive work from them, but to build study places for orcas where they can come to of their own accord and communicate with humans and be taught.
Sidenote on how orcas (and pilot whales) could be useful datapoints for AI alignment
(feel free to skip this if you’re not interested in alignment.)
Steven Byrnes is trying to reverse engineer the steering subsystem in human brains. My uncertain guess is that this probably is not directly amazingly useful for aligning AI, but I’m still a big fan of his agenda. A major reason for this is that understanding the steering subsystem might help us to better understand how human values form, and that we might be able to generalize the understanding a bit to see how we might align AIs.
If there are other intelligent species on earth, we could reverse their steering subsystems too and observe and understand how their values form, and we’d thereby have multiple datapoints which seems like a lot better basis for forming good generalizing models of what alignment-machinery we need for shaping the (values of the) AI as we want.
where most of the 50% probability mass is actually on orcas being even vastly smarter than +10std humans would be
(e.g. 1 billon dollars and a few very smart geniuses going into trying to make communication with orcas work well)
(where tbc my median guess still says it will be very difficult—but perhaps feasible given a highly selected group of geniuses)
Though with better understanding we might of course be able to predict much better what approach is more promising, rather than thinking they are similarly promising.
Tbc, I’d not expect current orcas to be able to compete with current humans in abstract problem solving, because orcas are probably basically not trained in it at all. But we could see how fast they learn it and maybe compare how fast a human who didn’t get education can learn it.
I’m currently not quite yet excited enough myself / I am more excited about my current agenda (which I am unusually excited about—the orca thing is still among the top contenders). Also I have much higher irreplaceability on my agenda whereas I might not have that great of a competetive advantage on the orca stuff.