I don’t think I claimed that the brain is a totally aligned general intelligence, and if I did, I take it back! For now, I’ll stand by what I said here: “if we comprehensively understood how the human brain works at the algorithmic level, then necessarily embedded in this understanding should be some recipe for a generally intelligent system at least as aligned to our values as the typical human brain.” This seems harmonious with what I take your point to be: that the human brain is not a totally aligned general intelligence. I second Steve’s deferral to Eliezer’s thoughts on the matter, and I mean to endorse something similar here.
what’s the prevalence of empathy in social but non-general animals?
Here’s a good summary. I also found a really nice non-academic article in Vox on the topic.
And I’m looking forward to seeing your post on second-order alignment! I think the more people who take the concern seriously (and put forward compelling arguments to that end), the better.
Thank you!
I don’t think I claimed that the brain is a totally aligned general intelligence, and if I did, I take it back! For now, I’ll stand by what I said here: “if we comprehensively understood how the human brain works at the algorithmic level, then necessarily embedded in this understanding should be some recipe for a generally intelligent system at least as aligned to our values as the typical human brain.” This seems harmonious with what I take your point to be: that the human brain is not a totally aligned general intelligence. I second Steve’s deferral to Eliezer’s thoughts on the matter, and I mean to endorse something similar here.
Here’s a good summary. I also found a really nice non-academic article in Vox on the topic.
And I’m looking forward to seeing your post on second-order alignment! I think the more people who take the concern seriously (and put forward compelling arguments to that end), the better.
Ah, you’re too late to look forward to it, it’s already published :P