Just to clarify, do you only consider ‘strong human intelligence amplification’ through some internal change, or do you also consider AIs to be part of that? As in, it sounds like you are saying we currently lack the intelligence to make significant progress on alignment research and consider increasing human intelligence to be the best way to make progress. Are you also of the opinion that using AIs to augment alignment researchers and progressively automate alignment research is doomed and not worth consideration? If not, then here.
Not strictly doomed but probably doomed, yeah. You’d have to first do difficult interesting novel philosophy yourself, and then look for things that would have helped with that.
Fair enough. For what it’s worth, I’ve thought a lot about the kind of thing you describe in that comment and partially committing to this direction because I feel like I have enough intuition and insight that those other tools for thought failed to incorporate.
Just to clarify, do you only consider ‘strong human intelligence amplification’ through some internal change, or do you also consider AIs to be part of that? As in, it sounds like you are saying we currently lack the intelligence to make significant progress on alignment research and consider increasing human intelligence to be the best way to make progress. Are you also of the opinion that using AIs to augment alignment researchers and progressively automate alignment research is doomed and not worth consideration? If not, then here.
Not strictly doomed but probably doomed, yeah. You’d have to first do difficult interesting novel philosophy yourself, and then look for things that would have helped with that.
Fair enough. For what it’s worth, I’ve thought a lot about the kind of thing you describe in that comment and partially committing to this direction because I feel like I have enough intuition and insight that those other tools for thought failed to incorporate.
Sure. You can ping me at some point if you want to talk about ideas for that or get my feedback or whatever.