What strikes me is how very much the story is about FAI—not just learning the skills people need to work on the problem, but how much Harry and Quirrell (at least) are like AIs of possible Friendliness which the other characters need to make good judgments about (and of course, they need to gauge each other), not to mention how much work Harry needs to do to hopefully become Friendly himself.
Quirrell tried to create an aligned successor and failed. Hard. He literally imprinted his own cognitive patterns and shaped Harry the entire year, and still failed.
What strikes me is how very much the story is about FAI—not just learning the skills people need to work on the problem, but how much Harry and Quirrell (at least) are like AIs of possible Friendliness which the other characters need to make good judgments about (and of course, they need to gauge each other), not to mention how much work Harry needs to do to hopefully become Friendly himself.
Quirrell tried to create an aligned successor and failed. Hard. He literally imprinted his own cognitive patterns and shaped Harry the entire year, and still failed.
I was repeatedly flashing back to a certain youtube Q&A session...
Link?