But we can refuse to be satisified with instructions that look like “cut the red one, then blue, etc...”. We should request that the AI writing the textbook explain from first principles why that will work, in a way that is maximally comprehensible by a human or team of humans.
But we can refuse to be satisified with instructions that look like “cut the red one, then blue, etc...”. We should request that the AI writing the textbook explain from first principles why that will work, in a way that is maximally comprehensible by a human or team of humans.
Did you mean “in a way that maximally convinces a human or a team of humans that they understand everything”? I don’t think this is a good idea.