There is some degree to which you should expect to be swayed by empty arguments, and yes, you should subtract that out if you anticipate it.
Right. I think my argument hinges on the fact that AI knows how much you intend to subtract before you read the book, and can make it be more convincing than this amount.
I don’t think it’s okay to have the AI’s convincingness be truly infinite, in the full inf—inf = undefined sense. Your math will break down. Safer just to represent “suppose there’s a super-good arguer” by having the convincingess be finite, but larger than every other scale in the problem.
Right. I think my argument hinges on the fact that AI knows how much you intend to subtract before you read the book, and can make it be more convincing than this amount.
I don’t think it’s okay to have the AI’s convincingness be truly infinite, in the full inf—inf = undefined sense. Your math will break down. Safer just to represent “suppose there’s a super-good arguer” by having the convincingess be finite, but larger than every other scale in the problem.