Would such an ML-based system also keep track of users as individuals? For example, if one particular user makes the same moderation calls as the actual moderator 99% of the time, should the system start weighting that person’s calls more heavily?
I would say that it should do so. Even if a high-scoring community member decides to maliciously downvote somebody they are biased against 1% of the time, they’re still providing their useful moderator-aligned judgement 99% of the time, and the overall system still comes out ahead.
Would such an ML-based system also keep track of users as individuals? For example, if one particular user makes the same moderation calls as the actual moderator 99% of the time, should the system start weighting that person’s calls more heavily?
I would say that it should do so. Even if a high-scoring community member decides to maliciously downvote somebody they are biased against 1% of the time, they’re still providing their useful moderator-aligned judgement 99% of the time, and the overall system still comes out ahead.