(17/23) This means we should look carefully at outliers, like those answers placed at the end of our rankings, since they might really belong somewhere else. For more discussion, see https://law.mit.edu/pub/unsupervised-machine-scoring-of-free-response-answers/release/1
But the question is, "even with this need for review, does our machine ranking help us out somehow?" And I think the answer is, "yes." We just need to ask "compared to what?"