Greetings. On 7 Apr 2002, Dennis Roberts wrote: > how will you know for sure IF a grader is aberrant? ... an outlier?
In some cases, either by her own admission or by inspection of the assignments she graded. It may turn out that she neglected to make deductions for a certain class of errors, or perhaps she consistently deducted twice as many (or few) marks as instructed for a certain type of error, or perhaps she looked for certain classes of errors that the other graders did not check for. I have seen cases where exactly this sort of thing occurred, and whatever the cause (poorly-specified marking scheme, incompetent grader, etc.), the end result is that one grader is definitely and demonstrably aberrant, usually in a consistent way. It is precisely this sort of situation that I was referring to in my original posting, but so far people seem more interested in challenging my scenario than answering the questions. -- \\\ Tristan Miller \\\ Department of Computer Science, University of Toronto \\\ http://www.cs.toronto.edu/~psy/ . . ================================================================= Instructions for joining and leaving this list, remarks about the problem of INAPPROPRIATE MESSAGES, and archives are available at: . http://jse.stat.ncsu.edu/ . =================================================================
