Open Access
Translator Disclaimer
August 1996 Rank inversions in scoring multipart examinations
Simeon M. Berman
Ann. Appl. Probab. 6(3): 992-1005 (August 1996). DOI: 10.1214/aoap/1034968237


Let $(X_i, Y_i), i = 1, \dots, n$, be independent random vectors with a standard bivariate normal distribution and let $s_X$ and $s_Y$ be the sample standard deviations. For arbitrary $p, 0 < p < 1$, define $T_i = pX_i + (1 - p) Y_i$ and $Z_i = pX_i / s_X + (1 - p) Y_i / s_Y, i = 1, \dots, n$. The couple of pairs $(T_i, Z_i)$ and $(T_j, Z_j)$ is said to be discordant if either $T_i < T_j$ and $Z_i > Z_j$ or $T_i > T_j$ and $Z_i < Z_j$. It is shown that the expected number of discordant couples of pairs is asymptotically equal to $n^{3/2}$ times an explicit constant depending on p and the correlation coefficient of $X_i$ and $Y_i$. By an application of the Durbin-Stuart inequality, this implies an asymptotic lower bound on the expected value of the sum of $(\rank(Z_i) - \rank(T_i))^+$. The problem arose in a court challenge to a standard procedure for the scoring of multipart written civil service examinations. Here the sum of the positive rank differences represents a measure of the unfairness of the method of scoring.


Download Citation

Simeon M. Berman. "Rank inversions in scoring multipart examinations." Ann. Appl. Probab. 6 (3) 992 - 1005, August 1996.


Published: August 1996
First available in Project Euclid: 18 October 2002

zbMATH: 0866.62031
MathSciNet: MR1410125
Digital Object Identifier: 10.1214/aoap/1034968237

Primary: 62F07 , 62H20

Keywords: Bivariate normal distribution , concordance , ranks , sample variance

Rights: Copyright © 1996 Institute of Mathematical Statistics


Vol.6 • No. 3 • August 1996
Back to Top