Open Access
February 2019 Leading the field: Fortune favors the bold in Thurstonian choice models
Steven N. Evans, Ronald L. Rivest, Philip B. Stark
Bernoulli 25(1): 26-46 (February 2019). DOI: 10.3150/17-BEJ930


Schools with the highest average student performance are often the smallest schools; localities with the highest rates of some cancers are frequently small; and the effects observed in clinical trials are likely to be largest for the smallest numbers of subjects. Informal explanations of this “small-schools phenomenon” point to the fact that the sample means of smaller samples have higher variances. But this cannot be a complete explanation: If we draw two samples from a diffuse distribution that is symmetric about some point, then the chance that the smaller sample has larger mean is 50%. A particular consequence of results proved below is that if one draws three or more samples of different sizes from the same normal distribution, then the sample mean of the smallest sample is most likely to be highest, the sample mean of the second smallest sample is second most likely to be highest, and so on; this is true even though for any pair of samples, each one of the pair is equally likely to have the larger sample mean. The same effect explains why heteroscedasticity can result in misleadingly small nominal $p$-values in nonparametric tests of association.

Our conclusions are relevant to certain stochastic choice models, including the following generalization of Thurstone’s Law of Comparative Judgment. There are $n$ items. Item $i$ is preferred to item $j$ if $Z_{i}<Z_{j}$, where $Z$ is a random $n$-vector of preference scores. Suppose $\mathbb{P}\{Z_{i}=Z_{j}\}=0$ for $i\ne j$, so there are no ties. Item $k$ is the favorite if $Z_{k}<\min_{i\ne k}Z_{i}$. Let $p_{i}$ denote the chance that item $i$ is the favorite. We characterize a large class of distributions for $Z$ for which $p_{1}>p_{2}>\cdots>p_{n}$. Our results are most surprising when $\mathbb{P}\{Z_{i}<Z_{j}\}=\mathbb{P}\{Z_{i}>Z_{j}\}=\frac{1}{2}$ for $i\ne j$, so neither of any two items is likely to be preferred over the other in a pairwise comparison. Then, under suitable assumptions, $p_{1}>p_{2}>\cdots>p_{n}$ when the variability of $Z_{i}$ decreases with $i$ in an appropriate sense. Our conclusions echo the proverb “Fortune favors the bold.”


Download Citation

Steven N. Evans. Ronald L. Rivest. Philip B. Stark. "Leading the field: Fortune favors the bold in Thurstonian choice models." Bernoulli 25 (1) 26 - 46, February 2019.


Received: 1 July 2014; Revised: 1 December 2016; Published: February 2019
First available in Project Euclid: 12 December 2018

zbMATH: 07007198
MathSciNet: MR3892310
Digital Object Identifier: 10.3150/17-BEJ930

Keywords: coupling , Discrete choice models , extreme value , maximum (or minimum) of random variables , most dangerous equation , order statistic , preference scores , small schools phenomenon , stochastic domination , test of association , Thurstone , winning probability

Rights: Copyright © 2019 Bernoulli Society for Mathematical Statistics and Probability

Vol.25 • No. 1 • February 2019
Back to Top