The Annals of Applied Statistics

In-season prediction of batting averages: A field test of empirical Bayes and Bayes methodologies

Lawrence D. Brown

Full-text: Open access

Abstract

Batting average is one of the principle performance measures for an individual baseball player. It is natural to statistically model this as a binomial-variable proportion, with a given (observed) number of qualifying attempts (called “at-bats”), an observed number of successes (“hits”) distributed according to the binomial distribution, and with a true (but unknown) value of pi that represents the player’s latent ability. This is a common data structure in many statistical applications; and so the methodological study here has implications for such a range of applications.

We look at batting records for each Major League player over the course of a single season (2005). The primary focus is on using only the batting records from an earlier part of the season (e.g., the first 3 months) in order to estimate the batter’s latent ability, pi, and consequently, also to predict their batting-average performance for the remainder of the season. Since we are using a season that has already concluded, we can then validate our estimation performance by comparing the estimated values to the actual values for the remainder of the season.

The prediction methods to be investigated are motivated from empirical Bayes and hierarchical Bayes interpretations. A newly proposed nonparametric empirical Bayes procedure performs particularly well in the basic analysis of the full data set, though less well with analyses involving more homogeneous subsets of the data. In those more homogeneous situations better performance is obtained from appropriate versions of more familiar methods. In all situations the poorest performing choice is the naïve predictor which directly uses the current average to predict the future average.

One feature of all the statistical methodologies here is the preliminary use of a new form of variance stabilizing transformation in order to transform the binomial data problem into a somewhat more familiar structure involving (approximately) Normal random variables with known variances. This transformation technique is also used in the construction of a new empirical validation test of the binomial model assumption that is the conceptual basis for all our analyses.

Article information

Source
Ann. Appl. Stat. Volume 2, Number 1 (2008), 113-152.

Dates
First available in Project Euclid: 24 March 2008

Permanent link to this document
https://projecteuclid.org/euclid.aoas/1206367815

Digital Object Identifier
doi:10.1214/07-AOAS138

Mathematical Reviews number (MathSciNet)
MR2415597

Zentralblatt MATH identifier
1137.62419

Keywords
Empirical Bayes hierarchical Bayes harmonic prior variance stabilization FDR sports hitting streaks hot-hand

Citation

Brown, Lawrence D. In-season prediction of batting averages: A field test of empirical Bayes and Bayes methodologies. Ann. Appl. Stat. 2 (2008), no. 1, 113--152. doi:10.1214/07-AOAS138. https://projecteuclid.org/euclid.aoas/1206367815.


Export citation

References

  • Albert, J. (2008). Streaky hitting in baseball., J. Quantitative Analysis in Sports 4 Article 3. Available at http://www.bepress.com/jqas/vol4/iss1/3.
  • Albert, J. and Bennett, J. (2001)., Curve Ball: Baseball, Statistics, and the Role of Chance in the Game. Copernicus, New York.
  • Albright, S. C. (1993). A statistical analysis of hitting streaks in baseball (with discussion)., J. Amer. Statist. Assoc. 88 1175–1183.
  • Anscombe, F. J. (1948). The transformation of Poisson, binomial and negative binomial data., Biometrika 35 246–254.
  • Bartlett, M. S. (1936). The square root transformation in the analysis of variance., J. Roy. Statist. Soc. Suppl. 3 68–78.
  • Bartlett, M. S. (1947). The use of transformations., Biometrics 3 39–52.
  • Benjamini, Y. and Hochberg, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing., J. R. Stat. Soc. Ser. B Stat. Methodol. 57 289–300.
  • Berger, J. O. (1985)., Statistical Decision Theory and Bayesian Analysis, 2nd ed. Springer, New York.
  • Brown, L. D. (1971). Admissible estimators, recurrent diffusions and insoluble boundary value problems., Ann. Math. Statist. 42 855–903.
  • Brown, L. D. (1975). Estimation with incompletely specified loss functions (the case of several location parameters)., J. Amer. Statist. Assoc. 70 417–427.
  • Brown, L. D. (2007)., Lecture Notes on Shrinkage Estimation. Available at http://www-stat.wharton.upenn.edu/~lbrown/.
  • Brown, L. D. (2008). Supplement to “In-season prediction of batting averages: A field test of empirical Bayes and Bayes methodologies.” DOI:, 10.1214/07-AOAS138SUPP.
  • Brown, L. D. and Greenshtein, E. (2007). Empirical Bayes and compound decision approaches for estimation of a high dimensional vector of normal means., Manuscript.
  • Brown, L. D. and Zhao, L. (2002). A new test for the Poisson distribution., Sankhyā Ser. A 64 611–625.
  • Brown, L. D. and Zhao, L. (2006). Estimators for Gaussian models having a block-wise structure. Available at, http://www-stat.wharton.upenn.edu/~lbrown/.
  • Brown, K. D. and Zhao, L. (2007). A unified view of regression, shrinkage, empirical Bayes, hierarchical Bayes, and random effects. Available at, http://www-stat.wharton.upenn.edu/~lbrown/.
  • Brown, L. D., Cai, T., Zhang, R., Zhao, L. and Zhou, H. (2007). The root-unroot algorithm for density estimation as implemented via wavelet block thresholding. Available at, http://www-stat.wharton.upenn.edu/~lbrown/.
  • Efron, B. (2003). Robbins, empirical Bayes and microarrays., Ann. Statist. 31 366–378.
  • Efron, B. and Morris, C. (1975). Data analysis using Stein’s estimator and its generalizations., J. Amer. Stat. Assoc. 70 311–319.
  • Efron, B. and Morris, C. (1977). Stein’s paradox in statistics., Scientific American 236 119–127.
  • Freeman, M. F. and Tukey, J. W. (1950). Transformations related to the angular and the square root., Ann. Math. Statist. 21 607–611.
  • Frey, J. (2007). Is an.833 hitter better than a.338 hitter?, The American Statistician 61 105–111.
  • Gilovich, T., Vallone, R. and Tversky, A. (1985). The hot hand in basketball: On the misperception of random sequences., Cognitive Psychology 17 295–314.
  • James, W. and Stein, C. (1961). Estimation with quadratic loss., Proc. 4th Berkeley Symp. Probab. Statist. 1 367–379. Univ. California Press, Berkeley.
  • Lehmann, E. and Casella, G. (1998)., The Theory of Point Estimation, 2nd ed. Springer, New York.
  • Lewis, M. (2004)., Moneyball: The Art of Winning an Unfair Game. W. W. Norton, New York.
  • Lindley, D. (1962). Discussion on Proffesor Stein’s paper., J. Roy. Statist. Soc. B 24 285–287.
  • Mosteller, F. and Youtz, C. (1961). Tables of the Freeman–Tukey transformation for the binomial and Poisson distribution., Biometrika 48 433–450.
  • Robbins, H. (1951). An empirical Bayes approach to statistics., Proc. 3rd Berkeley Symp. Math. Statist. Probab. 1 157–163. Univ. California Press, Berkeley.
  • Robbins, H. (1956). Asymptotically subminimax solutions of compound statistical decision problems., Proc. 2nd Berkeley Symp. Math. Statist. Probab. 131–148. Univ. California Press, Berkeley.
  • Stein, C. (1962). Confidence sets for the mean of a multivariate normal distribution (with discussion)., J. Roy. Statist. Soc. Ser. B 24 265–296.
  • Stein, C. (1973). Estimation of the mean of a multivariate normal distribution. In, Proc. Prague Symp. on Asymptotic Statistics II (Charles Univ., Prague, 1973) 345–381. Charles Univ., Prague.
  • Stein, C. (1981). Estimation of the mean of a multivariate normal distribution., Ann. Statist. 9 1135–1151.
  • Stern, H. (2005). Baseball decision making by the numbers. In, Statistics: A Guide to the Unknown, 4th ed. (R. Peck, G. Casella, G. Cobb, R. Hoerl, D. Nolan, R. Starbuck and H. Stern, eds.) 393–406. Duxbury Press, Pacific Grove, CA.
  • Strawderman, W. E. (1971). Proper Bayes estimators of the multivariate normal mean., Ann. Math. Statist. 42 385–388.
  • Strawderman, W. E. (1973). Proper Bayes minimax estimators of the multivariate normal mean for the case of common unknown variances., Ann. Math. Statist. 44 1189–1194.

Supplemental materials