The Annals of Statistics
- Ann. Statist.
- Volume 39, Number 5 (2011), 2356-2382.
Evaluating probability forecasts
Probability forecasts of events are routinely used in climate predictions, in forecasting default probabilities on bank loans or in estimating the probability of a patient’s positive response to treatment. Scoring rules have long been used to assess the efficacy of the forecast probabilities after observing the occurrence, or nonoccurrence, of the predicted events. We develop herein a statistical theory for scoring rules and propose an alternative approach to the evaluation of probability forecasts. This approach uses loss functions relating the predicted to the actual probabilities of the events and applies martingale theory to exploit the temporal structure between the forecast and the subsequent occurrence or nonoccurrence of the event.
Ann. Statist. Volume 39, Number 5 (2011), 2356-2382.
First available in Project Euclid: 30 November 2011
Permanent link to this document
Digital Object Identifier
Mathematical Reviews number (MathSciNet)
Zentralblatt MATH identifier
Lai, Tze Leung; Gross, Shulamith T.; Shen, David Bo. Evaluating probability forecasts. Ann. Statist. 39 (2011), no. 5, 2356--2382. doi:10.1214/11-AOS902. http://projecteuclid.org/euclid.aos/1322663461.