Electronic Journal of Statistics
- Electron. J. Statist.
- Volume 13, Number 1 (2019), 1166-1211.
Order-sensitivity and equivariance of scoring functions
The relative performance of competing point forecasts is usually measured in terms of loss or scoring functions. It is widely accepted that these scoring function should be strictly consistent in the sense that the expected score is minimized by the correctly specified forecast for a certain statistical functional such as the mean, median, or a certain risk measure. Thus, strict consistency opens the way to meaningful forecast comparison, but is also important in regression and M-estimation. Usually strictly consistent scoring functions for an elicitable functional are not unique. To give guidance on the choice of a scoring function, this paper introduces two additional quality criteria. Order-sensitivity opens the possibility to compare two deliberately misspecified forecasts given that the forecasts are ordered in a certain sense. On the other hand, equivariant scoring functions obey similar equivariance properties as the functional at hand – such as translation invariance or positive homogeneity. In our study, we consider scoring functions for popular functionals, putting special emphasis on vector-valued functionals, e.g. the pair (mean, variance) or (Value at Risk, Expected Shortfall).
Electron. J. Statist., Volume 13, Number 1 (2019), 1166-1211.
Received: November 2017
First available in Project Euclid: 5 April 2019
Permanent link to this document
Digital Object Identifier
Mathematical Reviews number (MathSciNet)
Zentralblatt MATH identifier
Primary: 62C99: None of the above, but in this section 62F07: Ranking and selection
Secondary: 62G99: None of the above, but in this section 91B06: Decision theory [See also 62Cxx, 90B50, 91A35]
Fissler, Tobias; Ziegel, Johanna F. Order-sensitivity and equivariance of scoring functions. Electron. J. Statist. 13 (2019), no. 1, 1166--1211. doi:10.1214/19-EJS1552. https://projecteuclid.org/euclid.ejs/1554429627