Electronic Journal of Statistics
- Electron. J. Statist.
- Volume 9, Number 1 (2015), 1041-1077.
Estimation and model selection for model-based clustering with the conditional classification likelihood
The Integrated Completed Likelihood (ICL) criterion was introduced by Biernacki, Celeux and Govaert (2000) in the model-based clustering framework to select a relevant number of classes and has been used by statisticians in various application areas. A theoretical study of ICL is proposed.
A contrast related to the clustering objective is introduced: the conditional classification likelihood. An estimator and model selection criteria are deduced. The properties of these new procedures are studied and ICL is proved to be an approximation of one of these criteria. We contrast these results with the current leading point of view about ICL, that it would not be consistent. Moreover these results give insights into the class notion underlying ICL and feed a reflection on the class notion in clustering.
General results on penalized minimum contrast criteria and upper-bounds of the bracketing entropy in parametric situations are derived, which can be useful per se.
Practical solutions for the computation of the introduced procedures are proposed, notably an adapted EM algorithm and a new initialization method for EM-like algorithms which helps to improve the estimation in Gaussian mixture models.
Electron. J. Statist., Volume 9, Number 1 (2015), 1041-1077.
Received: March 2014
First available in Project Euclid: 27 May 2015
Permanent link to this document
Digital Object Identifier
Mathematical Reviews number (MathSciNet)
Zentralblatt MATH identifier
Primary: 62H30: Classification and discrimination; cluster analysis [See also 68T10, 91C20]
Secondary: 62H12: Estimation
Baudry, Jean-Patrick. Estimation and model selection for model-based clustering with the conditional classification likelihood. Electron. J. Statist. 9 (2015), no. 1, 1041--1077. doi:10.1214/15-EJS1026. https://projecteuclid.org/euclid.ejs/1432732304