- Bayesian Anal.
- Volume 5, Number 3 (2010), 429-449.
Selection sampling from large data sets for targeted inference in mixture modeling
One of the challenges in using Markov chain Monte Carlo for model analysis in studies with very large datasets is the need to scan through the whole data at each iteration of the sampler, which can be computationally prohibitive. Several approaches have been developed to address this, typically drawing computationally manageable subsamples of the data. Here we consider the specific case where most of the data from a mixture model provides little or no information about the parameters of interest, and we aim to select subsamples such that the information extracted is most relevant. The motivating application arises in flow cytometry, where several measurements from a vast number of cells are available. Interest lies in identifying specific rare cell subtypes and characterizing them according to their corresponding markers. We present a Markov chain Monte Carlo approach where an initial subsample of the full dataset is used to guide selection sampling of a further set of observations targeted at a scientificallyinteresting, low probability region. We define a Sequential Monte Carlo strategy in which the targeted subsample is augmented sequentially as estimates improve, and introduce a stopping rule for determining the size of the targeted subsample. An example from flow cytometry illustrates the ability of the approach to increase the resolution of inferences for rare cell subtypes.
Bayesian Anal., Volume 5, Number 3 (2010), 429-449.
First available in Project Euclid: 22 June 2012
Permanent link to this document
Digital Object Identifier
Mathematical Reviews number (MathSciNet)
Zentralblatt MATH identifier
Manolopoulou, Ioanna; Chan, Cliburn; West, Mike. Selection sampling from large data sets for targeted inference in mixture modeling. Bayesian Anal. 5 (2010), no. 3, 429--449. doi:10.1214/10-BA517. https://projecteuclid.org/euclid.ba/1340369756
- Related item: Fabio Rigat. Comment on article by Manolopoulou et al. Bayesian Anal., Vol. 5, Iss. 3 (2010), 451-455.
- Related item: Nick Whiteley. Comment on article by Manolopoulou et al. Bayesian Anal., Vol. 5, Iss. 3 (2010), 457-460.
- Related item: Cliburn Chan, Ionna Manolopoulou, Mike West. Rejoinder. Bayesian Anal., Vol. 5, Iss. 3(2010), 461-463.