Source: J. Appl. Probab. Volume 46, Number 4
(2009), 1073-1085.
We approximate the distribution of the sum of independent but not
necessarily identically distributed Bernoulli random variables using a
shifted binomial distribution, where the three parameters (the number of
trials, the probability of success, and the shift amount) are chosen to
match the first three moments of the two distributions. We give a bound on
the approximation error in terms of the total variation metric using
Stein's method. A numerical study is discussed that shows shifted binomial
approximations are typically more accurate than Poisson or standard
binomial approximations. The application of the approximation to solving a
problem arising in Bayesian hierarchical modeling is also discussed.
References
Arak, T. V. and Zaĭtsev, A. Yu. (1988). Uniform limit theorems for sums of independent random variables. Proc. Steklov Inst. Math. 174, viii+222 pp.
Mathematical Reviews (MathSciNet):
MR974089
Ash, A., Shwartz, M. and Peköz, E. (2003). Comparing outcomes across providers. In Risk Adjustment for Measuring Health Care Outcomes, 3rd edn. Health Administration Press, Chicago, IL, pp. 297--333.
Barbour, A. D. and Brown, T. C. (1992). Stein's method and point process approximation. Stoch. Process. Appl. 43, 9--31.
Barbour, A. D. and Čekanavičius, V. (2002). Total variation asymptotics for sums of independent integer random variables. Ann. Prob. 30, 509--545.
Barbour, A. D. and Chen, L. H. Y. (eds) (2005). An Introduction to Stein's Method (Lecture Notes Ser., Inst. Math. Sci., National Uni. Singapore 4), Singapore University Press.
Barbour, A. D. and Chryssaphinou, O. (2001). Compound Poisson approximation: a user's guide. Ann. Appl. Prob. 11, 964--1002.
Barbour, A. D. and Lindvall, T. (2006). Translated Poisson approximation for Markov chains. J. Theoret. Prob. 19, 609--630.
Barbour, A. D. and Xia, A. (1999). Poisson perturbations. ESAIM Prob. Statist. 3, 131--150 (electronic).
Barbour, A. D., Chen, L. H. Y. and Loh, W.-L. (1992a). Compound Poisson approximation for nonnegative random variables via Stein's method. Ann. Prob. 20, 1843--1866.
Barbour, A. D., L. Holst, and Janson, S. (1992b). Poisson Approximation (Oxford Stud. Prob. 2). Clarendon Press, Oxford.
Čekanavičius, V. and Roos, B. (2007). Binomial approximation to the Markov binomial distribution. Acta Appl. Math. 96, 137--146.
Čekanavičius, V. and Vaĭtkus, P. (2001). Centered Poisson approximation by the Stein method. Lithuanian Math. J. 41, 319--329.
Chen, L. H. Y. (1974). On the convergence of Poisson binomial to Poisson distributions. Ann. Prob. 2, 178--180.
Mathematical Reviews (MathSciNet):
MR370693
Chen, L. H. Y. (1975). Poisson approximation for dependent trials. Ann. Prob. 3, 534--545.
Mathematical Reviews (MathSciNet):
MR428387
Chen, S. X. and Liu, J. S. (1997). Statistical applications of the Poisson-binomial and conditional Bernoulli distributions. Statistica Sinica 7, 875--892.
Choi, K. P. and Xia, A. (2002). Approximating the number of successes in independent trials: binomial versus Poisson. Ann. Appl. Prob. 12, 1139--1148.
Ehm, W. (1991). Binomial approximation to the Poisson binomial distribution. Statist. Prob. Lett. 11, 7--16.
Le Cam, L. (1960). An approximation theorem for the Poisson binomial distribution. Pacific J. Math. 10, 1181--1197.
Mathematical Reviews (MathSciNet):
MR142174
Loh, W.-L. (1992). Stein's method and multinomial approximation. Ann. Appl. Prob. 2, 536--554.
Luk, H. M. (1994). Stein's method for the gamma distribution and related statistical applications. Doctoral Thesis, University of Southern California.
Mattner, L. and Roos, B. (2007). A shorter proof of Kanter's Bessel function concentration bound. Prob. Theory Relat. Fields 139, 191--205.
Peköz, E. A. (1996). Stein's method for geometric approximation. J. Appl. Prob. 33, 707--713.
Peköz, E. A., Shwartz, M., Christiansen, C. and Berlowitz, D. (2009). Approximate Bayesian models for aggregate data when individual-level data is confidential or unavailable. Submitted.
Pitman, J. (1997). Probabilistic bounds on the coefficients of polynomials with only real zeros. J. Combinatorial Theory A 77, 279--303.
Reinert, G. (2005). Three general approaches to Stein's method. In An Introduction to Stein's Method (Lecture Notes Ser., Inst. Math. Sci., National Uni. Singapore 4), Singapore University Press, pp. 183--221.
Röllin, A. (2005). Approximation of sums of conditionally independent variables by the translated Poisson distribution. Bernoulli 11, 1115--1128.
Röllin, A. (2008). Symmetric and centered binomial approximation of sums of locally dependent random variables. Electron. J. Prob. 13, 756--776.
Roos, B. (2000). Binomial approximation to the Poisson binomial distribution: the Krawtchouk expansion. Theory Prob. Appl. 45, 258--272.
Ross, S. and Peköz, E. (2007). A Second Course in Probability. ProbabilityBookstore.com, Boston, MA.
Soon, S. Y. T. (1996). Binomial approximation for dependent indicators. Statistica Sinica 6, 703--714.
Stein, C. (1972). A bound for the error in the normal approximation to the distribution of a sum of dependent random variables. In Proc. 6th Berkeley Symp. Math. Statist. Prob., Vol. II, University of California Press, Berkeley, pp. 583\nobreakdash--602.
Mathematical Reviews (MathSciNet):
MR402873