The Annals of Statistics

Combining information from independent sources through confidence distributions

Kesar Singh, Minge Xie, and William E. Strawderman
Source: Ann. Statist. Volume 33, Number 1 (2005), 159-183.

Abstract

This paper develops new methodology, together with related theories, for combining information from independent studies through confidence distributions. A formal definition of a confidence distribution and its asymptotic counterpart (i.e., asymptotic confidence distribution) are given and illustrated in the context of combining information. Two general combination methods are developed: the first along the lines of combining p-values, with some notable differences in regard to optimality of Bahadur type efficiency; the second by multiplying and normalizing confidence densities. The latter approach is inspired by the common approach of multiplying likelihood functions for combining parametric information. The paper also develops adaptive combining methods, with supporting asymptotic theory which should be of practical interest. The key point of the adaptive development is that the methods attempt to combine only the correct information, downweighting or excluding studies containing little or wrong information about the true parameter of interest. The combination methodologies are illustrated in simulated and real data examples with a variety of applications.

First Page: Show Hide
Primary Subjects: 62F03, 62F12, 62G05, 62G10, 62G20
Full-text: Open access
Links and Identifiers

Permanent link to this document: http://projecteuclid.org/euclid.aos/1112967703
Digital Object Identifier: doi:10.1214/009053604000001084
Zentralblatt MATH identifier: 02182560
Mathematical Reviews number (MathSciNet): MR2157800

References

Berger, J. O. (1985). Statistical Decision Theory and Bayesian Analysis, 2nd ed. Springer, New York.
Mathematical Reviews (MathSciNet): MR804611
Zentralblatt MATH: 0572.62008
Efron, B. (1993). Bayes and likelihood calculations from confidence intervals. Biometrika 80 3--26.
Mathematical Reviews (MathSciNet): MR1225211
Zentralblatt MATH: 0773.62021
Efron, B. (1996). Empirical Bayes methods for combining likelihoods (with discussion). J. Amer. Statist. Assoc. 91 538--565.
Mathematical Reviews (MathSciNet): MR1395725
Efron, B. (1998). R. A. Fisher in the 21st century (with discussion). Statist. Sci. 13 95--122.
Mathematical Reviews (MathSciNet): MR1647499
Digital Object Identifier: doi:10.1214/ss/1028905930
Project Euclid: euclid.ss/1028905930
Zentralblatt MATH: 1074.01536
Fisher, R. A. (1930). Inverse probability. Proc. Cambridge Philos. Soc. 26 528--535.
Fisher, R. A. (1932). Statistical Methods for Research Workers, 4th ed. Oliver and Boyd, Edinburgh.
Zentralblatt MATH: 58.1161.04
Fisher, R. A. (1973). Statistical Methods and Scientific Inference, 3rd ed. Hafner Press, New York.
Mathematical Reviews (MathSciNet): MR346955
Zentralblatt MATH: 0281.62002
Fraser, D. A. S. (1991). Statistical inference: Likelihood to significance. J. Amer. Statist. Assoc. 86 258--265.
Mathematical Reviews (MathSciNet): MR1137116
Fraser, D. A. S. (1996). Comments on ``Pivotal inference and the fiducial argument,'' by G. A. Barnard. Internat. Statist. Rev. 64 231--235.
Hall, P. (1992). On the removal of skewness by transformation. J. Roy. Statist. Soc. Ser. B 54 221--228.
Mathematical Reviews (MathSciNet): MR1157721
Jordan, S. M. and Krishnamoorthy, K. (1996). Exact confidence intervals for the common mean of several normal populations. Biometrics 52 77--86.
Kernohan, R. M., Anderson, J. R., McKelvey, S. T. and Kennedy, T. L. (1984). A controlled trial of bipolar electrocoagulation in patients with upper gastrointestinal bleeding. British J. Surgery 71 889--891.
Lehmann, E. L. (1993). The Fisher, Neyman--Pearson theories of testing hypotheses: One theory or two? J. Amer. Statist. Assoc. 88 1242--1249.
Mathematical Reviews (MathSciNet): MR1245356
Littell, R. C. and Folks, J. L. (1973). Asymptotic optimality of Fisher's method of combining independent tests. II. J. Amer. Statist. Assoc. 68 193--194.
Mathematical Reviews (MathSciNet): MR375577
Marden, J. I. (1991). Sensitive and sturdy $p$-values. Ann. Statist. 19 918--934.
Mathematical Reviews (MathSciNet): MR1105852
Neyman, J. (1941). Fiducial argument and the theory of confidence intervals. Biometrika 32 128--150.
Mathematical Reviews (MathSciNet): MR5582
Oja, H. (1983). Descriptive statistics for multivariate distributions. Statist. Probab. Lett. 1 327--332.
Mathematical Reviews (MathSciNet): MR721446
Schweder, T. and Hjort, N. L. (2002). Confidence and likelihood. Scand. J. Statist. 29 309--332.
Mathematical Reviews (MathSciNet): MR1909788
Digital Object Identifier: doi:10.1111/1467-9469.00285
Zentralblatt MATH: 1017.62026
Singh, K., Xie, M. and Strawderman. W. (2001). Confidence distributions---concept, theory and applications. Technical report, Dept. Statistics, Rutgers Univ. Revised 2004.
Welch, B. L. and Peers, H. W. (1963). On formulae for confidence points based on integrals of weighted likelihoods. J. Roy. Statist. Soc. Ser. B 25 318--329.
Mathematical Reviews (MathSciNet): MR173309
Yu, P. L. H., Sun, Y. and Sinha, B. K. (1999). On exact confidence intervals for the common mean of several normal populations. J. Statist. Plann. Inference 81 263--277.
Mathematical Reviews (MathSciNet): MR1721552
Digital Object Identifier: doi:10.1016/S0378-3758(99)00052-X
Zentralblatt MATH: 0955.62027

2012 © Institute of Mathematical Statistics

The Annals of Statistics

The Annals of Statistics