Annals of Statistics

Combining information from independent sources through confidence distributions

Kesar Singh, Minge Xie, and William E. Strawderman

Full-text: Open access


This paper develops new methodology, together with related theories, for combining information from independent studies through confidence distributions. A formal definition of a confidence distribution and its asymptotic counterpart (i.e., asymptotic confidence distribution) are given and illustrated in the context of combining information. Two general combination methods are developed: the first along the lines of combining p-values, with some notable differences in regard to optimality of Bahadur type efficiency; the second by multiplying and normalizing confidence densities. The latter approach is inspired by the common approach of multiplying likelihood functions for combining parametric information. The paper also develops adaptive combining methods, with supporting asymptotic theory which should be of practical interest. The key point of the adaptive development is that the methods attempt to combine only the correct information, downweighting or excluding studies containing little or wrong information about the true parameter of interest. The combination methodologies are illustrated in simulated and real data examples with a variety of applications.

Article information

Ann. Statist., Volume 33, Number 1 (2005), 159-183.

First available in Project Euclid: 8 April 2005

Permanent link to this document

Digital Object Identifier

Mathematical Reviews number (MathSciNet)

Zentralblatt MATH identifier

Primary: 62F03: Hypothesis testing 62F12: Asymptotic properties of estimators 62G05: Estimation 62G10: Hypothesis testing 62G20: Asymptotic properties

Combining information confidence distribution frequentist inference bootstrap common mean problem meta-analysis U-statistic robust scale computer intensive methods p-value function


Singh, Kesar; Xie, Minge; Strawderman, William E. Combining information from independent sources through confidence distributions. Ann. Statist. 33 (2005), no. 1, 159--183. doi:10.1214/009053604000001084.

Export citation


  • Berger, J. O. (1985). Statistical Decision Theory and Bayesian Analysis, 2nd ed. Springer, New York.
  • Efron, B. (1993). Bayes and likelihood calculations from confidence intervals. Biometrika 80 3–26.
  • Efron, B. (1996). Empirical Bayes methods for combining likelihoods (with discussion). J. Amer. Statist. Assoc. 91 538–565.
  • Efron, B. (1998). R. A. Fisher in the 21st century (with discussion). Statist. Sci. 13 95–122.
  • Fisher, R. A. (1930). Inverse probability. Proc. Cambridge Philos. Soc. 26 528–535.
  • Fisher, R. A. (1932). Statistical Methods for Research Workers, 4th ed. Oliver and Boyd, Edinburgh.
  • Fisher, R. A. (1973). Statistical Methods and Scientific Inference, 3rd ed. Hafner Press, New York.
  • Fraser, D. A. S. (1991). Statistical inference: Likelihood to significance. J. Amer. Statist. Assoc. 86 258–265.
  • Fraser, D. A. S. (1996). Comments on “Pivotal inference and the fiducial argument,” by G. A. Barnard. Internat. Statist. Rev. 64 231–235.
  • Hall, P. (1992). On the removal of skewness by transformation. J. Roy. Statist. Soc. Ser. B 54 221–228.
  • Jordan, S. M. and Krishnamoorthy, K. (1996). Exact confidence intervals for the common mean of several normal populations. Biometrics 52 77–86.
  • Kernohan, R. M., Anderson, J. R., McKelvey, S. T. and Kennedy, T. L. (1984). A controlled trial of bipolar electrocoagulation in patients with upper gastrointestinal bleeding. British J. Surgery 71 889–891.
  • Lehmann, E. L. (1993). The Fisher, Neyman–Pearson theories of testing hypotheses: One theory or two? J. Amer. Statist. Assoc. 88 1242–1249.
  • Littell, R. C. and Folks, J. L. (1973). Asymptotic optimality of Fisher's method of combining independent tests. II. J. Amer. Statist. Assoc. 68 193–194.
  • Marden, J. I. (1991). Sensitive and sturdy $p$-values. Ann. Statist. 19 918–934.
  • Neyman, J. (1941). Fiducial argument and the theory of confidence intervals. Biometrika 32 128–150.
  • Oja, H. (1983). Descriptive statistics for multivariate distributions. Statist. Probab. Lett. 1 327–332.
  • Schweder, T. and Hjort, N. L. (2002). Confidence and likelihood. Scand. J. Statist. 29 309–332.
  • Singh, K., Xie, M. and Strawderman. W. (2001). Confidence distributions–-concept, theory and applications. Technical report, Dept. Statistics, Rutgers Univ. Revised 2004.
  • Welch, B. L. and Peers, H. W. (1963). On formulae for confidence points based on integrals of weighted likelihoods. J. Roy. Statist. Soc. Ser. B 25 318–329.
  • Yu, P. L. H., Sun, Y. and Sinha, B. K. (1999). On exact confidence intervals for the common mean of several normal populations. J. Statist. Plann. Inference 81 263–277.