Statistical Science

Some Progress and Problems in Meta-Analysis of Clinical Trials

Frederick Mosteller and Thomas C. Chalmers

Full-text: Open access

Abstract

We report progress on some methodological issues in meta-analysis. Evidence continues to accumulate that randomized trials show smaller gains than nonrandomized trials when innovations are compared to standard therapies. Quality scores for randomized clinical trials show that reporting has improved about 27% in three decades, to a quality level slightly over 50%. Although quality scoring could be useful, in principle, for adjusting estimates of gain from innovations, a substantial study has not found a statistical relation between gains and quality. We describe a method of blinding papers to reduce the bias of readers doing meta-analyses. For combining data for fixed effects, Greenland and Salvan recommend using Mantel-Haensztel, weighted least squares or maximum likelihood methods. For random effects, Larholt, Tsiatis and Gelber have improvements for the DerSimonian and Laird method. Eddy and his colleagues have prepared software and book-length works on Bayesian methods for technology assessment using meta-analysis. Louis has a valuable review article on Bayesian approaches. The annoying difficulties in combining $2 \times 2$ tables when some cells have zeros has been largely overcome by exact calculation methods. From diagnostic data acquired from several independent investigations, new methods have appeared for estimating receiver operating characteristic curves. An update on meta-analyses of randomized clinical trials shows about 16 meta-analyses per year in journals during 1983-1990. We expect much more methodologic work as new issues appear and findings point us toward fresh solutions.

Article information

Source
Statist. Sci., Volume 7, Number 2 (1992), 227-236.

Dates
First available in Project Euclid: 19 April 2007

Permanent link to this document
https://projecteuclid.org/euclid.ss/1177011362

Digital Object Identifier
doi:10.1214/ss/1177011362

Mathematical Reviews number (MathSciNet)
MR1179649

Zentralblatt MATH identifier
0955.62642

JSTOR
links.jstor.org

Keywords
Clinical trials overviews combining data quality scores Bayesian methods exact methods ROC curves technology assessment

Citation

Mosteller, Frederick; Chalmers, Thomas C. Some Progress and Problems in Meta-Analysis of Clinical Trials. Statist. Sci. 7 (1992), no. 2, 227--236. doi:10.1214/ss/1177011362. https://projecteuclid.org/euclid.ss/1177011362


Export citation