The Annals of Statistics

A geometric characterization of c-optimal designs for heteroscedastic regression

Holger Dette and Tim Holland-Letz

Source: Ann. Statist. Volume 37, Number 6B (2009), 4088-4103.

Abstract

We consider the common nonlinear regression model where the variance, as well as the mean, is a parametric function of the explanatory variables. The c-optimal design problem is investigated in the case when the parameters of both the mean and the variance function are of interest. A geometric characterization of c-optimal designs in this context is presented, which generalizes the classical result of Elfving [Ann. Math. Statist. 23 (1952) 255–262] for c-optimal designs. As in Elfving’s famous characterization, c-optimal designs can be described as representations of boundary points of a convex set. However, in the case where there appear parameters of interest in the variance, the structure of the Elfving set is different. Roughly speaking, the Elfving set corresponding to a heteroscedastic regression model is the convex hull of a set of ellipsoids induced by the underlying model and indexed by the design space. The c-optimal designs are characterized as representations of the points where the line in direction of the vector c intersects the boundary of the new Elfving set. The theory is illustrated in several examples including pharmacokinetic models with random effects.

Primary Subjects: 62K05
Keywords: c-optimal design; heteroscedastic regression; Elfving’s theorem; pharmacokinetic models; random effects; locally optimal design; geometric characterization

Full-text: Access denied (no subscription detected)

We're sorry, but we are unable to provide you with the full text of this article because we are not able to identify you as a subscriber.
If you have a personal subscription to this journal, then please login. If you are already logged in, then you may need to update your profile to register your subscription. Read more about accessing full-text
Links and Identifiers

Permanent link to this document: http://projecteuclid.org/euclid.aos/1256303537
Digital Object Identifier: doi:10.1214/09-AOS708

References

Atkinson, A. C. (2008). Examples of the use of an equivalence theorem in constructing optimum experimental designs for random-effects nonlinear regression models. J. Statist. Plann. Inference 138 2595–2606.
Mathematical Reviews (MathSciNet): MR2439971
Zentralblatt MATH: 1141.62059
Digital Object Identifier: doi:10.1016/j.jspi.2008.03.002
Atkinson, A. C. and Cook, R. D. (1995). D-optimum designs for heteroscedastic linear models. J. Amer. Statist. Assoc. 90 204–212.
Mathematical Reviews (MathSciNet): MR1325128
Zentralblatt MATH: 0818.62063
Digital Object Identifier: doi:10.2307/2291144
Atkinson, A. C. and Donev, A. (1992). Optimum Experimental Designs. Clarendon Press, Oxford.
Beatty, D. A. and Pigeorsch, W. W. (1997). Optimal statistical design for toxicokinetic studies. Stat. Methods Med. Res. 6 359–376.
Biedermann, S., Dette, H. and Zhu, W. (2006). Optimal designs for dose-response models with restricted design spaces. J. Amer. Statist. Assoc. 101 747–759.
Mathematical Reviews (MathSciNet): MR2256185
Zentralblatt MATH: 1119.62348
Digital Object Identifier: doi:10.1198/016214505000001087
Box, G. E. P. and Lucas, H. L. (1959). Design of experiments in non-linear situations. Biometrika 46 77–90.
Mathematical Reviews (MathSciNet): MR102155
Zentralblatt MATH: 0086.34803
Brown, L. D. and Wong, W. K. (2000). An algorithmic construction of optimal minimax designs for heteroscedastic linear models. J. Statist. Plann. Inference 85 103–114.
Mathematical Reviews (MathSciNet): MR1759243
Zentralblatt MATH: 0961.62065
Digital Object Identifier: doi:10.1016/S0378-3758(99)00073-7
Cayen, M. and Black, H. (1993). Role of toxicokinetics in dose selection for carcinogenicity studies. In Drug Toxicokinetics (P. Welling and F. de la Iglesia, eds.) 69–83. Dekker, New York.
Chaloner, K. and Verdinelli, I. (1995). Bayesian experimental design: A review. Statist. Sci. 10 273–304.
Mathematical Reviews (MathSciNet): MR1390519
Digital Object Identifier: doi:10.1214/ss/1177009939
Project Euclid: euclid.ss/1177009939
Chernoff, H. (1953). Locally optimal designs for estimating parameters. Ann. Math. Statist. 24 586–602.
Mathematical Reviews (MathSciNet): MR58932
Digital Object Identifier: doi:10.1214/aoms/1177728915
Project Euclid: euclid.aoms/1177728915
Chernoff, H. and Haitovsky, Y. (1990). Locally optimal design for comparing two probabilities from binomial data subject to misclassification. Biometrika 77 797–805.
Mathematical Reviews (MathSciNet): MR1086690
Digital Object Identifier: doi:10.1093/biomet/77.4.797
Dette, H. (1995). Designing of experiments with respect to “standardized” optimality criteria. J. Roy. Statist. Soc. Ser. B 59 97–110.
Mathematical Reviews (MathSciNet): MR1436556
Digital Object Identifier: doi:10.1111/1467-9868.00056
Dette, H., Bretz, F., Pepelyshev, A. and Pinheiro, J. C. (2008). Optimal designs for dose finding studies. J. Amer. Statist. Assoc. 103 1225–1237.
Mathematical Reviews (MathSciNet): MR2462895
Digital Object Identifier: doi:10.1198/016214508000000427
Dette, H., Melas, V. B. and Pepelyshev, A. (2004). Optimal designs for a class of nonlinear regression models. Ann. Statist. 32 2142–2167.
Mathematical Reviews (MathSciNet): MR2102506
Zentralblatt MATH: 1056.62084
Digital Object Identifier: doi:10.1214/009053604000000382
Project Euclid: euclid.aos/1098883785
Elfving, G. (1952). Optimal allocation in linear regression theory. Ann. Math. Statist. 23 255–262.
Mathematical Reviews (MathSciNet): MR47998
Digital Object Identifier: doi:10.1214/aoms/1177729442
Project Euclid: euclid.aoms/1177729442
Ette, E., Kelman, A., Howie, C. and Whiting, B. (1995). Analysis of animal pharmacokinetic data: Performance of the one point per animal design. J. Pharmacokinet. Biopharm. 23 551–566.
Fan, S. K. and Chaloner, K. (2003). A geometric method for singular c-optimal designs. J. Statist. Plann. Inference 113 249–257.
Mathematical Reviews (MathSciNet): MR1963044
Zentralblatt MATH: 1033.62073
Digital Object Identifier: doi:10.1016/S0378-3758(01)00289-0
Fang, Z. and Wiens, D. P. (2000). Integer-valued, minimax robust designs for estimation and extrapolation in heteroscedastic, approximately linear models. J. Amer. Statist. Assoc. 95 807–818.
Mathematical Reviews (MathSciNet): MR1803879
Zentralblatt MATH: 0995.62068
Digital Object Identifier: doi:10.2307/2669464
Fellmann, J. (1999). Gustav Elfving’s contribution to the emergence of the optimal experimental design theory. Statist. Sci. 14 197–200.
Mathematical Reviews (MathSciNet): MR1722070
Digital Object Identifier: doi:10.1214/ss/1009212245
Project Euclid: euclid.ss/1009212245
Ford, I., Torsney, B. and Wu, C. F. J. (1992). The use of canonical form in the construction of locally optimum designs for nonlinear problems. J. Roy. Statist. Soc. Ser. B 54 569–583.
Mathematical Reviews (MathSciNet): MR1160483
Haines, L. M. (1993). Optimal design for nonlinear regression models. Comm. Statist. Theory Methods 22 1613–1627.
Haines, L. M. (1995). A geometric approach to optimal design for one-parameter non-linear models. J. Roy. Statist. Soc. Ser. B 57 575–598.
Mathematical Reviews (MathSciNet): MR1341325
Han, C. and Chaloner, K. (2003). D- and c-optimal designs for exponential regression models used in pharmacokinetics and viral dynamics. J. Statist. Plann. Inference 115 585–601.
Mathematical Reviews (MathSciNet): MR1985885
Zentralblatt MATH: 1016.62088
Digital Object Identifier: doi:10.1016/S0378-3758(02)00175-1
Jennrich, R. I. (1969). Asymptotic properties of non-linear least squares estimators. Ann. Math. Statist. 40 633–643.
Mathematical Reviews (MathSciNet): MR238419
Digital Object Identifier: doi:10.1214/aoms/1177697731
Project Euclid: euclid.aoms/1177697731
King, J. and Wong, W. K. (1998). Optimal minimax designs for prediction in heteroscedastic models. J. Statist. Plann. Inference 69 371–383.
Mathematical Reviews (MathSciNet): MR1631356
Zentralblatt MATH: 0938.62078
Digital Object Identifier: doi:10.1016/S0378-3758(97)00167-5
López-Fidalgo, J. and Wong, W. K. (2002). Design issues for the Michaelis−Menten model. J. Theoret. Biol. 215 1–11.
Montepiedra, G. and Wong, W. K. (2001). A new design criterion when heteroscedasticity is ignored. Ann. Inst. Statist. Math. 53 418–426.
Mathematical Reviews (MathSciNet): MR1841145
Zentralblatt MATH: 1027.62059
Digital Object Identifier: doi:10.1023/A:1012435125788
Müller, C. H. and Pázman, A. (1998). Applications of necessary and sufficient conditions for maximum efficient designs. Metrika 48 1–19.
Ortiz, I. and Rodríguez, C. (1998). Optimal designs with respect to Elfving’s partial minimax criterion for heteroscedastic polynomial regression. Test 7 347–360.
Pázman, A. and Pronzato, L. (2009). Asymptotic normality of nonlinear least squares under singular experimental designs. In Optimal Design and Related Areas in Optimization and Statistics. Springer, Heidelberg.
Pukelsheim, F. (1981). On c-optimal design measures. Math. Operationsforsch. Statist. Ser. Statist. 12 13–20.
Mathematical Reviews (MathSciNet): MR607951
Zentralblatt MATH: 0481.62057
Pukelsheim, F. (1993). Optimal Design of Experiments. Wiley, New York.
Mathematical Reviews (MathSciNet): MR1211416
Pukelsheim, F. and Rieder, S. (1992). Efficient rounding of approximate designs. Biometrika 79 763–770.
Mathematical Reviews (MathSciNet): MR1209476
Digital Object Identifier: doi:10.1093/biomet/79.4.763
Randall, T., Donev, A. and Atkinson, A. C. (2007). Optimum Experimental Designs, with SAS. Oxford Univ. Press.
Mathematical Reviews (MathSciNet): MR2323647
Zentralblatt MATH: 05162229
Ratkowsky, D. A. (1983). Nonlinear Regression Modeling: A Unified Practical Approach. Dekker, New York.
Zentralblatt MATH: 0572.62054
Ratkowsky, D. A. (1990). Handbook of Nonlinear Regression Models. Dekker, New York.
Zentralblatt MATH: 0705.62060
Retout, S. and Mentré, F. (2003). Further developments of the fisher information matrix in nonlinear mixed-effects models with evaluation in population pharmacokinetics. J. Biopharm. Statist. 13 209–227.
Rowland, M. (1993). Clinical Pharmacokinetics: Concepts and Applications. Williams and Wilkins, Baltimore.
Searle, S. R. (1982). Matrix Algebra Useful for Statistics. Wiley, New York.
Mathematical Reviews (MathSciNet): MR670947
Seber, G. A. F. and Wild, C. J. (1989). Nonlinear Regression. Wiley, New York.
Mathematical Reviews (MathSciNet): MR986070
Zentralblatt MATH: 0721.62062
Silvey, S. D. (1980). Optimal Design. Chapman and Hall, London.
Mathematical Reviews (MathSciNet): MR606742
Studden, W. J. (1968). Optimal designs on Tchebycheff points. Ann. Math. Statist. 39 1435–1447.
Mathematical Reviews (MathSciNet): MR231497
Project Euclid: euclid.aoms/1177698123
Studden, W. J. (2005). Elfving’s theorem revisited. J. Statist. Plann. Inference 130 85–94.
Mathematical Reviews (MathSciNet): MR2127757
Zentralblatt MATH: 1058.62063
Digital Object Identifier: doi:10.1016/j.jspi.2003.05.004
Wong, W. K. and Cook, R. D. (1993). Heteroscedastic G-optimal designs. J. Roy. Statist. Soc. 55 871–880.
Mathematical Reviews (MathSciNet): MR1229885

2009 © Institute of Mathematical Statistics