Open Access
December 2014 Equivalence testing for functional data with an application to comparing pulmonary function devices
Colin B. Fogarty, Dylan S. Small
Ann. Appl. Stat. 8(4): 2002-2026 (December 2014). DOI: 10.1214/14-AOAS763
Abstract

Equivalence testing for scalar data has been well addressed in the literature, however, the same cannot be said for functional data. The resultant complexity from maintaining the functional structure of the data, rather than using a scalar transformation to reduce dimensionality, renders the existing literature on equivalence testing inadequate for the desired inference. We propose a framework for equivalence testing for functional data within both the frequentist and Bayesian paradigms. This framework combines extensions of scalar methodologies with new methodology for functional data. Our frequentist hypothesis test extends the Two One-Sided Testing (TOST) procedure for equivalence testing to the functional regime. We conduct this TOST procedure through the use of the nonparametric bootstrap. Our Bayesian methodology employs a functional analysis of variance model, and uses a flexible class of Gaussian Processes for both modeling our data and as prior distributions. Through our analysis, we introduce a model for heteroscedastic variances within a Gaussian Process by modeling variance curves via Log-Gaussian Process priors. We stress the importance of choosing prior distributions that are commensurate with the prior state of knowledge and evidence regarding practical equivalence. We illustrate these testing methods through data from an ongoing method comparison study between two devices for pulmonary function testing. In so doing, we provide not only concrete motivation for equivalence testing for functional data, but also a blueprint for researchers who hope to conduct similar inference.

References

1.

Alberola-Lopez, C. and Martin-Fernandez, M. (2003). A simple test of equality of time series. Signal Process. 83 1343–1348.Alberola-Lopez, C. and Martin-Fernandez, M. (2003). A simple test of equality of time series. Signal Process. 83 1343–1348.

2.

Anderson, S. and Hauck, W. W. (1990). Consideration of individual bioequivalence. Journal of Pharmacokinetics and Pharmacodynamics 18 259–273.Anderson, S. and Hauck, W. W. (1990). Consideration of individual bioequivalence. Journal of Pharmacokinetics and Pharmacodynamics 18 259–273.

3.

Barnard, J., McCulloch, R. and Meng, X.-L. (2000). Modeling covariance matrices in terms of standard deviations and correlations, with application to shrinkage. Statist. Sinica 10 1281–1311. MR1804544Barnard, J., McCulloch, R. and Meng, X.-L. (2000). Modeling covariance matrices in terms of standard deviations and correlations, with application to shrinkage. Statist. Sinica 10 1281–1311. MR1804544

4.

Behseta, S. and Kass, R. E. (2005). Testing equality of two functions using BARS. Stat. Med. 24 3523–3534. MR2210791 10.1002/sim.2195Behseta, S. and Kass, R. E. (2005). Testing equality of two functions using BARS. Stat. Med. 24 3523–3534. MR2210791 10.1002/sim.2195

5.

Berger, R. L. (1982). Multiparameter hypothesis testing and acceptance sampling. Technometrics 24 295–300. MR687187 10.2307/1267823Berger, R. L. (1982). Multiparameter hypothesis testing and acceptance sampling. Technometrics 24 295–300. MR687187 10.2307/1267823

6.

Berger, R. L. and Hsu, J. C. (1996). Bioequivalence trials, intersection-union tests and equivalence confidence sets. Statist. Sci. 11 283–319. MR1445984 10.1214/ss/1032280304 euclid.ss/1032280304 Berger, R. L. and Hsu, J. C. (1996). Bioequivalence trials, intersection-union tests and equivalence confidence sets. Statist. Sci. 11 283–319. MR1445984 10.1214/ss/1032280304 euclid.ss/1032280304

7.

Brown, L. D., Hwang, J. and Munk, A. (1995). An unbiased test for the bioequivalence problem. Technical report, Cornell Univ., Ithaca, NY.Brown, L. D., Hwang, J. and Munk, A. (1995). An unbiased test for the bioequivalence problem. Technical report, Cornell Univ., Ithaca, NY.

8.

Buja, A. and Rolke, W. (2003). (Re)sampling methods for simultaneous inference with applications to function estimation and functional data. Unpublished manuscript.Buja, A. and Rolke, W. (2003). (Re)sampling methods for simultaneous inference with applications to function estimation and functional data. Unpublished manuscript.

9.

Chambers, R. and Chandra, H. (2013). A random effect block bootstrap for clustered data. J. Comput. Graph. Statist. 22 452–470. MR3173724 10.1080/10618600.2012.681216Chambers, R. and Chandra, H. (2013). A random effect block bootstrap for clustered data. J. Comput. Graph. Statist. 22 452–470. MR3173724 10.1080/10618600.2012.681216

10.

Chen, K. and Müller, H.-G. (2012). Modeling repeated functional observations. J. Amer. Statist. Assoc. 107 1599–1609. MR3036419 10.1080/01621459.2012.734196Chen, K. and Müller, H.-G. (2012). Modeling repeated functional observations. J. Amer. Statist. Assoc. 107 1599–1609. MR3036419 10.1080/01621459.2012.734196

11.

Chow, S.-C. and Liu, J.-P. (1992). On the assessment of variability in bioavailability/bioequivalence studies. Commun. Stat. 21 2591–2607.Chow, S.-C. and Liu, J.-P. (1992). On the assessment of variability in bioavailability/bioequivalence studies. Commun. Stat. 21 2591–2607.

12.

Davison, A. C. and Hinkley, D. V. (1997). Bootstrap Methods and Their Application. Cambridge Series in Statistical and Probabilistic Mathematics 1. Cambridge Univ. Press, Cambridge. MR1478673Davison, A. C. and Hinkley, D. V. (1997). Bootstrap Methods and Their Application. Cambridge Series in Statistical and Probabilistic Mathematics 1. Cambridge Univ. Press, Cambridge. MR1478673

13.

Efron, B. and Tibshirani, R. J. (1993). An Introduction to the Bootstrap. Monographs on Statistics and Applied Probability 57. Chapman & Hall, New York. MR1270903Efron, B. and Tibshirani, R. J. (1993). An Introduction to the Bootstrap. Monographs on Statistics and Applied Probability 57. Chapman & Hall, New York. MR1270903

14.

Fogarty, C. B. and Small, D. S. (2014). Supplement to “Equivalence testing for functional data with an application to comparing pulmonary function devices.”  DOI:10.1214/14-AOAS763SUPPMR3292487 10.1214/14-AOAS763 euclid.aoas/1419001733 Fogarty, C. B. and Small, D. S. (2014). Supplement to “Equivalence testing for functional data with an application to comparing pulmonary function devices.”  DOI:10.1214/14-AOAS763SUPPMR3292487 10.1214/14-AOAS763 euclid.aoas/1419001733

15.

Fuentes, M. (2002). Spectral methods for nonstationary spatial processes. Biometrika 89 197–210. MR1888368 10.1093/biomet/89.1.197Fuentes, M. (2002). Spectral methods for nonstationary spatial processes. Biometrika 89 197–210. MR1888368 10.1093/biomet/89.1.197

16.

Fuentes, M. and Smith, R. L. (2001). A new class of nonstationary spatial models. Technical report, North Carolina State Univ., Raleigh, NC.Fuentes, M. and Smith, R. L. (2001). A new class of nonstationary spatial models. Technical report, North Carolina State Univ., Raleigh, NC.

17.

Goudsouzian, N. G. and Karamanian, A. (1984). Physiology for the Anesthesiologist, 2nd ed. Appleton-Century-Crofts, Norwalk, CT.Goudsouzian, N. G. and Karamanian, A. (1984). Physiology for the Anesthesiologist, 2nd ed. Appleton-Century-Crofts, Norwalk, CT.

18.

Jeffreys, H. (1961). Theory of Probability, 3rd ed. Clarendon, Oxford. MR187257Jeffreys, H. (1961). Theory of Probability, 3rd ed. Clarendon, Oxford. MR187257

19.

Kass, R. E. and Raftery, A. E. (1995). Bayes factors. J. Amer. Statist. Assoc. 90 773–795.Kass, R. E. and Raftery, A. E. (1995). Bayes factors. J. Amer. Statist. Assoc. 90 773–795.

20.

Kaufman, C. G. and Sain, S. R. (2010). Bayesian functional ANOVA modeling using Gaussian process prior distributions. Bayesian Anal. 5 123–149. MR2596438 10.1214/10-BA505 euclid.ba/1340369795 Kaufman, C. G. and Sain, S. R. (2010). Bayesian functional ANOVA modeling using Gaussian process prior distributions. Bayesian Anal. 5 123–149. MR2596438 10.1214/10-BA505 euclid.ba/1340369795

21.

Matérn, B. (1986). Spatial Variation, 2nd ed. Lecture Notes in Statistics 36. Springer, Berlin. MR867886Matérn, B. (1986). Spatial Variation, 2nd ed. Lecture Notes in Statistics 36. Springer, Berlin. MR867886

22.

Morris, J. S. and Carroll, R. J. (2006). Wavelet-based functional mixed models. J. R. Stat. Soc. Ser. B Stat. Methodol. 68 179–199. MR2188981 10.1111/j.1467-9868.2006.00539.xMorris, J. S. and Carroll, R. J. (2006). Wavelet-based functional mixed models. J. R. Stat. Soc. Ser. B Stat. Methodol. 68 179–199. MR2188981 10.1111/j.1467-9868.2006.00539.x

23.

Nychka, D., Wikle, C. and Royle, J. A. (2002). Multiresolution models for nonstationary spatial covariance functions. Stat. Model. 2 315–331. MR1951588 10.1191/1471082x02st037oaNychka, D., Wikle, C. and Royle, J. A. (2002). Multiresolution models for nonstationary spatial covariance functions. Stat. Model. 2 315–331. MR1951588 10.1191/1471082x02st037oa

24.

Paciorek, C. J. and Schervish, M. J. (2006). Spatial modelling using a new class of nonstationary covariance functions. Environmetrics 17 483–506. MR2240939 10.1002/env.785Paciorek, C. J. and Schervish, M. J. (2006). Spatial modelling using a new class of nonstationary covariance functions. Environmetrics 17 483–506. MR2240939 10.1002/env.785

25.

R Development Core Team (2011). R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna.R Development Core Team (2011). R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna.

26.

Ramsay, J. O. and Silverman, B. W. (2005). Functional Data Analysis, 2nd ed. Springer, New York. MR2168993Ramsay, J. O. and Silverman, B. W. (2005). Functional Data Analysis, 2nd ed. Springer, New York. MR2168993

27.

Searle, S. R., Casella, G. and McCulloch, C. E. (1992). Variance Components. Wiley, New York. MR1190470Searle, S. R., Casella, G. and McCulloch, C. E. (1992). Variance Components. Wiley, New York. MR1190470

28.

Shao, J. and Tu, D. S. (1995). The Jackknife and Bootstrap. Springer, New York. MR1351010Shao, J. and Tu, D. S. (1995). The Jackknife and Bootstrap. Springer, New York. MR1351010

29.

Tibshirani, R. (1988). Variance stabilization and the bootstrap. Biometrika 75 433–444. MR967582 10.1093/biomet/75.3.433Tibshirani, R. (1988). Variance stabilization and the bootstrap. Biometrika 75 433–444. MR967582 10.1093/biomet/75.3.433
Copyright © 2014 Institute of Mathematical Statistics
Colin B. Fogarty and Dylan S. Small "Equivalence testing for functional data with an application to comparing pulmonary function devices," The Annals of Applied Statistics 8(4), 2002-2026, (December 2014). https://doi.org/10.1214/14-AOAS763
Published: December 2014
Vol.8 • No. 4 • December 2014
Back to Top