Electronic Journal of Statistics

Partial martingale difference correlation

Trevor Park, Xiaofeng Shao, and Shun Yao

Full-text: Open access

Enhanced PDF (306 KB)

Abstract

We introduce the partial martingale difference correlation, a scalar-valued measure of conditional mean dependence of $Y$ given $X$, adjusting for the nonlinear dependence on $Z$, where $X$, $Y$ and $Z$ are random vectors of arbitrary dimensions. At the population level, partial martingale difference correlation is a natural extension of partial distance correlation developed recently by Székely and Rizzo [14], which characterizes the dependence of $Y$ and $X$, after controlling for the nonlinear effect of $Z$. It extends the martingale difference correlation first introduced in Shao and Zhang [10] just as partial distance correlation extends the distance correlation in Székely, Rizzo and Bakirov [13]. Sample partial martingale difference correlation is also defined building on some new results on equivalent expressions of sample martingale difference correlation. Numerical results demonstrate the effectiveness of these new dependence measures in the context of variable selection and dependence testing.

Article information

Source
Electron. J. Statist., Volume 9, Number 1 (2015), 1492-1517.

Dates
Received: February 2015
First available in Project Euclid: 7 July 2015

Permanent link to this document
https://projecteuclid.org/euclid.ejs/1436277595

Digital Object Identifier
doi:10.1214/15-EJS1047

Mathematical Reviews number (MathSciNet)
MR3367668

Zentralblatt MATH identifier
1329.62272

Keywords
Distance correlation nonlinear dependence partial correlation variable selection

Citation

Park, Trevor; Shao, Xiaofeng; Yao, Shun. Partial martingale difference correlation. Electron. J. Statist. 9 (2015), no. 1, 1492--1517. doi:10.1214/15-EJS1047. https://projecteuclid.org/euclid.ejs/1436277595


Export citation

References

  • [1] Cook, R. D. and Li, B. (2002). Dimension reduction for conditional mean in regression., Annals of Statistics, 30, 455–474.
    Mathematical Reviews (MathSciNet): MR1902895
    Zentralblatt MATH: 1012.62035
    Digital Object Identifier: doi:10.1214/aos/1021379861
    Project Euclid: euclid.aos/1021379861
  • [2] Dueck, J., Edelmann, D., Gneiting, T., and Richards, D. (2014). The affinely invariant distance correlation., Bernoulli, 20, 2305–2330.
    Mathematical Reviews (MathSciNet): MR3263106
    Digital Object Identifier: doi:10.3150/13-BEJ558
    Project Euclid: euclid.bj/1411134461
  • [3] Hastie, T., Tibshirani, R., and Friedman, J. (2009)., Elements of Statistical Learning, 2nd ed, Springer, New York.
    Mathematical Reviews (MathSciNet): MR2722294
  • [4] Kong, J., Klein, B. E. K., Klein, R., Lee, K., and Wahba, G. (2012). Using distance correlation and SS-AVOVA to assess associations of familial relationships, lifestyle factors, diseases, and mortality., Proceeding of the National Academy of Sciences, 109(50), 20352–20357.
  • [5] Legendre, P. (2000). Comparison of permutation methods for the partial correlation and partial Mantel tests., J. Statist. Compu. and Simu., 67, 37–73.
    Mathematical Reviews (MathSciNet): MR1815171
    Zentralblatt MATH: 1146.62355
    Digital Object Identifier: doi:10.1080/00949650008812035
  • [6] Li, G., Li, Y., and Tsai, C.-L. (2014). Quantile correlations and quantile autoregressive modeling., Journal of the American Statistical Association, to appear.
    Mathematical Reviews (MathSciNet): MR3338500
    Digital Object Identifier: doi:10.1080/01621459.2014.892007
  • [7] Li, R., Zhong, W., and Zhu, L. (2012). Feature Screening via Distance Correlation Learning., Journal of the American Statistical Association, 107, 1129–1139.
    Mathematical Reviews (MathSciNet): MR3010900
    Zentralblatt MATH: 1134.62011
    Digital Object Identifier: doi:10.1080/01621459.2012.695654
  • [8] Lyons, R. (2013). Distance covariance in metric spaces., Annals of Probability, 41, 3284–3305.
    Mathematical Reviews (MathSciNet): MR3127883
    Zentralblatt MATH: 1292.62087
    Digital Object Identifier: doi:10.1214/12-AOP803
    Project Euclid: euclid.aop/1378991840
  • [9] Sejdinovick, D., Sriperumbudur, B., Gretton, A., and Fukumizu, K. (2013). Equivalence of distance-based and RKHS-based statistics in hypothesis testing., Annals of Statistics, 41, 2263–2291.
    Mathematical Reviews (MathSciNet): MR3127866
    Zentralblatt MATH: 1281.62117
    Digital Object Identifier: doi:10.1214/13-AOS1140
    Project Euclid: euclid.aos/1383661264
  • [10] Shao, X. and Zhang, J. (2014). Martingale difference correlation and its use in high dimensional variable screening., Journal of the American Statistical Association, 109, 1302–1318.
    Mathematical Reviews (MathSciNet): MR3265698
    Digital Object Identifier: doi:10.1080/01621459.2014.887012
  • [11] Sheng, W. and Yin, X. (2013). Direction estimation in single-index models via distance covariance., Journal of Multivariate Analysis, 122, 148–161.
    Mathematical Reviews (MathSciNet): MR3189314
    Zentralblatt MATH: 1279.62097
    Digital Object Identifier: doi:10.1016/j.jmva.2013.07.003
  • [12] Székely, G. J. and Rizzo, M. L. (2009). Brownian distance covariance., The Annals of Applied Statistics, 3, 1236–1265.
    Mathematical Reviews (MathSciNet): MR2752127
    Digital Object Identifier: doi:10.1214/09-AOAS312
    Project Euclid: euclid.aoas/1267453933
  • [13] Székely, G. J., Rizzo, M. L., and Bakirov, N. K. (2007). Measuring and testing independence by correlation of distances., Annals of Statistics, 35(6), 2769–2794.
    Mathematical Reviews (MathSciNet): MR2382665
    Zentralblatt MATH: 1129.62059
    Digital Object Identifier: doi:10.1214/009053607000000505
    Project Euclid: euclid.aos/1201012979
  • [14] Székely, G. J. and Rizzo, M. L. (2014). Partial distance correlation with methods for dissimilarities., Annals of Statistics, to appear.
    Mathematical Reviews (MathSciNet): MR3269983
    Zentralblatt MATH: 06383654
    Digital Object Identifier: doi:10.1214/14-AOS1255
    Project Euclid: euclid.aos/1413810731
  • [15] Wang, X., Pan, W., Hu, W., Tian, Y., and Zhang, H. (2015). Conditional distance correlation., Journal of the American Statistical Association, to appear.

The Institute of Mathematical Statistics and the Bernoulli Society

Electronic Journal of Statistics

New content alerts

Email RSS ToC RSS Article
  • You have access to this content.
  • You have partial access to this content.
  • You do not have access to this content.
Turn Off MathJax

What is MathJax?

More like this

+ See more