Conditional mean and quantile dependence testing in high dimension

Xianyang Zhang, Shun Yao, Xiaofeng Shao

Research output: Contribution to journalArticle

Abstract

Motivated by applications in biological science, we propose a novel test to assess the conditional mean dependence of a response variable on a large number of covariates. Our procedure is built on the martingale difference divergence recently proposed in Shao and Zhang [J. Amer. Statist. Assoc. 109 (2014) 1302-1318], and it is able to detect certain type of departure from the null hypothesis of conditional mean independence without making any specific model assumptions. Theoretically, we establish the asymptotic normality of the proposed test statistic under suitable assumption on the eigenvalues of a Hermitian operator, which is constructed based on the characteristic function of the covariates. These conditions can be simplified under banded dependence structure on the covariates or Gaussian design. To account for heterogeneity within the data, we further develop a testing procedure for conditional quantile independence at a given quantile level and provide an asymptotic justification. Empirically, our test of conditional mean independence delivers comparable results to the competitor, which was constructed under the linear model framework, when the underlying model is linear. It significantly outperforms the competitor when the conditional mean admits a nonlinear form.

Original languageEnglish (US)
Pages (from-to)219-246
Number of pages28
JournalAnnals of Statistics
Volume46
Issue number1
DOIs
StatePublished - Feb 2018

Keywords

  • Large-p-small-n
  • Martingale difference divergence
  • Simultaneous test
  • U-statistics

ASJC Scopus subject areas

  • Statistics and Probability
  • Statistics, Probability and Uncertainty

Fingerprint Dive into the research topics of 'Conditional mean and quantile dependence testing in high dimension'. Together they form a unique fingerprint.

  • Cite this