Understanding and estimating the power to detect cross-level interaction effects in multilevel modeling

John E. Mathieu, Herman Aguinis, Steven A. Culpepper, Gilad Chen

Research output: Contribution to journalArticlepeer-review

Abstract

Cross-level interaction effects lie at the heart of multilevel contingency and interactionism theories. Researchers have often lamented the difficulty of finding hypothesized cross-level interactions, and to date there has been no means by which the statistical power of such tests can be evaluated. We develop such a method and report results of a large-scale simulation study, verify its accuracy, and provide evidence regarding the relative importance of factors that affect the power to detect cross-level interactions. Our results indicate that the statistical power to detect cross-level interactions is determined primarily by the magnitude of the cross-level interaction, the standard deviation of lower level slopes, and the lower and upper level sample sizes. We provide a Monte Carlo tool that enables researchers to a priori design more efficient multilevel studies and provides a means by which they can better interpret potential explanations for nonsignificant results. We conclude with recommendations for how scholars might design future multilevel studies that will lead to more accurate inferences regarding the presence of cross-level interactions.

Original languageEnglish (US)
Pages (from-to)951-966
Number of pages16
JournalJournal of Applied Psychology
Volume97
Issue number5
DOIs
StatePublished - 2012

Keywords

  • Interactionism
  • Interactions
  • Multilevel modeling
  • Power

ASJC Scopus subject areas

  • Applied Psychology
  • Medicine(all)

Fingerprint Dive into the research topics of 'Understanding and estimating the power to detect cross-level interaction effects in multilevel modeling'. Together they form a unique fingerprint.

Cite this