Covariate balance in simple, stratified and clustered comparative studies

Ben B. Hansen, Jake Bowers

Research output: Contribution to journalArticlepeer-review

Abstract

In randomized experiments, treatment and control groups should be roughly the same - balanced - in their distributions of pretreatment variables. But how nearly so? Can descriptive comparisons meaningfully be paired with significance tests? If so, should there be several such tests, one for each pretreatment variable, or should there be a single, omnibus test? Could such a test be engineered to give easily computed p-values that are reliable in samples of moderate size, or would simulation be needed for reliable calibration? What new concerns are introduced by random assignment of clusters? Which tests of balance would be optimal? To address these questions, Fisher's randomization inference is applied to the question of balance. Its application suggests the reversal of published conclusions about two studies, one clinical and the other a field experiment in political participation.

Original languageEnglish (US)
Pages (from-to)219-236
Number of pages18
JournalStatistical Science
Volume23
Issue number2
DOIs
StatePublished - 2008

Keywords

  • Cluster
  • Community intervention
  • Contiguity
  • Group randomization
  • Randomization inference
  • Subclassiflcation

ASJC Scopus subject areas

  • Statistics and Probability
  • Mathematics(all)
  • Statistics, Probability and Uncertainty

Fingerprint Dive into the research topics of 'Covariate balance in simple, stratified and clustered comparative studies'. Together they form a unique fingerprint.

Cite this