Statistical Testing in Treatment by Replication Designs: Three Options Reconsidered

Sally A Jackson, Dale E. Brashers, Joseph E. Massey

Research output: Contribution to journalArticlepeer-review

Abstract

Burgoon, Hall, and Pfau (1991) offer an empirical comparison of three methods for statistical analysis of treatment by replication experiments involving message variables. Message replications within such designs might be: (1) ignored in the statistical analysis; (2) treated as levels of a fixed effect; or (3) treated as levels of a random effect. Burgoon et al. argue that although the three methods do not differ noticeably in practice, the third method is prone to both alpha-inflation and low power. This paper examines the mathematical relationships among the three methods, specifies the empirical conditions under which they should be expected to yield different conclusions, and reviews evidence pertinent to the status of these conditions within the social influence literature. Contrary to the conclusions of Burgoon et al., there is good reason to expect that the three methods will often produce different results. Although the third method yields low power under certain conditions, under other conditions it is the only method of the three that offers a reasonable test of the treatment main effect.

Original languageEnglish (US)
Pages (from-to)211-227
Number of pages17
JournalCommunication Quarterly
Volume40
Issue number3
DOIs
StatePublished - Jun 1 1992
Externally publishedYes

Keywords

  • Message replication
  • Social influence
  • design choices
  • mathematical relationships

ASJC Scopus subject areas

  • Communication

Fingerprint

Dive into the research topics of 'Statistical Testing in Treatment by Replication Designs: Three Options Reconsidered'. Together they form a unique fingerprint.

Cite this