Within-group agreement for multi-item scales: Considering interitem correlations

Daniel A. Newman, Hock Peng Sin

Research output: Contribution to conferencePaperpeer-review

Abstract

Within-group agreement indexes support multilevel research on organizational climate, and are often used as a hurdle to justify aggregating individual-level responses to represent a group-level property. Such agreement indexes are derived from a theoretical model involving a group-level construct true score, with simplifying assumptions placed on the between-rater variance. The current paper comments on the role of these assumptions in traditional within-group agreement estimation, and focuses on one particular assumption made in the derivation of multi-item rwg(J): that internal consistency reliability (Cronbach's alpha) for climate scales is zero (LeBreton, James, & Lindell, 2005). We revisit LeBreton et al.'s derivation of the multi-item rwg agreement index, proposing an alternative set of derivations (and modified rwg agreement index) for use with reliable multi-item scales (where Cronbach's alpha > 0). Our goal is to highlight how the theoretical assumption of uncorrelated items on climate scales influences within-group agreement estimation.

Original languageEnglish (US)
StatePublished - Dec 1 2008
Event68th Annual Meeting of the Academy of Management, AOM 2008 - Anaheim, CA, United States
Duration: Aug 8 2008Aug 13 2008

Other

Other68th Annual Meeting of the Academy of Management, AOM 2008
Country/TerritoryUnited States
CityAnaheim, CA
Period8/8/088/13/08

Keywords

  • Aggregation
  • Multilevel
  • Within-group agreement

ASJC Scopus subject areas

  • Management Information Systems
  • Management of Technology and Innovation

Fingerprint

Dive into the research topics of 'Within-group agreement for multi-item scales: Considering interitem correlations'. Together they form a unique fingerprint.

Cite this