A nonparametric technique for analysis of state-trace functions

Aaron S Benjamin, Michael L. Griffin, Jeffrey A Douglas

Research output: Contribution to journalArticle

Abstract

State-trace analysis provides a direct and transparent way of evaluating a question that is central to many studies of cognitive function: do one or two latent processes underlie performance on a particular task? This evaluation is made using a state-trace plot, which is a bivariate plot of two dependent variables over a dimensional variable that provides the basis for the hypothesized dissociation, and a trace variable, which enables the examination over a range of levels of performance. State-trace analysis has been used successfully in research on perception (Mccarley & Grant, 2008), attention (Verhaeghen & Cerella, 2002), memory (Dunn, 2008), and categorization (Newell, Dunn, & Kalish, 2010). However, inferential techniques for evaluating whether a given state-trace plot yields evidence for one versus two latent processes have only recently started to appear in the literature. Here we develop PIRST (Permuted Isotonic Regression for State-Trace), a fully nonparametric algorithm based on isotonic regression that can be applied to a state-trace plot and used to characterize the amount of evidence in support of one hypothesis or the other. The technique is benchmarked using simulated data, and is shown to recover the true underlying latent structure under conditions of adequate measurement. Finally, we compare PIRST to an extant technique for state-trace analysis (CMR) using ROC analysis and evaluate their respective strengths and weaknesses for diagnosing latent structure.

Original languageEnglish (US)
Pages (from-to)88-99
Number of pages12
JournalJournal of Mathematical Psychology
Volume90
DOIs
StatePublished - Jun 1 2019

Fingerprint

Trace Function
Trace analysis
ROC Curve
Cognition
Trace
Research
Isotonic Regression
Latent Process
Data storage equipment
ROC Analysis
Categorization

ASJC Scopus subject areas

  • Psychology(all)
  • Applied Mathematics

Cite this

A nonparametric technique for analysis of state-trace functions. / Benjamin, Aaron S; Griffin, Michael L.; Douglas, Jeffrey A.

In: Journal of Mathematical Psychology, Vol. 90, 01.06.2019, p. 88-99.

Research output: Contribution to journalArticle

@article{f897190090664ff889f785c113b5dcd3,
title = "A nonparametric technique for analysis of state-trace functions",
abstract = "State-trace analysis provides a direct and transparent way of evaluating a question that is central to many studies of cognitive function: do one or two latent processes underlie performance on a particular task? This evaluation is made using a state-trace plot, which is a bivariate plot of two dependent variables over a dimensional variable that provides the basis for the hypothesized dissociation, and a trace variable, which enables the examination over a range of levels of performance. State-trace analysis has been used successfully in research on perception (Mccarley & Grant, 2008), attention (Verhaeghen & Cerella, 2002), memory (Dunn, 2008), and categorization (Newell, Dunn, & Kalish, 2010). However, inferential techniques for evaluating whether a given state-trace plot yields evidence for one versus two latent processes have only recently started to appear in the literature. Here we develop PIRST (Permuted Isotonic Regression for State-Trace), a fully nonparametric algorithm based on isotonic regression that can be applied to a state-trace plot and used to characterize the amount of evidence in support of one hypothesis or the other. The technique is benchmarked using simulated data, and is shown to recover the true underlying latent structure under conditions of adequate measurement. Finally, we compare PIRST to an extant technique for state-trace analysis (CMR) using ROC analysis and evaluate their respective strengths and weaknesses for diagnosing latent structure.",
author = "Benjamin, {Aaron S} and Griffin, {Michael L.} and Douglas, {Jeffrey A}",
year = "2019",
month = "6",
day = "1",
doi = "10.1016/j.jmp.2019.03.006",
language = "English (US)",
volume = "90",
pages = "88--99",
journal = "Journal of Mathematical Psychology",
issn = "0022-2496",
publisher = "Academic Press Inc.",

}

TY - JOUR

T1 - A nonparametric technique for analysis of state-trace functions

AU - Benjamin, Aaron S

AU - Griffin, Michael L.

AU - Douglas, Jeffrey A

PY - 2019/6/1

Y1 - 2019/6/1

N2 - State-trace analysis provides a direct and transparent way of evaluating a question that is central to many studies of cognitive function: do one or two latent processes underlie performance on a particular task? This evaluation is made using a state-trace plot, which is a bivariate plot of two dependent variables over a dimensional variable that provides the basis for the hypothesized dissociation, and a trace variable, which enables the examination over a range of levels of performance. State-trace analysis has been used successfully in research on perception (Mccarley & Grant, 2008), attention (Verhaeghen & Cerella, 2002), memory (Dunn, 2008), and categorization (Newell, Dunn, & Kalish, 2010). However, inferential techniques for evaluating whether a given state-trace plot yields evidence for one versus two latent processes have only recently started to appear in the literature. Here we develop PIRST (Permuted Isotonic Regression for State-Trace), a fully nonparametric algorithm based on isotonic regression that can be applied to a state-trace plot and used to characterize the amount of evidence in support of one hypothesis or the other. The technique is benchmarked using simulated data, and is shown to recover the true underlying latent structure under conditions of adequate measurement. Finally, we compare PIRST to an extant technique for state-trace analysis (CMR) using ROC analysis and evaluate their respective strengths and weaknesses for diagnosing latent structure.

AB - State-trace analysis provides a direct and transparent way of evaluating a question that is central to many studies of cognitive function: do one or two latent processes underlie performance on a particular task? This evaluation is made using a state-trace plot, which is a bivariate plot of two dependent variables over a dimensional variable that provides the basis for the hypothesized dissociation, and a trace variable, which enables the examination over a range of levels of performance. State-trace analysis has been used successfully in research on perception (Mccarley & Grant, 2008), attention (Verhaeghen & Cerella, 2002), memory (Dunn, 2008), and categorization (Newell, Dunn, & Kalish, 2010). However, inferential techniques for evaluating whether a given state-trace plot yields evidence for one versus two latent processes have only recently started to appear in the literature. Here we develop PIRST (Permuted Isotonic Regression for State-Trace), a fully nonparametric algorithm based on isotonic regression that can be applied to a state-trace plot and used to characterize the amount of evidence in support of one hypothesis or the other. The technique is benchmarked using simulated data, and is shown to recover the true underlying latent structure under conditions of adequate measurement. Finally, we compare PIRST to an extant technique for state-trace analysis (CMR) using ROC analysis and evaluate their respective strengths and weaknesses for diagnosing latent structure.

UR - http://www.scopus.com/inward/record.url?scp=85064317502&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85064317502&partnerID=8YFLogxK

U2 - 10.1016/j.jmp.2019.03.006

DO - 10.1016/j.jmp.2019.03.006

M3 - Article

VL - 90

SP - 88

EP - 99

JO - Journal of Mathematical Psychology

JF - Journal of Mathematical Psychology

SN - 0022-2496

ER -