Comparison of visual analysis, non-overlap methods, and effect sizes in the evaluation of parent implemented functional assessment based interventions

Erin E. Barton, Hedda Meadan-Kaplansky, Angel Fettig

Research output: Contribution to journalArticle

Abstract

We used an existing body of research (i.e., parent implemented functional-assessment based interventions) to examine visual analysis features and processes and evaluate the reliability of two frequently used non-overlap indices (NAP & Tau-U) and a novel effect size index—the between-case standardized mean difference (BC-SMD). Results indicated that visual analysis terms and procedures were inconsistently used across studies. Further, there was limited agreement between the non-overlap indices and independent visual analysis. Results regarding the BC-SMD were inconclusive given only 5 of the 15 studies were eligible for analyses for different dependent variables. Our results suggest that visual analysis standards are needed by which single case researchers analyze and report their results. Further, additional research is needed refining SCR effect sizes, which can be used to describe the magnitude of change within and across SCR studies with functional relations.

LanguageEnglish (US)
Pages31-41
Number of pages11
JournalResearch in Developmental Disabilities
Volume85
DOIs
StatePublished - Feb 1 2019

Fingerprint

Research
Research Personnel

Keywords

  • Parent-implemented interventions
  • Single case research’ visual analysis

ASJC Scopus subject areas

  • Developmental and Educational Psychology
  • Clinical Psychology

Cite this

@article{e4949ab8bef04107bf378e71111bde76,
title = "Comparison of visual analysis, non-overlap methods, and effect sizes in the evaluation of parent implemented functional assessment based interventions",
abstract = "We used an existing body of research (i.e., parent implemented functional-assessment based interventions) to examine visual analysis features and processes and evaluate the reliability of two frequently used non-overlap indices (NAP & Tau-U) and a novel effect size index—the between-case standardized mean difference (BC-SMD). Results indicated that visual analysis terms and procedures were inconsistently used across studies. Further, there was limited agreement between the non-overlap indices and independent visual analysis. Results regarding the BC-SMD were inconclusive given only 5 of the 15 studies were eligible for analyses for different dependent variables. Our results suggest that visual analysis standards are needed by which single case researchers analyze and report their results. Further, additional research is needed refining SCR effect sizes, which can be used to describe the magnitude of change within and across SCR studies with functional relations.",
keywords = "Parent-implemented interventions, Single case research’ visual analysis",
author = "Barton, {Erin E.} and Hedda Meadan-Kaplansky and Angel Fettig",
year = "2019",
month = "2",
day = "1",
doi = "10.1016/j.ridd.2018.11.001",
language = "English (US)",
volume = "85",
pages = "31--41",
journal = "Research in Developmental Disabilities",
issn = "0891-4222",
publisher = "Elsevier Inc.",

}

TY - JOUR

T1 - Comparison of visual analysis, non-overlap methods, and effect sizes in the evaluation of parent implemented functional assessment based interventions

AU - Barton, Erin E.

AU - Meadan-Kaplansky, Hedda

AU - Fettig, Angel

PY - 2019/2/1

Y1 - 2019/2/1

N2 - We used an existing body of research (i.e., parent implemented functional-assessment based interventions) to examine visual analysis features and processes and evaluate the reliability of two frequently used non-overlap indices (NAP & Tau-U) and a novel effect size index—the between-case standardized mean difference (BC-SMD). Results indicated that visual analysis terms and procedures were inconsistently used across studies. Further, there was limited agreement between the non-overlap indices and independent visual analysis. Results regarding the BC-SMD were inconclusive given only 5 of the 15 studies were eligible for analyses for different dependent variables. Our results suggest that visual analysis standards are needed by which single case researchers analyze and report their results. Further, additional research is needed refining SCR effect sizes, which can be used to describe the magnitude of change within and across SCR studies with functional relations.

AB - We used an existing body of research (i.e., parent implemented functional-assessment based interventions) to examine visual analysis features and processes and evaluate the reliability of two frequently used non-overlap indices (NAP & Tau-U) and a novel effect size index—the between-case standardized mean difference (BC-SMD). Results indicated that visual analysis terms and procedures were inconsistently used across studies. Further, there was limited agreement between the non-overlap indices and independent visual analysis. Results regarding the BC-SMD were inconclusive given only 5 of the 15 studies were eligible for analyses for different dependent variables. Our results suggest that visual analysis standards are needed by which single case researchers analyze and report their results. Further, additional research is needed refining SCR effect sizes, which can be used to describe the magnitude of change within and across SCR studies with functional relations.

KW - Parent-implemented interventions

KW - Single case research’ visual analysis

UR - http://www.scopus.com/inward/record.url?scp=85056654560&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85056654560&partnerID=8YFLogxK

U2 - 10.1016/j.ridd.2018.11.001

DO - 10.1016/j.ridd.2018.11.001

M3 - Article

VL - 85

SP - 31

EP - 41

JO - Research in Developmental Disabilities

T2 - Research in Developmental Disabilities

JF - Research in Developmental Disabilities

SN - 0891-4222

ER -