TY - JOUR
T1 - Psychometric Evaluation of the Cybersecurity Concept Inventory
AU - Poulsen, Seth
AU - Herman, Geoffrey L.
AU - Peterson, Peter A.H.
AU - Golaszewski, Enis
AU - Gorti, Akshita
AU - Oliva, Linda
AU - Scheponik, Travis
AU - Sherman, Alan T.
N1 - Support for this research was provided in part by the U.S. Department of Defense under CAE-R grants H98230-15-1-0294, H98230-15-1-0273, H98230-17-1-0349, H98230-17-1-0347; and by the National Science Foundation under UMBC SFS grants DGE-1241576, 1753681, and SFS Capacity Grants DGE-1819521, 1820531. Authors’ addresses: S. Poulsen and G. L. Herman, University of Illinois at Urbana-Champaign 3213 Siebel Center, 201 N. Goodwin Ave., Urbana, IL 61801; emails: {sethp3, glherman}@illinois.edu; P. A. H. Peterson, University of Minnesota Duluth 329 Heller Hall 1114 Kirby Dr. Duluth, MN 55812; email: [email protected]; E. Golaszewski, A. Gorti, L. Oliva, T. Scheponik, and A. T. Sherman, University of Maryland, CSEE Dept, UMBC, ITE Building, 1000 Hilltop Circle Baltimore, MD 21250 USA; emails: [email protected], [email protected], {oliva, tshep1, sherman}@umbc.edu. Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]. © 2021 Copyright held by the owner/author(s). Publication rights licensed to ACM. 1946-6226/2021/10-ART6 $15.00 https://doi.org/10.1145/3451346
Support for this research was provided in part by the U.S. Department of Defense under CAE-R grants H98230-15-1-0294, H98230-15-1-0273, H98230-17-1-0349, H98230-17-1-0347; and by the National Science Foundation under UMBC SFS grants DGE-1241576, 1753681, and SFS Capacity Grants DGE-1819521, 1820531. We thank the many people who contributed to the CATS project as Delphi experts, interview subjects, Hackathon participants, expert reviewers, student subjects, and former team members, including Michael Neary, Spencer Offenberger, Geet Parekh, Konstantinos Patsourakos, Dhananjay Phatak, and Julia Thompson.
PY - 2022/3
Y1 - 2022/3
N2 - We present a psychometric evaluation of a revised version of the Cybersecurity Concept Inventory (CCI), completed by 354 students from 29 colleges and universities. The CCI is a conceptual test of understanding created to enable research on instruction quality in cybersecurity education. This work extends previous expert review and small-scale pilot testing of the CCI. Results show that the CCI aligns with a curriculum many instructors expect from an introductory cybersecurity course, and that it is a valid and reliable tool for assessing what conceptual cybersecurity knowledge students learned.
AB - We present a psychometric evaluation of a revised version of the Cybersecurity Concept Inventory (CCI), completed by 354 students from 29 colleges and universities. The CCI is a conceptual test of understanding created to enable research on instruction quality in cybersecurity education. This work extends previous expert review and small-scale pilot testing of the CCI. Results show that the CCI aligns with a curriculum many instructors expect from an introductory cybersecurity course, and that it is a valid and reliable tool for assessing what conceptual cybersecurity knowledge students learned.
KW - Classical Test Theory (CTT)
KW - Cybersecurity Assessment Tools (CATS)
KW - Cybersecurity Concept Inventory (CCI)
KW - Item Response Theory (IRT)
KW - concept inventories
KW - cybersecurity education
KW - psychometric evaluation
UR - https://www.scopus.com/pages/publications/105030653857
UR - https://www.scopus.com/pages/publications/105030653857#tab=citedBy
U2 - 10.1145/3451346
DO - 10.1145/3451346
M3 - Article
AN - SCOPUS:105030653857
SN - 1946-6226
VL - 22
JO - ACM Transactions on Computing Education
JF - ACM Transactions on Computing Education
IS - 1
M1 - 3451346
ER -