TY - GEN
T1 - Initial Validation of the Cybersecurity Concept Inventory
T2 - 49th IEEE Frontiers in Education Conference, FIE 2019
AU - Offenberger, Spencer
AU - Herman, Geoffrey L.
AU - Peterson, Peter
AU - Sherman, Alan T.
AU - Golaszewski, Enis
AU - Scheponik, Travis
AU - Oliva, Linda
N1 - Funding Information:
VII. ACKNOWLEDGMENTS We thank all of the experts and pilot trial participants. This work was supported in part by the U.S. Department of Defense under CAE-R grants H98230-15-1-0294, H98230-15-1-0273, H98230-17-1-0349, and H98230-17-1-0347; and by the National Science Foundation under SFS grant 1241576 and DGE grant 1820531.
Publisher Copyright:
© 2019 IEEE.
PY - 2019/10
Y1 - 2019/10
N2 - We analyze expert review and student performance data to evaluate the validity of the Cybersecurity Concept Inventory (CCI) for assessing student knowledge of core cybersecurity concepts after a first course on the topic. A panel of 12 experts in cybersecurity reviewed the CCI, and 142 students from six different institutions took the CCI as a pilot test. The panel reviewed each item of the CCI and the overwhelming majority rated every item as measuring appropriate cybersecurity knowledge. We administered the CCI to students taking a first cybersecurity course either online or proctored by the course instructor. We applied classical test theory to evaluate the quality of the CCI. This evaluation showed that the CCI is sufficiently reliable for measuring student knowledge of cybersecurity and that the CCI may be too difficult as a whole. We describe the results of the expert review and the pilot test and provide recommendations for the continued improvement of the CCI.
AB - We analyze expert review and student performance data to evaluate the validity of the Cybersecurity Concept Inventory (CCI) for assessing student knowledge of core cybersecurity concepts after a first course on the topic. A panel of 12 experts in cybersecurity reviewed the CCI, and 142 students from six different institutions took the CCI as a pilot test. The panel reviewed each item of the CCI and the overwhelming majority rated every item as measuring appropriate cybersecurity knowledge. We administered the CCI to students taking a first cybersecurity course either online or proctored by the course instructor. We applied classical test theory to evaluate the quality of the CCI. This evaluation showed that the CCI is sufficiently reliable for measuring student knowledge of cybersecurity and that the CCI may be too difficult as a whole. We describe the results of the expert review and the pilot test and provide recommendations for the continued improvement of the CCI.
KW - Cybersecurity Assessment Tools (CATS) Project
KW - Cybersecurity Concept Inventory (CCI)
KW - Cybersecurity education
KW - assessment validation
UR - http://www.scopus.com/inward/record.url?scp=85076112446&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85076112446&partnerID=8YFLogxK
U2 - 10.1109/FIE43999.2019.9028652
DO - 10.1109/FIE43999.2019.9028652
M3 - Conference contribution
AN - SCOPUS:85076112446
T3 - Proceedings - Frontiers in Education Conference, FIE
BT - 2019 IEEE Frontiers in Education Conference, FIE 2019
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 16 October 2019 through 19 October 2019
ER -