TY - GEN
T1 - Exploring Different Specifications Grading Policies
AU - dos Santos Montagner, Igor
AU - Ferrão, Rafael Corsi
AU - Zilles, Craig
AU - Silva, Mariana
N1 - We thank the donors of the Insper-UIUC partnership and Insper Computer Science Program for making this research possible (project \"Adapting immediate feedback and frequent testing to project-based courses\").
PY - 2025/2/18
Y1 - 2025/2/18
N2 - Alternative grading practices, such as specifications grading, have been reported to increase student engagement, decrease instructor workload, and ensure a minimum mastery of all course topics. However, there are also reports of decreased student learning and there have been few comparisons between different policies. In this experience report, we explore the effects of adopting different types of specifications grading systems in a project-based Embedded Systems course taught at a South American institution. We tested three different grading policies for exams in three different course offerings, varying both the number of times mastery needed to be demonstrated and whether exams specified two (pass/fail) or five (I, D, C, B, A) proficiency levels. For each policy, we list potential problems we were trying to address and evaluate how the change impacted the course. We use a mixed-methods approach to do a retrospective analysis, focusing on three aspects: (1) exam attendance and pass rates, (2) grades on labs and projects and, (3) student perceptions. We find that attendance remains high and pass rates increase with the pass/fail model. Also, lab and project grades decrease after students receive a passing grade in the first exam, indicating a possible decrease in engagement with the course. In terms of student perception, students described a mix of procrastination, low engagement with the course, and a desire to learn and create a challenging project. Finally, we discuss how we believe these findings could be used to increase engagement and learning.
AB - Alternative grading practices, such as specifications grading, have been reported to increase student engagement, decrease instructor workload, and ensure a minimum mastery of all course topics. However, there are also reports of decreased student learning and there have been few comparisons between different policies. In this experience report, we explore the effects of adopting different types of specifications grading systems in a project-based Embedded Systems course taught at a South American institution. We tested three different grading policies for exams in three different course offerings, varying both the number of times mastery needed to be demonstrated and whether exams specified two (pass/fail) or five (I, D, C, B, A) proficiency levels. For each policy, we list potential problems we were trying to address and evaluate how the change impacted the course. We use a mixed-methods approach to do a retrospective analysis, focusing on three aspects: (1) exam attendance and pass rates, (2) grades on labs and projects and, (3) student perceptions. We find that attendance remains high and pass rates increase with the pass/fail model. Also, lab and project grades decrease after students receive a passing grade in the first exam, indicating a possible decrease in engagement with the course. In terms of student perception, students described a mix of procrastination, low engagement with the course, and a desire to learn and create a challenging project. Finally, we discuss how we believe these findings could be used to increase engagement and learning.
KW - embedded systems
KW - exams
KW - grading policy
KW - specifications grading
UR - https://www.scopus.com/pages/publications/86000202312
UR - https://www.scopus.com/pages/publications/86000202312#tab=citedBy
U2 - 10.1145/3641554.3701925
DO - 10.1145/3641554.3701925
M3 - Conference contribution
AN - SCOPUS:86000202312
T3 - SIGCSE TS 2025 - Proceedings of the 56th ACM Technical Symposium on Computer Science Education
SP - 276
EP - 282
BT - SIGCSE TS 2025 - Proceedings of the 56th ACM Technical Symposium on Computer Science Education
PB - Association for Computing Machinery
T2 - 56th Annual SIGCSE Technical Symposium on Computer Science Education, SIGCSE TS 2025
Y2 - 26 February 2025 through 1 March 2025
ER -