Abstract
In this Research Work in Progress Paper, we examine the effectiveness of CATME, a tool that implements a criteria-based team formation approach. The tool facilitates forming teams based on criteria like demographics, skills, and work styles. This information is collected from the students via an online survey. The effectiveness of this genre of tool depends on the practicality of the instructor's configuration of the criteria, the veracity of students' responses to the survey, and the soundness of the algorithm. In this work-in-progress paper, we investigate potential issues affecting these factors. Our study was conducted by performing new analysis of data collected from a prior study comparing the performance of teams formed using CATME or randomly in a user interface design course. The performance of teams was not statistically different between the two conditions. In examining the students' responses to the team formation survey, we found issues related to Self-Assessment such as inconsistencies between students' ratings of their skills and reporting of their strongest skills. Likewise, we found some cases where the tool produced unexpected results when calculating the homogeneity of the skills of a team. Implications for instructors to mitigate these problems are discussed.
| Original language | English (US) |
|---|---|
| Title of host publication | Frontiers in Education |
| Subtitle of host publication | Fostering Innovation Through Diversity, FIE 2018 - Conference Proceedings |
| Publisher | Institute of Electrical and Electronics Engineers Inc. |
| ISBN (Electronic) | 9781538611739 |
| DOIs | |
| State | Published - Mar 4 2019 |
| Event | 48th Frontiers in Education Conference, FIE 2018 - San Jose, United States Duration: Oct 3 2018 → Oct 6 2018 |
Publication series
| Name | Proceedings - Frontiers in Education Conference, FIE |
|---|---|
| Volume | 2018-October |
| ISSN (Print) | 1539-4565 |
Conference
| Conference | 48th Frontiers in Education Conference, FIE 2018 |
|---|---|
| Country | United States |
| City | San Jose |
| Period | 10/3/18 → 10/6/18 |
Fingerprint
Keywords
- Criteria-based approach
- Student's self-assessment
- Team formation
ASJC Scopus subject areas
- Software
- Education
- Computer Science Applications
Cite this
Examination of the effectiveness of a criteria-based team formation tool. / Alamri, Albatool A.; Bailey, Brian P.
Frontiers in Education: Fostering Innovation Through Diversity, FIE 2018 - Conference Proceedings. Institute of Electrical and Electronics Engineers Inc., 2019. 8658483 (Proceedings - Frontiers in Education Conference, FIE; Vol. 2018-October).Research output: Chapter in Book/Report/Conference proceeding › Conference contribution
}
TY - GEN
T1 - Examination of the effectiveness of a criteria-based team formation tool
AU - Alamri, Albatool A.
AU - Bailey, Brian P
PY - 2019/3/4
Y1 - 2019/3/4
N2 - In this Research Work in Progress Paper, we examine the effectiveness of CATME, a tool that implements a criteria-based team formation approach. The tool facilitates forming teams based on criteria like demographics, skills, and work styles. This information is collected from the students via an online survey. The effectiveness of this genre of tool depends on the practicality of the instructor's configuration of the criteria, the veracity of students' responses to the survey, and the soundness of the algorithm. In this work-in-progress paper, we investigate potential issues affecting these factors. Our study was conducted by performing new analysis of data collected from a prior study comparing the performance of teams formed using CATME or randomly in a user interface design course. The performance of teams was not statistically different between the two conditions. In examining the students' responses to the team formation survey, we found issues related to Self-Assessment such as inconsistencies between students' ratings of their skills and reporting of their strongest skills. Likewise, we found some cases where the tool produced unexpected results when calculating the homogeneity of the skills of a team. Implications for instructors to mitigate these problems are discussed.
AB - In this Research Work in Progress Paper, we examine the effectiveness of CATME, a tool that implements a criteria-based team formation approach. The tool facilitates forming teams based on criteria like demographics, skills, and work styles. This information is collected from the students via an online survey. The effectiveness of this genre of tool depends on the practicality of the instructor's configuration of the criteria, the veracity of students' responses to the survey, and the soundness of the algorithm. In this work-in-progress paper, we investigate potential issues affecting these factors. Our study was conducted by performing new analysis of data collected from a prior study comparing the performance of teams formed using CATME or randomly in a user interface design course. The performance of teams was not statistically different between the two conditions. In examining the students' responses to the team formation survey, we found issues related to Self-Assessment such as inconsistencies between students' ratings of their skills and reporting of their strongest skills. Likewise, we found some cases where the tool produced unexpected results when calculating the homogeneity of the skills of a team. Implications for instructors to mitigate these problems are discussed.
KW - Criteria-based approach
KW - Student's self-assessment
KW - Team formation
UR - http://www.scopus.com/inward/record.url?scp=85063523912&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85063523912&partnerID=8YFLogxK
U2 - 10.1109/FIE.2018.8658483
DO - 10.1109/FIE.2018.8658483
M3 - Conference contribution
AN - SCOPUS:85063523912
T3 - Proceedings - Frontiers in Education Conference, FIE
BT - Frontiers in Education
PB - Institute of Electrical and Electronics Engineers Inc.
ER -