Examination of the effectiveness of a criteria-based team formation tool

Albatool A. Alamri, Brian P Bailey

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this Research Work in Progress Paper, we examine the effectiveness of CATME, a tool that implements a criteria-based team formation approach. The tool facilitates forming teams based on criteria like demographics, skills, and work styles. This information is collected from the students via an online survey. The effectiveness of this genre of tool depends on the practicality of the instructor's configuration of the criteria, the veracity of students' responses to the survey, and the soundness of the algorithm. In this work-in-progress paper, we investigate potential issues affecting these factors. Our study was conducted by performing new analysis of data collected from a prior study comparing the performance of teams formed using CATME or randomly in a user interface design course. The performance of teams was not statistically different between the two conditions. In examining the students' responses to the team formation survey, we found issues related to Self-Assessment such as inconsistencies between students' ratings of their skills and reporting of their strongest skills. Likewise, we found some cases where the tool produced unexpected results when calculating the homogeneity of the skills of a team. Implications for instructors to mitigate these problems are discussed.

Original languageEnglish (US)
Title of host publicationFrontiers in Education
Subtitle of host publicationFostering Innovation Through Diversity, FIE 2018 - Conference Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781538611739
DOIs
StatePublished - Mar 4 2019
Event48th Frontiers in Education Conference, FIE 2018 - San Jose, United States
Duration: Oct 3 2018Oct 6 2018

Publication series

NameProceedings - Frontiers in Education Conference, FIE
Volume2018-October
ISSN (Print)1539-4565

Conference

Conference48th Frontiers in Education Conference, FIE 2018
CountryUnited States
CitySan Jose
Period10/3/1810/6/18

Fingerprint

Students
examination
instructor
student
work style
User interfaces
self-assessment
user interface
online survey
performance
genre
rating

Keywords

  • Criteria-based approach
  • Student's self-assessment
  • Team formation

ASJC Scopus subject areas

  • Software
  • Education
  • Computer Science Applications

Cite this

Alamri, A. A., & Bailey, B. P. (2019). Examination of the effectiveness of a criteria-based team formation tool. In Frontiers in Education: Fostering Innovation Through Diversity, FIE 2018 - Conference Proceedings [8658483] (Proceedings - Frontiers in Education Conference, FIE; Vol. 2018-October). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/FIE.2018.8658483

Examination of the effectiveness of a criteria-based team formation tool. / Alamri, Albatool A.; Bailey, Brian P.

Frontiers in Education: Fostering Innovation Through Diversity, FIE 2018 - Conference Proceedings. Institute of Electrical and Electronics Engineers Inc., 2019. 8658483 (Proceedings - Frontiers in Education Conference, FIE; Vol. 2018-October).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Alamri, AA & Bailey, BP 2019, Examination of the effectiveness of a criteria-based team formation tool. in Frontiers in Education: Fostering Innovation Through Diversity, FIE 2018 - Conference Proceedings., 8658483, Proceedings - Frontiers in Education Conference, FIE, vol. 2018-October, Institute of Electrical and Electronics Engineers Inc., 48th Frontiers in Education Conference, FIE 2018, San Jose, United States, 10/3/18. https://doi.org/10.1109/FIE.2018.8658483
Alamri AA, Bailey BP. Examination of the effectiveness of a criteria-based team formation tool. In Frontiers in Education: Fostering Innovation Through Diversity, FIE 2018 - Conference Proceedings. Institute of Electrical and Electronics Engineers Inc. 2019. 8658483. (Proceedings - Frontiers in Education Conference, FIE). https://doi.org/10.1109/FIE.2018.8658483
Alamri, Albatool A. ; Bailey, Brian P. / Examination of the effectiveness of a criteria-based team formation tool. Frontiers in Education: Fostering Innovation Through Diversity, FIE 2018 - Conference Proceedings. Institute of Electrical and Electronics Engineers Inc., 2019. (Proceedings - Frontiers in Education Conference, FIE).
@inproceedings{fdb6d13bef15496796f3a94b1f4e9839,
title = "Examination of the effectiveness of a criteria-based team formation tool",
abstract = "In this Research Work in Progress Paper, we examine the effectiveness of CATME, a tool that implements a criteria-based team formation approach. The tool facilitates forming teams based on criteria like demographics, skills, and work styles. This information is collected from the students via an online survey. The effectiveness of this genre of tool depends on the practicality of the instructor's configuration of the criteria, the veracity of students' responses to the survey, and the soundness of the algorithm. In this work-in-progress paper, we investigate potential issues affecting these factors. Our study was conducted by performing new analysis of data collected from a prior study comparing the performance of teams formed using CATME or randomly in a user interface design course. The performance of teams was not statistically different between the two conditions. In examining the students' responses to the team formation survey, we found issues related to Self-Assessment such as inconsistencies between students' ratings of their skills and reporting of their strongest skills. Likewise, we found some cases where the tool produced unexpected results when calculating the homogeneity of the skills of a team. Implications for instructors to mitigate these problems are discussed.",
keywords = "Criteria-based approach, Student's self-assessment, Team formation",
author = "Alamri, {Albatool A.} and Bailey, {Brian P}",
year = "2019",
month = "3",
day = "4",
doi = "10.1109/FIE.2018.8658483",
language = "English (US)",
series = "Proceedings - Frontiers in Education Conference, FIE",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
booktitle = "Frontiers in Education",
address = "United States",

}

TY - GEN

T1 - Examination of the effectiveness of a criteria-based team formation tool

AU - Alamri, Albatool A.

AU - Bailey, Brian P

PY - 2019/3/4

Y1 - 2019/3/4

N2 - In this Research Work in Progress Paper, we examine the effectiveness of CATME, a tool that implements a criteria-based team formation approach. The tool facilitates forming teams based on criteria like demographics, skills, and work styles. This information is collected from the students via an online survey. The effectiveness of this genre of tool depends on the practicality of the instructor's configuration of the criteria, the veracity of students' responses to the survey, and the soundness of the algorithm. In this work-in-progress paper, we investigate potential issues affecting these factors. Our study was conducted by performing new analysis of data collected from a prior study comparing the performance of teams formed using CATME or randomly in a user interface design course. The performance of teams was not statistically different between the two conditions. In examining the students' responses to the team formation survey, we found issues related to Self-Assessment such as inconsistencies between students' ratings of their skills and reporting of their strongest skills. Likewise, we found some cases where the tool produced unexpected results when calculating the homogeneity of the skills of a team. Implications for instructors to mitigate these problems are discussed.

AB - In this Research Work in Progress Paper, we examine the effectiveness of CATME, a tool that implements a criteria-based team formation approach. The tool facilitates forming teams based on criteria like demographics, skills, and work styles. This information is collected from the students via an online survey. The effectiveness of this genre of tool depends on the practicality of the instructor's configuration of the criteria, the veracity of students' responses to the survey, and the soundness of the algorithm. In this work-in-progress paper, we investigate potential issues affecting these factors. Our study was conducted by performing new analysis of data collected from a prior study comparing the performance of teams formed using CATME or randomly in a user interface design course. The performance of teams was not statistically different between the two conditions. In examining the students' responses to the team formation survey, we found issues related to Self-Assessment such as inconsistencies between students' ratings of their skills and reporting of their strongest skills. Likewise, we found some cases where the tool produced unexpected results when calculating the homogeneity of the skills of a team. Implications for instructors to mitigate these problems are discussed.

KW - Criteria-based approach

KW - Student's self-assessment

KW - Team formation

UR - http://www.scopus.com/inward/record.url?scp=85063523912&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85063523912&partnerID=8YFLogxK

U2 - 10.1109/FIE.2018.8658483

DO - 10.1109/FIE.2018.8658483

M3 - Conference contribution

AN - SCOPUS:85063523912

T3 - Proceedings - Frontiers in Education Conference, FIE

BT - Frontiers in Education

PB - Institute of Electrical and Electronics Engineers Inc.

ER -