Resumen de A relative relevance approach to refine inconsistent peer- and self-assessment scores in teamwork assessment
This study proposes an extended approach to refine inconsistent peer- and self-assessment scores in teamwork assessment.These refined scores are commonly used to estimate individual contribution factors, also referred in some literature asindividual weighting factors. The individual contribution factors are then multiplied by team mark to convert team markinto individual marks, provided the scores are valid (the degree to which the scores measure the true contributions) andreliable (the extent to which the scores are consistent). However, not all peer- and self-assessment scores are valid andreliable. Although the validity is as equally, if not more, important as reliability, this study focuses on the reliability.Anecdotal and literature evidence suggests that there are several cases of inconsistencies in students’ peer- and self-assessment scores. Creative accounting scores (over-rating to self and under-rating to peers) by some minority teammembers are commonly encountered cases of inconsistencies, which are addressed by the proposed extension. To discussthe characteristics of the extended approach, mathematical equations and computations are presented and discussed withthe help of typical inconsistent peer- and self-assessment scores. The analysis clearly shows that relative relevance approachbased on standard normal probability can be a viable option in order to refine creative accounting cases of inconsistencies.
