title: Distorted perceptions of competence and incompetence are more than regression effects.
abstract: Students inaccurately assess their own skills, especially high- or low-performers on exams. This study assessed whether regression effects account for this observation. After completing the Infection and Immunity course final exam (IIF), second year medical students (N = 143) estimated their performance on the IIF in terms of percent correct and percentile rank. Second year grade point averages (M2GPAs) were combined with the IIF results to form five subgroups: 1 = true-low (lowest third on both IIF and M2GPA, 2 = false-low (lowest third on IIF only), 3 = middle (neither lowest nor highest third on IIF), 4 = false-high (highest third on IIF only), 5 = true-high (highest third on IIF and M2GPA). The false-low and false-high groups were considered more susceptible to regression effects due to likely group misclassification. Differences between self-assessment and actual performance within each group and between the five groups were used to estimate what portion of observed differences is due to general tendencies versus regression effects. Results found that students accurately assessed their percent correct, but inaccurately assessed their percentile rank. No statistically significant differences existed between the true and false-low subgroups nor the true- and false-high subgroups. Percentages of mean differences suggest that while regression effects resulted in 50-75% over/under-estimates of scores by students who were misclassified, when they were merged with the true-low/high groups, they do not account for more than 14% of low performer over-estimates of their performance and high performer under-estimates of their performance. Accurate percent correct assessments and distorted percentile rank assessments are challenges in using instructional methods dependent on student self-assessments of their learning needs. Identifying and helping students with distorted perceptions of their test performances may be a key issue in such instructional approaches.
authors.affiliation: University of Wisconsin Medical School, 2069, Medical Sciences Center, 1007C WARF, 610 Walnut Street, Madison, WI, 53726-2397, USA. maalbane@wisc.edu
authors.forename: M
authors.initials: M
authors.lastname: Albanese
authors.forename: S
authors.initials: S
authors.lastname: Dottl
authors.forename: G
authors.initials: G
authors.lastname: Mejicano
authors.forename: L
authors.initials: L
authors.lastname: Zakowski
authors.forename: C
authors.initials: C
authors.lastname: Seibert
authors.forename: S
authors.initials: S
authors.lastname: Van Eyck
authors.forename: C
authors.initials: C
authors.lastname: Prucha
mesh_terms: D003627:Data Interpretation, Statistical; D004521:Educational Measurement / Q000379:methods*; D006801:Humans; D010465:Perception; D012647:Self-Assessment; D013337:Students, Medical / Q000523:psychology*