The script concordance test in radiation oncology: validation study of a new tool to assess clinical reasoning.
BACKGROUND
The Script Concordance test (SCT) is a reliable and valid tool to evaluate clinical reasoning in complex situations where experts' opinions may be divided. Scores reflect the degree of concordance between the performance of examinees and that of a reference panel of experienced physicians. The purpose of this study is to demonstrate SCT's usefulness in radiation oncology.


METHODS
A 90 items radiation oncology SCT was administered to 155 participants. Three levels of experience were tested: medical students (n = 70), radiation oncology residents (n = 38) and radiation oncologists (n = 47). Statistical tests were performed to assess reliability and to document validity.


RESULTS
After item optimization, the test comprised 30 cases and 70 questions. Cronbach alpha was 0.90. Mean scores were 51.62 (+/- 8.19) for students, 71.20 (+/- 9.45) for residents and 76.67 (+/- 6.14) for radiation oncologists. The difference between the three groups was statistically significant when compared by the Kruskall-Wallis test (p < 0.001).


CONCLUSIONS
The SCT is reliable and useful to discriminate among participants according to their level of experience in radiation oncology. It appears as a useful tool to document the progression of reasoning during residency training.
Lambert
Carole
C
CPASS, Faculty of Medicine, University of Montreal, CP 6128, Succursale Centre-Ville, Montreal, Quebec, H3C 3J7, Canada. carole.lambert.chum@ssss.gouv.qc.ca
Gagnon
Robert
R
Nguyen
David
D
Charlin
Bernard
B
D001943:Breast Neoplasms / Q000532:radiotherapy; D002983:Clinical Competence; D003657:Decision Making; D004502:Education, Medical, Continuing / Q000706:statistics & numerical data; D004521:Educational Measurement / Q000379:methods*; D006801:Humans; D007396:Internship and Residency; D008175:Lung Neoplasms / Q000532:radiotherapy; D011340:Problem Solving; D018787:Radiation Oncology / Q000193:education / Q000379:methods*; D015203:Reproducibility of Results; D012107:Research Design; D013337:Students, Medical / Q000706:statistics & numerical data; D011795:Surveys and Questionnaires; D014571:Urologic Neoplasms / Q000532:radiotherapy