title: An exploratory study into the impact and acceptability of formatively used progress testing in postgraduate obstetrics and gynaecology.
abstract: Part of recent reforms of postgraduate medical training in the Netherlands is the introduction of formatively intended knowledge testing or progress testing. We previously evaluated the construct validity and reliability of postgraduate progress testing. However, when assessment is intended to be formative, the acceptability of the test (scores) and the educational impact that is achieved are at least as important in the utility of this assessment format. We developed a questionnaire targeted at both educational supervisors and postgraduate trainees, containing questions on general acceptability, educational impact and acceptability of test content. 90 % of trainees and 84 % of educational supervisors completed the questionnaire. The general acceptability of formatively used progress testing is good; however, the self-reported educational impact is limited. Furthermore, trainees query the validity of test content. Formatively intended progress testing is well accepted; however the impact is limited. We discuss the importance of feedback quality and the effect of grading. Furthermore we start a debate on whether, for a genuine effect on learning, formative assessment should have consequences, either by entwining the assessment with the training programme or by linking the assessment to a summative standard.
authors.affiliation: Department of Obstetrics and Gynaecology, Amphia Hospital, Langendijk 75, 4918 EV, Breda, the Netherlands. mgk.dijksterhuis@gmail.com.
authors.forename: Marja G K
authors.initials: MGK
authors.lastname: Dijksterhuis
authors.affiliation: Flinders Innovation in Clinical Education, Health Professions Education, School of Medicine Flinders University, Adelaide, SA, Australia.
authors.forename: Lambert W T
authors.initials: LWT
authors.lastname: Schuwirth
authors.affiliation: Department of Obstetrics and Gynaecology, University Medical Center Nijmegen, Nijmegen, the Netherlands.
authors.forename: Didi D M
authors.initials: DDM
authors.lastname: Braat
authors.affiliation: Institute for Medical Education and Training, VU University Medical Centre, Amsterdam, the Netherlands.
authors.forename: Fedde
authors.initials: F
authors.lastname: Scheele
keywords: Acceptability; Educational impact; Formative assessment; Postgraduate; Progress test