title: Confounding factors in using upward feedback to assess the quality of medical training: a systematic review.
abstract: OBJECTIVE
  Upward feedback is becoming more widely used in medical training as a means of quality control. Multiple biases exist, thus the accuracy of upward feedback is debatable. This study aims to identify factors that could influence upward feedback, especially in medical training.
  
  
  METHODS
  A systematic review using a structured search strategy was performed. Thirty-five databases were searched. Results were reviewed and relevant abstracts were shortlisted. All studies in English, both medical and non-medical literature, were included. A simple pro-forma was used initially to identify the pertinent areas of upward feedback, so that a focused pro-forma could be designed for data extraction.
  
  
  RESULTS
  A total of 204 articles were reviewed. Most studies on upward feedback bias were evaluative studies and only covered Kirkpatrick level 1-reaction. Most studies evaluated trainers or training, were used for formative purposes and presented quantitative data. Accountability and confidentiality were the most common overt biases, whereas method of feedback was the most commonly implied bias within articles.
  
  
  CONCLUSIONS
  Although different types of bias do exist, upward feedback does have a role in evaluating medical training. Accountability and confidentiality were the most common biases. Further research is required to evaluate which types of bias are associated with specific survey characteristics and which are potentially modifiable.
authors.affiliation: Royal Bolton Hospital, Lancashire, United Kingdom.
authors.forename: Anli Yue
authors.identifier: 0000-0003-2402-8289
authors.initials: AY
authors.lastname: Zhou
authors.affiliation: North Western Deanery, Manchester, United Kingdom.
authors.forename: Paul
authors.identifier: 0000-0003-1493-9660
authors.initials: P
authors.lastname: Baker
keywords: Bias; Confidentiality; Feedback; Quality control; Social responsibility
references.citation: J Gen Intern Med. 2007 Jul;22(7):969-75
references.pmid: 17468888
references.citation: Plast Reconstr Surg. 2004 Dec;114(7):1878-86
references.pmid: 15577363
references.citation: Surgery. 2006 Feb;139(2):150-8
references.pmid: 16455322
references.citation: Acad Med. 1993 Feb;68(2 Suppl):S61-3
references.pmid: 8431256
references.citation: Clin Orthop Relat Res. 2007 Jan;454:247-50
references.pmid: 17091017
references.citation: J Gen Intern Med. 2006 May;21(5):447-52
references.pmid: 16704386
references.citation: J Dent Educ. 2006 Apr;70(4):361-77
references.pmid: 16595529
references.citation: Adv Health Sci Educ Theory Pract. 2012 May;17(2):183-94
references.pmid: 20143260
references.citation: Adv Health Sci Educ Theory Pract. 2008 Aug;13(3):275-88
references.pmid: 17091339
references.citation: Med Educ. 2001 Jul;35(7):632-6
references.pmid: 11437964
references.citation: Nurse Educ Today. 2011 Feb;31(2):152-6
references.pmid: 20826043
references.citation: J Med Educ. 1981 Mar;56(3):181-6
references.pmid: 7205919
references.citation: Med Educ. 2001 Aug;35(8):735-42
references.pmid: 11489100
references.citation: J Hosp Med. 2012 May-Jun;7(5):376-81
references.pmid: 22378723
references.citation: Med Educ. 2008 Feb;42(2):214-23
references.pmid: 18230095
references.citation: Arch Surg. 2012 Jun;147(6):536-41
references.pmid: 22786539
references.citation: Med Educ. 1995 May;29(3):193-7
references.pmid: 7623711
references.citation: Clin Med (Lond). 2007 Oct;7(5):486-91
references.pmid: 17990718
references.citation: Eval Rev. 2012 Feb;36(1):72-96
references.pmid: 22505450
references.citation: Eval Health Prof. 1997 Sep;20(3):343-52
references.pmid: 10183328
references.citation: J Chiropr Educ. 2011 Fall;25(2):151-63
references.pmid: 22069340
references.citation: J Surg Educ. 2011 Nov-Dec;68(6):459-64
references.pmid: 22000531
references.citation: Med Educ. 2006 Jan;40(1):79-86
references.pmid: 16441327
references.citation: Med Educ. 1993 Jan;27(1):48-54
references.pmid: 8433660
references.citation: Med Teach. 2010 Jan;32(1):94
references.pmid: 20104666
references.citation: Med Teach. 2009 Apr;31(4):299-318
references.pmid: 19404890
references.citation: J Gen Intern Med. 2006 Jul;21(7):758-63
references.pmid: 16808778
references.citation: J Adv Nurs. 2007 Dec;60(6):615-26
references.pmid: 18039248
references.citation: Med Teach. 2005 Aug;27(5):470-2
references.pmid: 16147804
references.citation: Am J Surg. 2003 Apr;185(4):323-7
references.pmid: 12657383
references.citation: Obstet Gynecol. 1995 May;85(5 Pt 1):783-6
references.pmid: 7724114
references.citation: Acad Med. 1999 Jun;74(6):652-8
references.pmid: 10386091
references.citation: Am J Obstet Gynecol. 2006 Nov;195(5):1450-6
references.pmid: 16996453
references.citation: Ann Surg. 2003 Apr;237(4):449-55
references.pmid: 12677136
references.citation: Adv Health Sci Educ Theory Pract. 2005 Aug;10(3):171-88
references.pmid: 16193400
references.citation: Clin Teach. 2011 Dec;8(4):258-62
references.pmid: 22085003
references.citation: Br J Oral Maxillofac Surg. 2002 Oct;40(5):424-8
references.pmid: 12379190
references.citation: J Gen Intern Med. 1991 Mar-Apr;6(2):141-4
references.pmid: 2023021
references.citation: Am J Obstet Gynecol. 2006 Nov;195(5):1479-83
references.pmid: 16875655
references.citation: Eval Health Prof. 1992 Sep;15(3):313-24
references.pmid: 10121283
references.citation: Health Manpow Manage. 1997;23(2-3):68-72
references.pmid: 10167878
references.citation: Nurse Educ Today. 2009 Nov;29(8):886-90
references.pmid: 19576663
references.citation: Nurse Educ Today. 2011 Nov;31(8):763-7
references.pmid: 21131105
references.citation: J Gen Intern Med. 1995 Sep;10(9):504-10
references.pmid: 8523153
references.citation: Acad Emerg Med. 2009 Dec;16 Suppl 2:S76-81
references.pmid: 20053217
references.citation: Med Educ. 2002 Sep;36(9):879-86
references.pmid: 12354251
references.citation: Nurse Educ Today. 2006 May;26(4):338-45
references.pmid: 16406618
references.citation: Neurology. 2011 Aug 30;77(9):883-7
references.pmid: 21795650
references.citation: Public Health. 2006 Mar;120(3):237-48
references.pmid: 16343567
references.citation: Med Educ. 2005 May;39(5):497-504
references.pmid: 15842684
references.citation: J Surg Educ. 2011 Sep-Oct;68(5):350-4
references.pmid: 21821211
references.citation: Clin Med (Lond). 2006 Jul-Aug;6(4):378-80
references.pmid: 16956144
references.citation: Int J Nurs Educ Scholarsh. 2004;1:Article10
references.pmid: 16646875
references.citation: Eval Health Prof. 2001 Mar;24(1):53-60
references.pmid: 11233585
references.citation: J Gen Intern Med. 1988 Jul-Aug;3(4):351-5
references.pmid: 3404296
references.citation: J Gen Intern Med. 1993 Sep;8(9):502-7
references.pmid: 8410422
references.citation: Teach Learn Med. 2010 Jul;22(3):196-201
references.pmid: 20563940
references.citation: J Surg Res. 2002 May 1;104(1):40-5
references.pmid: 11971676
references.citation: Invest Radiol. 1988 Apr;23(4):308-11
references.pmid: 3372196
references.citation: J Appl Psychol. 2001 Oct;86(5):930-42
references.pmid: 11596809
references.citation: Teach Learn Med. 2005 Winter;17(1):42-8
references.pmid: 15691813
references.citation: Sociol Health Illn. 2008 Apr;30(3):333-48
references.pmid: 18419693
references.citation: J Palliat Med. 2007 Jun;10(3):759-69
references.pmid: 17592988
references.citation: Acad Med. 1993 Nov;68(11):817-23
references.pmid: 8216645
references.citation: J Appl Psychol. 2005 Jul;90(4):629-43
references.pmid: 16060783
references.citation: Med Teach. 2004 Jun;26(4):321-5
references.pmid: 15203844
references.citation: J Obstet Gynaecol. 2006 May;26(4):302-4
references.pmid: 16753676
references.citation: J Clin Nurs. 2008 Jul;17(14):1834-42
references.pmid: 18578757
references.citation: J Adv Nurs. 2006 Sep;55(6):736-47
references.pmid: 16925622
references.citation: Acad Med. 2008 Oct;83(10 Suppl):S97-100
references.pmid: 18820513
references.citation: Ann Surg. 2005 Oct;242(4):548-53; discussion 553-5
references.pmid: 16192815
references.citation: Arch Dis Child. 2010 May;95(5):330-5
references.pmid: 20457700
references.citation: BMC Med Res Methodol. 2011 Sep 05;11:126
references.pmid: 21888678
references.citation: Med Educ. 1982 May;16(3):151-5
references.pmid: 7099052
references.citation: J Am Acad Child Adolesc Psychiatry. 1990 Nov;29(6):946-9
references.pmid: 2273026
references.citation: Med Educ. 2005 Jul;39(7):696-703
references.pmid: 15960790
references.citation: Eur J Oncol Nurs. 2007 Apr;11(2):159-67
references.pmid: 17126078
references.citation: Can Fam Physician. 2008 Oct;54(10):1424-30
references.pmid: 18854472
references.citation: Med Educ. 2006 Feb;40(2):180-6
references.pmid: 16451247
references.citation: J Am Coll Surg. 2004 Dec;199(6):932-42
references.pmid: 15555978
references.citation: J Med Educ. 1987 Jan;62(1):1-7
references.pmid: 3795239
references.citation: J Psychol. 2007 Sep;141(5):499-523
references.pmid: 17933404
references.citation: Postgrad Med J. 2006 Dec;82(974):813-6
references.pmid: 17148705
references.citation: Acad Med. 1989 Mar;64(3):159-64
references.pmid: 2923638
references.citation: J Med Educ. 1987 May;62(5):435-8
references.pmid: 3573026
references.citation: J Med Educ. 1975 Sep;50(9):876-82
references.pmid: 1152022
references.citation: Nurse Educ Today. 2004 Nov;24(8):644-55
references.pmid: 15519448
references.citation: Nurse Educ Today. 2011 Nov;31(8):904-10
references.pmid: 21300419
references.citation: Am J Surg. 2006 Apr;191(4):527-32
references.pmid: 16531148
references.citation: Med Teach. 2006 Dec;28(8):708-12
references.pmid: 17594582
references.citation: Nurse Educ Today. 2006 Oct;26(7):578-85
references.pmid: 16571364
references.citation: Acad Med. 1999 Feb;74(2):192-4
references.pmid: 10065060
references.citation: Nurse Educ Today. 2005 Feb;25(2):140-7
references.pmid: 15701540
references.citation: J Adv Nurs. 2007 Apr;58(2):171-9
references.pmid: 17445020
references.citation: N Engl J Med. 1983 May 12;308(19):1129-32
references.pmid: 6835336
references.citation: Pediatrics. 2006 Jun;117(6):1949-54
references.pmid: 16740835
references.citation: J Nurs Manag. 2009 Jul;17(5):539-49
references.pmid: 19575712
references.citation: Int J Gynecol Cancer. 2008 Jan-Feb;18(1):199-204
references.pmid: 17511806
references.citation: Med Educ. 2012 Apr;46(4):381-9
references.pmid: 22429174
references.citation: Nurse Educ Pract. 2010 Jul;10(4):227-32
references.pmid: 20022303
references.citation: Ann R Coll Surg Engl. 2003 Sep;85(5):351-4
references.pmid: 14594542
references.citation: Br J Obstet Gynaecol. 1995 Jun;102(6):461-6
references.pmid: 7632637
references.citation: Am J Surg. 1996 Jun;171(6):612-4
references.pmid: 8678211
references.citation: J Am Coll Surg. 2007 Sep;205(3):393-404
references.pmid: 17765154
references.citation: J Am Coll Surg. 2009 Jul;209(1):47-54, 54.e1-2
references.pmid: 19651062
references.citation: Nurse Educ Today. 2007 Oct;27(7):677-84
references.pmid: 17184886
references.citation: BMJ. 2004 Sep 18;329(7467):658-9
references.pmid: 15256417
references.citation: Occup Med (Lond). 2005 May;55(3):227-33
references.pmid: 15797877
references.citation: Med Educ. 1993 Jan;27(1):55-61
references.pmid: 8433661
references.citation: J Dent Educ. 2007 May;71(5):632-45
references.pmid: 17493972
references.citation: J Gen Intern Med. 2004 May;19(5 Pt 2):554-7
references.pmid: 15109323
references.citation: Educ Prim Care. 2011 Mar;22(2):90-9
references.pmid: 21439140
references.citation: Adv Health Sci Educ Theory Pract. 2012 Mar;17(1):15-26
references.pmid: 21468778
references.citation: Acad Med. 2008 Jun;83(6):611-20
references.pmid: 18520472
references.citation: J Contin Educ Nurs. 2011 Dec;42(12):559-68
references.pmid: 21598850
references.citation: Nurse Educ Today. 2007 Nov;27(8):885-92
references.pmid: 17321013
references.citation: J Orthop Sports Phys Ther. 1999 Nov;29(11):635-51; discussion 652-5
references.pmid: 10575641
references.citation: Am J Surg. 1999 Jan;177(1):86-9
references.pmid: 10037316
references.citation: Med Educ. 2012 Feb;46(2):192-200
references.pmid: 22239333
references.citation: Nurse Educ Pract. 2006 Jul;6(4):207-13
references.pmid: 19040879
references.citation: Med Teach. 2011;33(9):744-9
references.pmid: 21854151
references.citation: Am Psychol. 1997 Nov;52(11):1209-16; discussion 1216-7
references.pmid: 9357333
references.citation: J Nurs Manag. 2010 Sep;18(6):669-77
references.pmid: 20840361
references.citation: Am J Pharm Educ. 2007 Feb 15;71(1):6
references.pmid: 17429506
references.citation: J Surg Res. 1991 Sep;51(3):186-91
references.pmid: 1881132
references.citation: J Med Educ. 1984 Nov;59(11 Pt 1):856-64
references.pmid: 6492102
references.citation: Am J Phys Med Rehabil. 1995 Mar-Apr;74(2):90-100
references.pmid: 7710735
references.citation: J Surg Res. 2006 Oct;135(2):275-81
references.pmid: 16934295
references.citation: Fam Pract. 2002 Feb;19(1):105-11
references.pmid: 11818359
references.citation: J Dent Educ. 2005 Oct;69(10):1137-47
references.pmid: 16204680
references.citation: J Adv Nurs. 1996 Oct;24(4):771-8
references.pmid: 8894895
references.citation: J Appl Psychol. 2004 Jun;89(3):575-81
references.pmid: 15161414