title: Reliability of the ECHOWS Tool for Assessment of Patient Interviewing Skills.
abstract: BACKGROUND
  History taking is an important component of patient/client management. Assessment of student history-taking competency can be achieved via a standardized tool. The ECHOWS tool has been shown to be valid with modest intrarater reliability in a previous study but did not demonstrate sufficient power to definitively prove its stability.
  
  
  OBJECTIVE
  The purposes of this study were: (1) to assess the reliability of the ECHOWS tool for student assessment of patient interviewing skills and (2) to determine whether the tool discerns between novice and experienced skill levels.
  
  
  METHODS
  A reliability and construct validity assessment was conducted.
  
  
  METHODS
  Three faculty members from the United States and Australia scored videotaped histories from standardized patients taken by students and experienced clinicians from each of these countries. The tapes were scored twice, 3 to 6 weeks apart. Reliability was assessed using interclass correlation coefficients (ICCs) and repeated measures. Analysis of variance models assessed the ability of the tool to discern between novice and experienced skill levels.
  
  
  RESULTS
  The ECHOWS tool showed excellent intrarater reliability (ICC [3,1]=.74-.89) and good interrater reliability (ICC [2,1]=.55) as a whole. The summary of performance (S) section showed poor interrater reliability (ICC [2,1]=.27). There was no statistical difference in performance on the tool between novice and experienced clinicians.
  
  
  CONCLUSIONS
  A possible ceiling effect may occur when standardized patients are not coached to provide complex and obtuse responses to interviewer questions. Variation in familiarity with the ECHOWS tool and in use of the online training may have influenced scoring of the S section.
  
  
  CONCLUSIONS
  The ECHOWS tool demonstrates excellent intrarater reliability and moderate interrater reliability. Sufficient training with the tool prior to student assessment is recommended. The S section must evolve in order to provide a more discerning measure of interviewing skills.
authors: J.S. Boissonnault, PT, PhD, WCS, Department of Physical Therapy and Health Care Sciences, The George Washington University School of Medicine and Health Sciences, 2000 Pennsylvania Ave NW, Suite 227, Washington, DC 20006 (USA). Dr Boissonnault was affiliated with the Department of Orthopedics and Rehabilitation, Physical Therapy Program, University of Wisconsin-Madison, Madison, Wisconsin, at the time of the study. jillboiss@email.gwu.edu.
authors: Jill S
authors: JS
authors: Boissonnault
authors: K. Evans, PT, PhD, School of Allied Health Sciences, Menzies Health Institute Queensland, Griffith University-Gold Coast Campus, Gold Coast, Australia.
authors: Kerrie
authors: K
authors: Evans
authors: N. Tuttle, PT, PhD, School of Allied Health Sciences, Menzies Health Institute Queensland, Griffith University-Gold Coast Campus.
authors: Neil
authors: N
authors: Tuttle
authors: S.J. Hetzel, MS, Department of Biostatistics and Medical Informatics, University of Wisconsin-Madison.
authors: Scott J
authors: SJ
authors: Hetzel
authors: W.G. Boissonnault, PT, DPT, DHSc, FAAOMPT, FAPTA, Executive Vice President, Professional Affairs, American Physical Therapy Association, 1111 N Fairfax St, Alexandria, Virginia. At the time of the study, Dr Boissonnault was affiliated with the Department of Orthopedics and Rehabilitation, Physical Therapy Program, University of Wisconsin-Madison.
authors: William G
authors: WG
authors: Boissonnault
mesh_terms: D001315:Australia; D002983:Clinical Competence; D004521:Educational Measurement; D006801:Humans; D007407:Interviews as Topic / Q000592:standards*; D008487:Medical History Taking / Q000592:standards*; D026761:Physical Therapy Specialty / Q000193:education; D015203:Reproducibility of Results; D013336:Students, Health Occupations; D014481:United States