title: Validating medical students' self-report of smoking-related communication skills and educational experiences.
abstract: OBJECTIVE
  Pediatric clerkships can be important settings for medical students to learn how to perform smoking assessments and counseling with parents. In evaluating an educational intervention that promotes this skill, we assess whether students' self-report of this counseling skill was a valid measure of actual behavior.
  
  
  METHODS
  A trained observer evaluated student smoking assessment and counseling practices during pediatric well-child visits at 5 clinical sites in eastern Massachusetts. The external observations of behavior were used as a gold standard, and we determined the accuracy of the students' self-report of their smoking counseling practices with families and of their preceptors' educational interventions.
  
  
  RESULTS
  We observed 38 pediatric preceptors and 85 Boston University School of Medicine (BUSM) III students in 85 clinical encounters. Sensitivities of the students' report of assessing smoking practices and counseling parents and children ranged from 0.60-1.00, and specificities ranged from 0.41-0.88. Specifically, with regards to the students' report of performing a smoking assessment with the family, the sensitivity was 0.97 (95 per cent confidence interval, 0.89-0.99) and the specificity was 0.88 (95 per cent confidence interval, 0.72-0.97). For measures where the observer could not determine practice, agreement between the student and preceptor was between 57 per cent and 83 per cent . Specifically, with regard to whether the preceptor made expectations clear with the student, students and preceptors agreed 83% of the time.
  
  
  CONCLUSIONS
  Although direct observations of behavior may still be the most accurate report of true practice, when this is not feasible, student self-report appears to be a valid measure of smoking assessment and counseling practices during pediatric clerkships.
authors: Department of Dermatology, Boston University School of Medicine, Boston, Mass., USA.
authors: Katie R
authors: KR
authors: Brooks
authors: Benjamin
authors: B
authors: Siegel
authors: Timothy L
authors: TL
authors: Lash
authors: Alan C
authors: AC
authors: Geller
authors: Alison
authors: A
authors: Fitzgerald
authors: Caroline
authors: C
authors: Tracy
authors: Marianne N
authors: MN
authors: Prout
mesh_terms: D002982:Clinical Clerkship; D003142:Communication; D037001:Directive Counseling; D004504:Education, Medical, Undergraduate; D006801:Humans; D010372:Pediatrics; D015203:Reproducibility of Results; D012647:Self-Assessment; D012907:Smoking; D013337:Students, Medical