title: Methods for assessing quality of provider performance in developing countries.
abstract: OBJECTIVE
  To compare the effectiveness of methods for assessing the quality of pediatric outpatient health provider performance in developing countries.
  
  
  METHODS
  Exit interviews, record reviews, and provider interview results were compared with those of direct observation of pediatric patient care. Thirty health care providers in 14 facilities in Lilongwe District, Malawi were interviewed and observed, treating 436 children in August 1994. Caretakers for 426 of the patients were interviewed, and 362 pediatric outpatient entries in the health center patient register were located and reviewed.
  
  
  METHODS
  Kappa statistics measuring the level of agreement on the same sample were used for three methods (record reviews, provider interviews, and exit interviews) in comparison with the fourth method, direct observation.
  
  
  RESULTS
  All three methods had strengths and weaknesses. Exit interviews with caretakers provided reliable responses for many history-taking tasks, easily discernible physical exam tasks, and many counseling tasks. Record review took little time, but provided limited information: however, the results were reliable for treatments. Provider interviews had much lower reliability, but were usable for assessing more rare events (treating severely ill children).
  
  
  CONCLUSIONS
  Although exit interviews and direct observation provide the 'best' data, they are most resource-intensive. Depending on the purpose of the assessment, various combinations of methods might be more effective.
authors.affiliation: Quality Assurance Project, Center for Human Services, Bethesda, MD 20814, USA. lfranco@urc-chs.com
authors.forename: Lynne Miller
authors.initials: LM
authors.lastname: Franco
authors.forename: Ciro
authors.initials: C
authors.lastname: Franco
authors.forename: Newton
authors.initials: N
authors.lastname: Kumwenda
authors.forename: Wilfred
authors.initials: W
authors.lastname: Nkhoma
mesh_terms: D019090:Case Management / Q000592:standards*; D002662:Child Health Services / Q000592:standards*; D002675:Child, Preschool; D003906:Developing Countries; D017598:Efficiency, Organizational; D006801:Humans; D007407:Interviews as Topic; D008295:Malawi; D019370:Observation; D010044:Outpatient Clinics, Hospital / Q000592:standards*; D011785:Quality Assurance, Health Care / Q000379:methods*; D013647:Task Performance and Analysis