title: Real-time assessments of the strength of program implementation for community case management of childhood illness: validation of a mobile phone-based method in Malawi.
abstract: Health surveillance assistants (HSAs) in Malawi have provided community case management (CCM) since 2008; however, program monitoring remains challenging. Mobile technology holds the potential to improve data, but rigorous assessments are few. This study tested the validity of collecting CCM implementation strength indicators through mobile phone interviews with HSAs. This validation study compared mobile phone interviews with information obtained through inspection visits. Sensitivity and specificity were measured to determine validity. Using mobile phones to interview HSAs on CCM implementation strength indicators produces accurate information. For deployment, training, and medicine stocks, the specificity and sensitivity of the results were excellent (> 90%). The sensitivity and specificity of this method for drug stock-outs, supervision, and mentoring were lower but with a few exceptions, still above 80%. This study provided a rigorous assessment of the accuracy of implementation strength data collected through mobile technologies and is an important step forward for evaluation of public health programs.
authors.forename: Elizabeth
authors.initials: E
authors.lastname: Hazel
authors.forename: Agbessi
authors.initials: A
authors.lastname: Amouzou
authors.forename: Lois
authors.initials: L
authors.lastname: Park
authors.forename: Benjamin
authors.initials: B
authors.lastname: Banda
authors.forename: Tiyese
authors.initials: T
authors.lastname: Chimuna
authors.forename: Tanya
authors.initials: T
authors.lastname: Guenther
authors.forename: Humphreys
authors.initials: H
authors.lastname: Nsona
authors.forename: Cesar G
authors.initials: CG
authors.lastname: Victora
authors.forename: Jennifer
authors.initials: J
authors.lastname: Bryce
mesh_terms: D019090:Case Management; D040421:Cell Phone; D002648:Child; D003153:Community Health Services; D006297:Health Services Accessibility; D006801:Humans; D008295:Malawi; D015203:Reproducibility of Results