title: An algorithm to assess methodological quality of nutrition and mortality cross-sectional surveys: development and application to surveys conducted in Darfur, Sudan.
abstract: BACKGROUND
  Nutrition and mortality surveys are the main tools whereby evidence on the health status of populations affected by disasters and armed conflict is quantified and monitored over time. Several reviews have consistently revealed a lack of rigor in many surveys. We describe an algorithm for analyzing nutritional and mortality survey reports to identify a comprehensive range of errors that may result in sampling, response, or measurement biases and score quality. We apply the algorithm to surveys conducted in Darfur, Sudan.
  
  
  METHODS
  We developed an algorithm based on internationally agreed upon methods and best practices. Penalties are attributed for a list of errors, and an overall score is built from the summation of penalties accrued by the survey as a whole. To test the algorithm reproducibility, it was independently applied by three raters on 30 randomly selected survey reports. The algorithm was further applied to more than 100 surveys conducted in Darfur, Sudan.
  
  
  RESULTS
  The Intra Class Correlation coefficient was 0.79 for mortality surveys and 0.78 for nutrition surveys. The overall median quality score and range of about 100 surveys conducted in Darfur were 0.60 (0.12-0.93) and 0.675 (0.23-0.86) for mortality and nutrition surveys, respectively. They varied between the organizations conducting the surveys, with no major trend over time.
  
  
  CONCLUSIONS
  Our study suggests that it is possible to systematically assess quality of surveys and reveals considerable problems with the quality of nutritional and particularly mortality surveys conducted in the Darfur crisis.
authors.affiliation: Health and Nutrition Tracking Service, Geneva, Switzerland. prudhonc@who.int.
authors.forename: Claudine
authors.initials: C
authors.lastname: Prudhon
authors.forename: Xavier
authors.initials: X
authors.lastname: de Radiguès
authors.forename: Nancy
authors.initials: N
authors.lastname: Dale
authors.forename: Francesco
authors.initials: F
authors.lastname: Checchi
references.citation: JAMA. 1994 Aug 3;272(5):371-6
references.pmid: 8028168
references.citation: Disasters. 2004 Jun;28(2):99
references.pmid: 20958782
references.citation: Lancet. 2004 Nov 20-26;364(9448):1899-909
references.pmid: 15555671
references.citation: JAMA. 2004 Aug 4;292(5):613-8
references.pmid: 15292087
references.citation: Lancet. 2010 Jan 23;375(9711):294-300
references.pmid: 20109956
references.citation: BMJ. 2006 Aug 12;333(7563):319
references.pmid: 16902208
references.citation: Lancet. 2004 Nov 13-19;364(9447):1801-13
references.pmid: 15541455
references.citation: Nutr Rev. 2000 Sep;58(9):269-77
references.pmid: 11060997
references.citation: Emerg Themes Epidemiol. 2007 Jun 01;4:10
references.pmid: 17543104
references.citation: Confl Health. 2009 Sep 10;3:8
references.pmid: 19744319
references.citation: Int J Epidemiol. 2011 Aug;40(4):971-84
references.pmid: 21296853
references.citation: PLoS Med. 2008 Jul 1;5(7):e146
references.pmid: 18597552