Computerized questionnaires and the quality of survey data.
METHODS
A retrospective data quality analysis was conducted.


OBJECTIVE
To compare missing response rates and internal consistency between computerized and paper surveys administered to spine patients.


BACKGROUND
Computerized patient surveys have been shown to offer numerous advantages over traditional paper surveys. It has been assumed that computerized surveys also improve data quality, but quantitative comparisons have not been made.


METHODS
Between January 1998 and December 2000, approximately 3500 computerized questionnaires and 15,000 paper questionnaires containing the MOS 36-Item Short-Form Health Survey (SF-36) and the Oswestry Low Back Pain Disability Questionnaire were administered in the National Spine Network. Missing response rates and the Response Consistency Index (RCI) were compared between computerized and paper questionnaire data.


RESULTS
Computer surveys had approximately half the missing response rate of paper surveys. For the SF-36, the computer survey had 1.7% missing, as compared with 3.3% missing on paper (P < 0.001). For the Oswestry, the computer survey had 2.9% missing, as compared with 6% missing on paper (P < 0.001). Whereas 84% of the SF-36 surveys and 85% of the Oswestry surveys collected by computer were completely filled out (no missing responses), only 68% of the SF-36 surveys (P < 0.001) and 77% of the Oswestry surveys (P < 0.001) collected on paper were completely filled out. The SF-36 data collected by computer had better internal consistency than the paper-form data, with average Response Consistency Index scores of 0.12 and 0.16, respectively (P = 0.001).


CONCLUSIONS
Superior response rates and higher internal consistency suggest that computerized survey systems improve data quality, and may enhance instrument validity for commonly used measures of spine patient health.
Dartmouth Medical School, Hanover, New Hampshire, USA. Brett.Hanscom@Dartmouth.Edu
Brett
B
Hanscom
Jon D
JD
Lurie
Karen
K
Homa
James N
JN
Weinstein
D015331:Cohort Studies; D003198:Computer Simulation / Q000706:statistics & numerical data*; D015986:Confounding Factors, Epidemiologic; D004185:Disability Evaluation; D005260:Female; D006304:Health Status; D006305:Health Status Indicators; D006801:Humans; D016015:Logistic Models; D017116:Low Back Pain / Q000523:psychology*; D008297:Male; D008875:Middle Aged; D015999:Multivariate Analysis; D011786:Quality Control; D015203:Reproducibility of Results; D012107:Research Design / Q000592:standards*; D012189:Retrospective Studies; D011795:Surveys and Questionnaires / Q000592:standards*