New technology in quality of life research: are all computer-assisted approaches created equal?
OBJECTIVE
To compare alternate form reliability for two previously validated questionnaires using traditional and computer-assisted interfaces (CASI).


METHODS
The Rhinoconjunctivitis Quality of Life Questionnaire (RQLQ) and the allergy-specific Work Productivity and Activity Impairment (WPAI) instrument were combined and formatted for paper-and-pencil (P), computer touch screen (TS), or web-based (WB) administration. Employees at a large midwestern hospital in the US each completed two of three possible formats assigned randomly and in random order. Those completing one of three possible format pairs (P-TS, P-WB, and TS-WB) comprised three study groups. Item response consistency was assessed using Spearman correlations; individuals' test-retest scores were compared using paired t-tests with mean test-retest differences compared between groups using ANOVA.


RESULTS
Seventy five volunteers completed 150 questionnaires. Item response consistency varied by format pair with correlations ranging from 0.566 to 0.973. Although no differences were observed in paired RQLQ responses, participants completing the WB form reported generally higher WPAI scores compared with those from either the paper (p = 0.07) or TS (p = 0.001) format. ANOVA of mean RQLQ and WPAI scores demonstrated no between-group differences.


CONCLUSIONS
Use of CASI, an increasingly popular method in survey research, may have important effects on instrument reliability. Studies examining this phenomenon more closely are needed to guide future use of CASI in this setting.
Litaker
David
D
Center for Health Care Research and Policy, MetroHealth Medical Center, Cleveland, Ohio 44109-1998, USA. wrightlit@aol.com
D000328:Adult; D003201:Computers; D003626:Data Display; D005260:Female; D006306:Health Surveys; D006801:Humans; D008297:Male; D008875:Middle Aged; D015146:Midwestern United States; D010564:Personnel, Hospital; D011788:Quality of Life; D011795:Surveys and Questionnaires / Q000592:standards*