Effects of question format and collection mode on the accuracy of retrospective surveys of health risk behavior: a comparison with daily sexual activity diaries.
OBJECTIVE
To use prospective diaries to assess the effects of alternative survey question formats and data collection modes on the accuracy of retrospective self-reports of sexual behavior for the same time period.


METHODS
Over a 3-month period, 493 adults completed and returned by mail daily diaries of their sexual activities. Participants then returned to complete a retrospective survey of their sexual activities during the same 3-month time period. Participants were randomized to 1 of 6 retrospective experimental survey conditions that represented the combinations of 2 question formats (in aggregate and by partner) and 3 collection modes (paper questionnaire, computer-assisted self-interview [CASI], and audio-enhanced CASI).


METHODS
Frequencies of sexual activities and condom use reported in surveys were compared with what participants had recorded in their prospective daily diaries.


RESULTS
Relative to activity recorded in daily diaries, participants more often underreported than overreported (61% vs. 28%, p < .05) sexual behavior in retrospective surveys. Greater survey-to-diary consistency in reported behavior was achieved with by-partner question format (p < .032) and CASI collection modes (p < .05) used in surveys. However, median rates of error in survey-to-diary comparisons of reported behavior were as high as 40%.


CONCLUSIONS
Even after refinements in survey question format and use of CASI techniques, there remained substantial error in participants' retrospective reports of sexual practices. These error rates may be comparable to, or even larger than, the expected effect size of some intervention studies. Further research is needed to improve the accuracy of sexual behavior reports.
McAuliffe
Timothy L
TL
Center for AIDS Intervention Research, Department of Psychiatry and Behavioral Medicine, Medical College of Wisconsin, Milwaukee, WI 53202, USA. mcauliff@mcw.edu
DiFranceisco
Wayne
W
Reed
Barbara R
BR
D000293:Adolescent; D000328:Adult; D001294:Attitude to Health; D017280:Condoms / Q000706:statistics & numerical data; D003625:Data Collection / Q000706:statistics & numerical data*; D005260:Female; D006679:HIV Seropositivity / Q000453:epidemiology / Q000523:psychology; D018451:Homosexuality, Male / Q000523:psychology* / Q000706:statistics & numerical data; D006801:Humans; D008297:Male; D008499:Medical Records / Q000706:statistics & numerical data*; D011446:Prospective Studies; D015203:Reproducibility of Results; D012189:Retrospective Studies; D012747:Sexual Partners; D011795:Surveys and Questionnaires; D047568:Unsafe Sex / Q000523:psychology*; D014922:Wisconsin