title: Evaluation of a risk factor survey with three assessment methods.
abstract: This paper describes the evaluation of questions on a cancer risk factor survey using three different methods: dataset response patterns, qualitative feedback, and questionnaire appraisal. These methods addressed the survey data, procedures and questions. The three methods identified similar issues but also made unique contributions. Dataset response patterns showed missing and out-of-range data, an order effect, and mixed coding. Qualitative feedback revealed lack of clarity, sensitive topics, technical or undefined terms, failure to hear all response options, overlapping response options (as perceived by respondents), coding problems and recall difficulties. Questionnaire appraisal showed technical or undefined terms, complex syntax, hidden definitions, and ambiguous wording. The survey assessment methods described here can improve data quality, especially when limited time and resources preclude in-depth questionnaire development.
authors.affiliation: Division of Preventive Oncology, Cancer Care Ontario, 620 University Avenue, Toronto, Ontario M5G 2L7. Beth.theis@cancercare.on.ca
authors.forename: Beth
authors.initials: B
authors.lastname: Theis
authors.forename: Jennifer
authors.initials: J
authors.lastname: Frood
authors.forename: Diane
authors.initials: D
authors.lastname: Nishri
authors.forename: Loraine D
authors.initials: LD
authors.lastname: Marrett
mesh_terms: D003625:Data Collection; D005246:Feedback; D006306:Health Surveys; D006801:Humans; D009369:Neoplasms / Q000209:etiology*; D011159:Population Surveillance; D018570:Risk Assessment / Q000379:methods*; D011795:Surveys and Questionnaires