Using cognitive interviews to develop surveys in diverse populations.
BACKGROUND
Conceptual equivalence of measures is essential in research that compares health across diverse racial/ethnic groups. Cognitive interviews are pretest methods to explore the conceptual equivalence of survey items. Systematic approaches for using these methods are emerging.


OBJECTIVE
We describe an interaction analysis (IA) approach using qualitative data analysis software to analyze transcripts of cognitive interviews in a study to develop a survey instrument of the quality of interpersonal processes of care of diverse patients. Cognitive interviews included standard administration of the survey followed by retrospective probes for selected items.


METHODS
Interviews were completed with 48 Latino, black, and non-Latino white respondents 18 years of age or older with at least one doctor's visit in the past 12 months. Participants averaged 45.8 years in age (standard deviation [SD] = 18.4), 58% were women, and mean education was 14.7 years (SD = 4.0).


RESULTS
Problems were identified in 126 of 159 items (79%). Behavior coding identified 32 problematic items (20%). IA of the transcript of the survey and retrospective probes identified 94 additional problematic items (59%). IA often revealed the nature of the problems, enabling decisions to modify or drop items based on respondents' comments. Behavior coding and IA identified ethnic and language similarities and differences in the use of response sets and the interpretation of items.


CONCLUSIONS
IA and behavior coding of cognitive interview transcripts can identify efficiently problems with items and their source to increase the likelihood of the revised items being conceptually equivalent across ethnic groups.
Nápoles-Springer
Anna M
AM
Medical Effectiveness Research Center for Diverse Populations and the Center on Aging in Diverse Communities, University of California at San Francisco, San Francisco, California 94118-1944, USA. anna.napoles-springer@ucsf.edu
Santoyo-Olsson
Jasmine
J
O'Brien
Helen
H
Stewart
Anita L
AL
D000328:Adult; D000368:Aged; D000369:Aged, 80 and over; D003142:Communication; D018864:Cultural Diversity; D005006:Ethnicity / Q000523:psychology; D005260:Female; D019538:Health Care Surveys; D006801:Humans; D007407:Interviews as Topic / Q000379:methods*; D008297:Male; D008875:Middle Aged; D011594:Psychometrics / Q000379:methods; D011795:Surveys and Questionnaires; D014481:United States