Intervention research: establishing fidelity of the independent variable in nursing clinical trials.
BACKGROUND
Internal validity of a randomized clinical trial of a nursing intervention is dependent on intervention fidelity. Although several methods have been developed, evaluating audio or audiovisual tapes for prescribed and proscribed interventionist behaviors is considered the gold standard test of treatment fidelity. This approach requires development of a psychometrically sound instrument to meaningfully categorize and quantify interventionist behaviors.


OBJECTIVE
To outline critical steps necessary to develop a treatment fidelity instrument.


METHODS
A comprehensive literature review was conducted to determine procedures used by other researchers. The literature review produced five quantitative studies of treatment fidelity, all in the field of psychotherapy, and two replication studies. A synthesis of methodologies across studies combined with researchers' experiences resulted in identification of the steps necessary to develop a treatment fidelity measure.


RESULTS
Seven sequential steps were identified as essential to the development of a valid and reliable measure of treatment fidelity. These steps include (a) identification of the essential elements of the experimental and control treatment modalities; (b) construction of scale items; (c) development of item scaling; (d) identification of the units for coding; (e) item testing and revision; (f) specification of rater qualifications and development of rater training program; and (g) development and completion of pilot testing to test psychometric properties. Development of the Possibilities Project Psychotherapy Coding Questionnaire is described as an illustration of the seven-step process.


CONCLUSIONS
The results show the essential steps that are unique to the development of treatment fidelity measures and show the feasibility of using these steps to construct a psychometrically sound treatment-specific fidelity measure.
Stein
Karen Farchaus
KF
School of Nursing, University of Michigan, Ann Arbor 48109, USA. kfarchau@umich.edu
Sargent
Judy T
JT
Rafaels
Nicholas
N
D000293:Adolescent; D000328:Adult; D000856:Anorexia Nervosa / Q000628:therapy; D052018:Bulimia Nervosa / Q000628:therapy; D015400:Clinical Nursing Research / Q000379:methods*; D015928:Cognitive Behavioral Therapy; D005260:Female; D006801:Humans; D015588:Observer Variation; D010865:Pilot Projects; D011594:Psychometrics / Q000379:methods*; D016032:Randomized Controlled Trials as Topic / Q000379:methods*; D015203:Reproducibility of Results; D012107:Research Design