title: Validation of complex interventions in a low back pain trial: selective video analysis cross-referenced to clinical case notes.
abstract: BACKGROUND
  Auditing the interventions used in clinical trials to demonstrate that treatment protocols were adhered to and that discrete modalities were delivered, is essential in establishing internal validity. Pragmatic studies involving complex interventions provide a particular challenge. The value of case report forms which document individual treatment content relies upon accurate recall and recording by the clinician. This report describes a method to validate this type of data in a randomised clinical trial, by using video analysis on a sample of patient therapist interactions.
  
  
  METHODS
  Six physiotherapists used standardised case report forms to record the treatment given to 402 patients recruited into the two treatment arms of a low back pain clinical trial. An audit checklist comprising the principal components of both management approaches was designed. Twelve treatment sessions were video recorded. Three independent clinicians viewed the recordings, using the checklist to identify the treatment content. These data were compared for agreement with the matching case report forms. The content of the interventions delivered to all of the trial patients was then audited.
  
  
  RESULTS
  Agreement between the video observers, and between the observers and the case report forms ranged from moderate to very good (kappa=0.45-0.82). When compared with the video observations, some under-reporting of treatment occurred on the case report forms. Overall, 80% of the patients received the treatment to which they were allocated.
  
  
  CONCLUSIONS
  This study has demonstrated that selective use of video recording, cross-referenced to clinical case notes may provide a feasible and relatively inexpensive means of establishing the internal validity of the interventions used in a pragmatic clinical trial.
authors.affiliation: Primary Care Sciences Research Centre, Keele University, Staffordshire, ST5 5BG, UK. r.mullis@cphc.keele.ac.uk
authors.forename: Ricky
authors.initials: R
authors.lastname: Mullis
authors.forename: Krysia S
authors.initials: KS
authors.lastname: Dziedzic
authors.forename: Martyn
authors.initials: M
authors.lastname: Lewis
authors.forename: Catherine J
authors.initials: CJ
authors.lastname: Minns Lowe
authors.forename: Christopher J
authors.initials: CJ
authors.lastname: Main
authors.forename: Paul J
authors.initials: PJ
authors.lastname: Watson
authors.forename: Elaine M
authors.initials: EM
authors.lastname: Hay
mesh_terms: D002985:Clinical Protocols / Q000592:standards*; D006801:Humans; D017116:Low Back Pain / Q000628:therapy*; D008485:Medical Audit; D015588:Observer Variation; D026741:Physical Therapy Modalities; D011320:Primary Health Care; D011369:Professional-Patient Relations; D015203:Reproducibility of Results; D014741:Video Recording