title: How to assess the external validity and model validity of therapeutic trials: a conceptual approach to systematic review methodology.
abstract: Background. Evidence rankings do not consider equally internal (IV), external (EV), and model validity (MV) for clinical studies including complementary and alternative medicine/integrative medicine (CAM/IM) research. This paper describe this model and offers an EV assessment tool (EVAT©) for weighing studies according to EV and MV in addition to IV. Methods. An abbreviated systematic review methodology was employed to search, assemble, and evaluate the literature that has been published on EV/MV criteria. Standard databases were searched for keywords relating to EV, MV, and bias-scoring from inception to Jan 2013. Tools identified and concepts described were pooled to assemble a robust tool for evaluating these quality criteria. Results. This study assembled a streamlined, objective tool to incorporate for the evaluation of quality of EV/MV research that is more sensitive to CAM/IM research. Conclusion. Improved reporting on EV can help produce and provide information that will help guide policy makers, public health researchers, and other scientists in their selection, development, and improvement in their research-tested intervention. Overall, clinical studies with high EV have the potential to provide the most useful information about "real-world" consequences of health interventions. It is hoped that this novel tool which considers IV, EV, and MV on equal footing will better guide clinical decision making.
authors.affiliation: Military Medical Research, Samueli Institute, 2101 East Coast Highway, Suite 300, Corona Del Mar, CA 92625, USA ; Department of Planning, Policy, and Design, School of Social Ecology, University of California Irvine, Irvine, CA 92697-7075, USA.
authors.forename: Raheleh
authors.identifier: 0000-0002-2947-079X
authors.initials: R
authors.lastname: Khorsan
authors.affiliation: Samueli Institute, 1737 King Street, Alexandria, VA 22314, USA.
authors.forename: Cindy
authors.identifier: 0000-0002-6693-8806
authors.initials: C
authors.lastname: Crawford
references.citation: J Eval Clin Pract. 2012 Feb;18(1):12-8
references.pmid: 20698919
references.citation: J Epidemiol Community Health. 1998 Jun;52(6):377-84
references.pmid: 9764259
references.citation: BMJ. 2001 Jul 7;323(7303):42-6
references.pmid: 11440947
references.citation: BMC Fam Pract. 2009 Jan 19;10:5
references.pmid: 19152681
references.citation: Forsch Komplementmed. 2006;13 Suppl 2:19-29
references.pmid: 16883077
references.citation: Am J Public Health. 2008 Jan;98(1):9-10
references.pmid: 18048772
references.citation: Forsch Komplementmed. 2012;19 Suppl 1:15-21
references.pmid: 22327547
references.citation: Int J Surg. 2012;10(1):28-55
references.pmid: 22036893
references.citation: J Clin Pharm Ther. 2003 Aug;28(4):285-7
references.pmid: 12911680
references.citation: Ann Fam Med. 2006 Mar-Apr;4(2):104-8
references.pmid: 16569712
references.citation: Addiction. 2012 Sep;107(9):1570-9
references.pmid: 22372548
references.citation: Control Clin Trials. 1995 Feb;16(1):62-73
references.pmid: 7743790
references.citation: N Engl J Med. 2004 Aug 5;351(6):543-51
references.pmid: 15295047
references.citation: Lancet. 2005 Jan 1-7;365(9453):82-93
references.pmid: 15639683
references.citation: Ann Behav Med. 2006 Apr;31(2):105-8
references.pmid: 16542124
references.citation: J Clin Epidemiol. 2006 Nov;59(11):1125-6
references.pmid: 17027421
references.citation: PLoS Med. 2005 Aug;2(8):e124
references.pmid: 16060722
references.citation: BMC Med Res Methodol. 2003 Dec 22;3:28
references.pmid: 14690550
references.citation: Syst Rev. 2012 Oct 15;1:46
references.pmid: 23067573
references.citation: J Eval Clin Pract. 2006 Aug;12(4):450-3
references.pmid: 16907689
references.citation: Lancet. 2001 Apr 14;357(9263):1191-4
references.pmid: 11323066
references.citation: BMC Med Res Methodol. 2006 Dec 11;6:56
references.pmid: 17156475
references.citation: N Engl J Med. 1999 Sep 2;341(10):709-17
references.pmid: 10471456
references.citation: Int J Epidemiol. 2010 Feb;39(1):89-94
references.pmid: 19376882
references.citation: BMC Med Res Methodol. 2012 Apr 17;12:49
references.pmid: 22510227
references.citation: Int J Technol Assess Health Care. 1996 Spring;12(2):195-208
references.pmid: 8707495
references.citation: Health Technol Assess. 2000;4(34):1-154
references.pmid: 11134917
references.citation: J Clin Epidemiol. 2011 Apr;64(4):383-94
references.pmid: 21195583
references.citation: Phys Ther. 2008 Feb;88(2):156-75
references.pmid: 18073267
references.citation: J Asthma. 2007 Nov;44(9):685-98
references.pmid: 17994396
references.citation: J Clin Epidemiol. 2006 Oct;59(10):1040-8
references.pmid: 16980143