title: Validation of the conceptual research utilization scale: an application of the standards for educational and psychological testing in healthcare.
abstract: BACKGROUND
  There is a lack of acceptable, reliable, and valid survey instruments to measure conceptual research utilization (CRU). In this study, we investigated the psychometric properties of a newly developed scale (the CRU Scale).
  
  
  METHODS
  We used the Standards for Educational and Psychological Testing as a validation framework to assess four sources of validity evidence: content, response processes, internal structure, and relations to other variables. A panel of nine international research utilization experts performed a formal content validity assessment. To determine response process validity, we conducted a series of one-on-one scale administration sessions with 10 healthcare aides. Internal structure and relations to other variables validity was examined using CRU Scale response data from a sample of 707 healthcare aides working in 30 urban Canadian nursing homes. Principal components analysis and confirmatory factor analyses were conducted to determine internal structure. Relations to other variables were examined using: (1) bivariate correlations; (2) change in mean values of CRU with increasing levels of other kinds of research utilization; and (3) multivariate linear regression.
  
  
  RESULTS
  Content validity index scores for the five items ranged from 0.55 to 1.00. The principal components analysis predicted a 5-item 1-factor model. This was inconsistent with the findings from the confirmatory factor analysis, which showed best fit for a 4-item 1-factor model. Bivariate associations between CRU and other kinds of research utilization were statistically significant (p < 0.01) for the latent CRU scale score and all five CRU items. The CRU scale score was also shown to be significant predictor of overall research utilization in multivariate linear regression.
  
  
  CONCLUSIONS
  The CRU scale showed acceptable initial psychometric properties with respect to responses from healthcare aides in nursing homes. Based on our validity, reliability, and acceptability analyses, we recommend using a reduced (four-item) version of the CRU scale to yield sound assessments of CRU by healthcare aides. Refinement to the wording of one item is also needed. Planned future research will include: latent scale scoring, identification of variables that predict and are outcomes to conceptual research use, and longitudinal work to determine CRU Scale sensitivity to change.
authors: Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada. jasquires@ohri.ca
authors: Janet E
authors: JE
authors: Squires
authors: Carole A
authors: CA
authors: Estabrooks
authors: Christine V
authors: CV
authors: Newburn-Cook
authors: Mark
authors: M
authors: Gierl
references: Worldviews Evid Based Nurs. 2007;4(4):187-99
references: 18076462
references: Implement Sci. 2011 Jan 05;6:1
references: 21208425
references: Implement Sci. 2008 Jan 07;3:1
references: 18179688
references: Res Nurs Health. 2007 Jun;30(3):282-96
references: 17514725
references: J Nurs Adm. 2007 Jul-Aug;37(7-8):366-72
references: 17939468
references: Clin Nurse Spec. 1991 Fall;5(3):151-5
references: 1913440
references: J Nurs Meas. 2001 Fall;9(2):201-15
references: 11696942
references: Res Nurs Health. 1999 Jun;22(3):203-16
references: 10344701
references: Res Nurs Health. 2006 Oct;29(5):489-97
references: 16977646
references: Nurs Res. 2010 Jan-Feb;59(1):42-50
references: 20010044
references: Nurs Res. 1986 Nov-Dec;35(6):382-5
references: 3640358
references: Implement Sci. 2009 Aug 11;4:52
references: 19671166
references: Nurse Educ Pract. 2009 May;9(3):199-208
references: 18701349
references: Int J Nurs Stud. 2005 Nov;42(8):899-914
references: 16210028
references: West J Nurs Res. 1999 Dec;21(6):758-72
references: 11512212
references: Gerontologist. 1994 Apr;34(2):245-50
references: 8005498
references: West J Nurs Res. 2003 Apr;25(3):322-37
references: 12705114
references: Image J Nurs Sch. 1985 Spring;17(2):40-4
references: 3846562
references: Gerontologist. 1992 Jun;32(3):351-9
references: 1500000
references: Res Nurs Health. 1995 Jun;18(3):271-84
references: 7754097
references: Nurs Leadersh (Tor Ont). 2005;18(3):45-67
references: 16372787
references: J Nurses Staff Dev. 2001 May-Jun;17(3):115-22; quiz 123-4
references: 11998670
references: Implement Sci. 2009 Aug 10;4:51
references: 19664285
references: Med Educ. 2003 Sep;37(9):830-7
references: 14506816