Methodological considerations regarding response bias effect in substance use research: is correlation between the measured variables sufficient?
Efforts for drug free sport include developing a better understanding of the behavioural determinants that underline doping with an increased interest in developing anti-doping prevention and intervention programmes. Empirical testing of both is dominated by self-report questionnaires, which is the most widely used method in psychological assessments and sociology polls. Disturbingly, the potential distorting effect of socially desirable responding (SD) is seldom considered in doping research, or dismissed based on weak correlation between some SD measure and the variables of interest. The aim of this report is to draw attention to i) the potential distorting effect of SD and ii) the limitation of using correlation analysis between a SD measure and the individual measures. Models of doping opinion as a potentially contentious issue was tested using structural equation modeling technique (SEM) with and without the SD variable, on a dataset of 278 athletes, assessing the SD effect both at the i) indicator and ii) construct levels, as well as iii) testing SD as an independent variable affecting expressed doping opinion. Participants were categorised by their SD score into high- and low SD groups. Based on low correlation coefficients (<|0.22|) observed in the overall sample, SD effect on the indicator variables could be disregarded. Regression weights between predictors and the outcome variable varied between groups with high and low SD but despite the practically non-existing relationship between SD and predictors (<|0.11|) in the low SD group, both groups showed improved model fit with SD, independently. The results of this study clearly demonstrate the presence of SD effect and the inadequacy of the commonly used pairwise correlation to assess social desirability at model level. In the absence of direct observation of the target behaviour (i.e. doping use), evaluation of the effectiveness of future anti-doping campaign, along with empirical testing of refined doping behavioural models, will likely to continue to rely on self-reported information. Over and above controlling the effect of socially desirable responding in research that makes inferences based on self-reported information on social cognitive and behavioural measures, it is recommended that SD effect is appropriately assessed during data analysis.
Kingston University, Faculty of Science, School of Life Sciences, Penrhyn Road, Kingston upon Thames, Surrey, KT1 2EE, UK. A.Petroczi@kingston.ac.uk
Andrea
A
Petróczi
Tamás
T
Nepusz
D001294:Attitude to Health; D015982:Bias; D035843:Biomedical Research / Q000379:methods / Q000592:standards*; D004300:Doping in Sports / Q000523:psychology* / Q000706:statistics & numerical data; D015340:Epidemiologic Research Design; D006801:Humans; D012650:Self Disclosure; D057566:Self Report; D012928:Social Desirability
J Health Soc Behav. 2009 Sep;50(3):277-92
19711806
J Stud Alcohol. 2001 Jan;62(1):5-13
11271964
J Pediatr Psychol. 2009 Nov-Dec;34(10):1069-83
19386771
Subst Abuse Treat Prev Policy. 2008 Mar 10;3:7
18331645
Drug Alcohol Depend. 1996 Sep;42(1):49-54
8889403
J Alcohol Drug Educ. 2008 Aug;52(2):73-92
19081833
Int J Sports Med. 2008 Jul;29(7):607-12
18214812
J Pers Soc Psychol. 2009 Jul;97(1):17-41
19586237
Addict Behav. 2008 Sep;33(9):1131-9
18547737
Arch Pediatr Adolesc Med. 2000 Apr;154(4):332-8
10768668
J Consult Psychol. 1960 Aug;24:349-54
13813058
Addiction. 2010 Apr;105(4):615-25
20403014
Int J Sports Med. 2004 Feb;25(2):133-8
14986197
Psychol Bull. 2007 Sep;133(5):859-83
17723033
Scand J Med Sci Sports. 2011 Dec;21(6):e132-42
22126721
Arch Pediatr Adolesc Med. 2004 Nov;158(11):1043-9
15520341
J Drug Educ. 2008;38(4):329-49
19438066
Forensic Sci Int. 2006 Jan 27;156(2-3):118-23
16410161
Perspect Psychol Sci. 2010 May;5(3):243-62
26162157
JAMA. 2009 Dec 2;302(21):2301-3
19952311
J Subst Abuse Treat. 2007 Mar;32(2):189-98
17306727
PLoS One. 2010 May 05;5(5):e10457
20463978
Clin Invest Med. 2007;30(1):33-41
17716538
J Pers Soc Psychol. 1986 Dec;51(6):1173-82
3806354
J Sports Sci. 2008 Mar;26(5):447-56
18274942
Clin J Sport Med. 2009 May;19(3):222-7
19423975
J Psychol. 2000 Jul;134(4):401-21
10908073
J Appl Psychol. 2003 Oct;88(5):879-903
14516251
J Health Psychol. 2008 Jul;13(5):703-11
18519443
Health Educ Res. 2008 Feb;23(1):70-80
17301058
Psychol Bull. 2009 May;135(3):347-368
19379018
Body Image. 2008 Dec;5(4):346-51
18644753
JAMA. 1996 Nov 20;276(19):1555-62
8918852
Sports Med. 2002;32(4):269-84
11929355
Subst Abuse Treat Prev Policy. 2007 Nov 09;2:34
17996097
Pediatrics. 2010 Nov;126(5):887-93
20974792
Clin J Sport Med. 2010 Jul;20(4):243-8
20606508
J Adolesc Health. 2007 Nov;41(5):421-9
17950161