title: Testing the role of reward and punishment sensitivity in avoidance behavior: a computational modeling approach.
abstract: Exaggerated avoidance behavior is a predominant symptom in all anxiety disorders and its degree often parallels the development and persistence of these conditions. Both human and non-human animal studies suggest that individual differences as well as various contextual cues may impact avoidance behavior. Specifically, we have recently shown that female sex and inhibited temperament, two anxiety vulnerability factors, are associated with greater duration and rate of the avoidance behavior, as demonstrated on a computer-based task closely related to common rodent avoidance paradigms. We have also demonstrated that avoidance is attenuated by the administration of explicit visual signals during "non-threat" periods (i.e., safety signals). Here, we use a reinforcement-learning network model to investigate the underlying mechanisms of these empirical findings, with a special focus on distinct reward and punishment sensitivities. Model simulations suggest that sex and inhibited temperament are associated with specific aspects of these sensitivities. Specifically, differences in relative sensitivity to reward and punishment might underlie the longer avoidance duration demonstrated by females, whereas higher sensitivity to punishment might underlie the higher avoidance rate demonstrated by inhibited individuals. Simulations also suggest that safety signals attenuate avoidance behavior by strengthening the competing approach response. Lastly, several predictions generated by the model suggest that extinction-based cognitive-behavioral therapies might benefit from the use of safety signals, especially if given to individuals with high reward sensitivity and during longer safe periods. Overall, this study is the first to suggest cognitive mechanisms underlying the greater avoidance behavior observed in healthy individuals with different anxiety vulnerabilities.
authors: Department of Veterans Affairs, New Jersey Health Care System, East Orange, NJ, USA; Joint Biomedical Engineering Program, New Jersey Institute of Technology and Graduate School of Biomedical Sciences, Rutgers, The State University of New Jersey, Newark, NJ, USA; Stress & Motivated Behavior Institute, New Jersey Medical School, Rutgers, The State University of New Jersey, Newark, NJ, USA. Electronic address: jsheynin@med.umich.edu.
authors: Jony
authors: J
authors: Sheynin
authors: Department of Veterans Affairs, New Jersey Health Care System, East Orange, NJ, USA; Marcs Institute for Brain and Behaviour & School of Social Sciences and Psychology, University of Western Sydney, Sydney, Australia. Electronic address: A.Moustafa@uws.edu.au.
authors: Ahmed A
authors: AA
authors: Moustafa
authors: Department of Veterans Affairs, New Jersey Health Care System, East Orange, NJ, USA; Joint Biomedical Engineering Program, New Jersey Institute of Technology and Graduate School of Biomedical Sciences, Rutgers, The State University of New Jersey, Newark, NJ, USA; Stress & Motivated Behavior Institute, New Jersey Medical School, Rutgers, The State University of New Jersey, Newark, NJ, USA. Electronic address: Kevin.Beck@va.gov.
authors: Kevin D
authors: KD
authors: Beck
authors: Joint Biomedical Engineering Program, New Jersey Institute of Technology and Graduate School of Biomedical Sciences, Rutgers, The State University of New Jersey, Newark, NJ, USA; Stress & Motivated Behavior Institute, New Jersey Medical School, Rutgers, The State University of New Jersey, Newark, NJ, USA; Department of Veterans Affairs, Veterans Affairs Medical Center, Syracuse, NY, USA. Electronic address: richard.servatius@va.gov.
authors: Richard J
authors: RJ
authors: Servatius
authors: Department of Veterans Affairs, New Jersey Health Care System, East Orange, NJ, USA; Joint Biomedical Engineering Program, New Jersey Institute of Technology and Graduate School of Biomedical Sciences, Rutgers, The State University of New Jersey, Newark, NJ, USA; Stress & Motivated Behavior Institute, New Jersey Medical School, Rutgers, The State University of New Jersey, Newark, NJ, USA. Electronic address: Catherine.Myers2@va.gov.
authors: Catherine E
authors: CE
authors: Myers
mesh_terms: D001362:Avoidance Learning; D015928:Cognitive Behavioral Therapy / Q000379:methods; D003198:Computer Simulation; D005108:Extinction, Psychological; D005260:Female; D006801:Humans; D008297:Male; D008960:Models, Psychological; D011678:Punishment; D012201:Reward; D012727:Sex Characteristics; D013694:Temperament
keywords: Anxiety vulnerability; Avoidance; Computational model; Individual difference; Reinforcement learning; Safety-signal
references: J Cogn Neurosci. 2011 Jan;23(1):151-67
references: 20044893
references: Psychoneuroendocrinology. 2004 Aug;29(7):937-43
references: 15177710
references: J Clin Psychiatry. 1999;60 Suppl 18:4-15
references: 10487250
references: Behav Res Ther. 2012 Oct;50(10):604-9
references: 22835841
references: J Comp Physiol Psychol. 1964 Oct;58:252-7
references: 14215399
references: J Pers Soc Psychol. 2002 May;82(5):804-18
references: 12003479
references: Science. 2004 Apr 16;304(5669):452-4
references: 15087550
references: J Clin Psychiatry. 2006 Jun;67(6):882-9
references: 16848647
references: Neuropsychopharmacology. 2014 May;39(6):1420-30
references: 24336447
references: Q J Exp Psychol (Hove). 2008 Aug;61(8):1199-216
references: 18938780
references: J Pers Soc Psychol. 2000 Jun;78(6):1135-49
references: 10870914
references: J Anxiety Disord. 2009 May;23(4):504-10
references: 19062251
references: Front Behav Neurosci. 2014 Aug 18;8:283
references: 25183956
references: Q J Exp Psychol (Hove). 2006 Jun;59(6):1003-20
references: 16885140
references: Biol Psychiatry. 2009 Dec 15;66(12):1072-4
references: 19944792
references: Ann Clin Psychiatry. 2004 Oct-Dec;16(4):209-15
references: 15702569
references: Depress Anxiety. 2005;22(3):103-13
references: 16149043
references: J Exp Anal Behav. 1975 Sep;24(2):227-39
references: 16811875
references: Front Behav Neurosci. 2009 Oct 01;3:33
references: 19847311
references: Neuropsychopharmacology. 2004 Jun;29(6):1040-9
references: 14997176
references: Int J Eat Disord. 2011 May;44(4):317-24
references: 21472750
references: Integr Physiol Behav Sci. 2003 Jan-Mar;38(1):36-44
references: 12814195
references: Psychiatr Dev. 1986 Autumn;4(3):167-226
references: 3809156
references: Nat Neurosci. 2011 Feb;14(2):154-62
references: 21270784
references: Am J Psychiatry. 1998 Jun;155(6):768-73
references: 9619148
references: Learn Behav. 2010 Feb;38(1):50-67
references: 20065349
references: Behav Res Ther. 2007 Mar;45(3):601-6
references: 16712783
references: Behav Processes. 2014 Mar;103:228-35
references: 24412263
references: JAMA. 1999 Aug 25;282(8):755-62
references: 10463711
references: Psychiatry Res. 2004 Jan 15;130(1):79-84
references: 14972370
references: Proc Natl Acad Sci U S A. 2007 Oct 9;104(41):16311-6
references: 17913879
references: Biol Psychiatry. 2006 May 15;59(10):966-74
references: 16616726
references: Behav Processes. 2006 Sep;73(2):199-208
references: 16806735
references: Behav Brain Res. 2008 Oct 10;192(2):191-7
references: 18501974
references: Front Behav Neurosci. 2014 Sep 15;8:323
references: 25309373
references: Dialogues Clin Neurosci. 2010;12(4):517-31
references: 21319496
references: Stress. 2013 May;16(3):289-99
references: 23101990
references: Am J Psychiatry. 2011 Dec;168(12):1255-65
references: 21865528
references: Network. 2008;19(2):137-60
references: 18569725
references: Synapse. 1995 Jul;20(3):200-8
references: 7570351
references: Curr Biol. 2014 Mar 3;24(5):541-7
references: 24560572
references: Q J Exp Psychol B. 1996 Aug;49(3):270-83
references: 8828400
references: Prog Neuropsychopharmacol Biol Psychiatry. 2011 Aug 15;35(7):1659-70
references: 21601608
references: Arch Gen Psychiatry. 1987 Jun;44(6):573-88
references: 3579504
references: Prog Neuropsychopharmacol Biol Psychiatry. 2010 Aug 16;34(6):852-60
references: 20382195
references: Behav Brain Res. 2011 Dec 1;225(2):455-63
references: 21843556
references: Stress. 2012 Jan;15(1):31-44
references: 21790343
references: Nat Neurosci. 2009 Aug;12(8):1062-8
references: 19620978
references: Behav Brain Res. 2011 Mar 17;218(1):174-83
references: 21115068
references: Neural Comput. 2006 Feb;18(2):283-328
references: 16378516
references: J Exp Anal Behav. 2000 Nov;74(3):265-81
references: 11218225
references: J Neurosci. 2012 Oct 10;32(41):14118-24
references: 23055481
references: J Clin Psychiatry. 2006;67 Suppl 2:15-25
references: 16602811