title: Missing mass approximations for the partition function of stimulus driven Ising models.
abstract: Ising models are routinely used to quantify the second order, functional structure of neural populations. With some recent exceptions, they generally do not include the influence of time varying stimulus drive. Yet if the dynamics of network function are to be understood, time varying stimuli must be taken into account. Inclusion of stimulus drive carries a heavy computational burden because the partition function becomes stimulus dependent and must be separately calculated for all unique stimuli observed. This potentially increases computation time by the length of the data set. Here we present an extremely fast, yet simply implemented, method for approximating the stimulus dependent partition function in minutes or seconds. Noting that the most probable spike patterns (which are few) occur in the training data, we sum partition function terms corresponding to those patterns explicitly. We then approximate the sum over the remaining patterns (which are improbable, but many) by casting it in terms of the stimulus modulated missing mass (total stimulus dependent probability of all patterns not observed in the training data). We use a product of conditioned logistic regression models to approximate the stimulus modulated missing mass. This method has complexity of roughly O(LNNpat) where is L the data length, N the number of neurons and N pat the number of unique patterns in the data, contrasting with the O(L2 (N) ) complexity of alternate methods. Using multiple unit recordings from rat hippocampus, macaque DLPFC and cat Area 18 we demonstrate our method requires orders of magnitude less computation time than Monte Carlo methods and can approximate the stimulus driven partition function more accurately than either Monte Carlo methods or deterministic approximations. This advance allows stimuli to be easily included in Ising models making them suitable for studying population based stimulus encoding.
authors.affiliation: Martinos Center for Biomedical Imaging, Massachusetts General Hospital Charlestown, MA, USA ; Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology Cambridge, MA, USA.
authors.forename: Robert
authors.initials: R
authors.lastname: Haslinger
authors.forename: Demba
authors.initials: D
authors.lastname: Ba
authors.forename: Ralf
authors.initials: R
authors.lastname: Galuske
authors.forename: Ziv
authors.initials: Z
authors.lastname: Williams
authors.forename: Gordon
authors.initials: G
authors.lastname: Pipa
keywords: Ising model; multiple unit recordings; network function; partition function; population codes; stimulus coding
references.citation: PLoS Biol. 2008 Jan;6(1):e16
references.pmid: 18232737
references.citation: PLoS One. 2012;7(7):e39699
references.pmid: 22802940
references.citation: Front Comput Neurosci. 2009 Nov 17;3:22
references.pmid: 19949460
references.citation: IEEE Trans Neural Syst Rehabil Eng. 2005 Jun;13(2):131-6
references.pmid: 16003890
references.citation: Nat Neurosci. 2010 Jan;13(1):105-11
references.pmid: 19966837
references.citation: Front Comput Neurosci. 2011 Jan 07;5:4
references.pmid: 21344015
references.citation: PLoS Comput Biol. 2009 May;5(5):e1000380
references.pmid: 19424487
references.citation: J Physiol Paris. 2009 Jan-Mar;103(1-2):107-13
references.pmid: 19616623
references.citation: Neural Comput. 1999 Jan 1;11(1):91-101
references.pmid: 9950724
references.citation: Proc Biol Sci. 1997 Dec 22;264(1389):1775-83
references.pmid: 9447735
references.citation: Science. 1995 Aug 4;269(5224):702-5
references.pmid: 7624802
references.citation: Proc Biol Sci. 2013 Jan 7;280(1750):20121931
references.pmid: 23097514
references.citation: Proc Natl Acad Sci U S A. 2011 Jun 7;108(23):9679-84
references.pmid: 21602497
references.citation: Phys Rev Lett. 2012 Aug 3;109(5):050602
references.pmid: 23006160
references.citation: Proc Natl Acad Sci U S A. 2009 Apr 7;106(14):5936-41
references.pmid: 19297621
references.citation: J Neurosci. 2003 Aug 20;23(20):7630-41
references.pmid: 12930802
references.citation: Proc Natl Acad Sci U S A. 2008 Oct 21;105(42):16344-9
references.pmid: 18854413
references.citation: Phys Rev Lett. 2011 Mar 4;106(9):090601
references.pmid: 21405611
references.citation: Proc Natl Acad Sci U S A. 2010 Aug 10;107(32):14419-24
references.pmid: 20660781
references.citation: J Neurosci. 2008 Jan 9;28(2):505-18
references.pmid: 18184793
references.citation: PLoS Comput Biol. 2013;9(3):e1002922
references.pmid: 23516339
references.citation: Neural Comput. 2009 Oct;21(10):2774-804
references.pmid: 19635014
references.citation: Science. 2003 Oct 17;302(5644):427-31
references.pmid: 14564004
references.citation: Neural Comput. 2004 Feb;16(2):277-307
references.pmid: 15006097
references.citation: Ann Stat. 2013 Apr;41(2):508-535
references.pmid: 26166910
references.citation: Phys Rev Lett. 2012 Mar 2;108(9):090201
references.pmid: 22463617
references.citation: Nat Rev Neurosci. 2006 May;7(5):358-66
references.pmid: 16760916
references.citation: J Comput Neurosci. 2012 Feb;32(1):101-18
references.pmid: 21667155
references.citation: Neural Comput. 2005 Sep;17(9):1927-61
references.pmid: 15992486
references.citation: Neural Comput. 2013 Aug;25(8):1953-93
references.pmid: 23607564
references.citation: J Neurophysiol. 2005 Feb;93(2):1074-89
references.pmid: 15356183
references.citation: Nature. 2006 Apr 20;440(7087):1007-12
references.pmid: 16625187
references.citation: Nature. 2008 Aug 21;454(7207):995-9
references.pmid: 18650810
references.citation: Nature. 2001 Jun 7;411(6838):698-701
references.pmid: 11395773
references.citation: Science. 2000 Feb 18;287(5456):1273-6
references.pmid: 10678835
references.citation: Neural Comput. 2000 Nov;12(11):2621-53
references.pmid: 11110130
references.citation: Phys Rev Lett. 2011 Nov 25;107(22):220601
references.pmid: 22182019