title: Interaction and behaviour imaging: a novel method to measure mother-infant interaction using video 3D reconstruction.
abstract: Studying early interaction is essential for understanding development and psychopathology. Automatic computational methods offer the possibility to analyse social signals and behaviours of several partners simultaneously and dynamically. Here, 20 dyads of mothers and their 13-36-month-old infants were videotaped during mother-infant interaction including 10 extremely high-risk and 10 low-risk dyads using two-dimensional (2D) and three-dimensional (3D) sensors. From 2D+3D data and 3D space reconstruction, we extracted individual parameters (quantity of movement and motion activity ratio for each partner) and dyadic parameters related to the dynamics of partners heads distance (contribution to heads distance), to the focus of mutual engagement (percentage of time spent face to face or oriented to the task) and to the dynamics of motion activity (synchrony ratio, overlap ratio, pause ratio). Features are compared with blind global rating of the interaction using the coding interactive behavior (CIB). We found that individual and dyadic parameters of 2D+3D motion features perfectly correlates with rated CIB maternal and dyadic composite scores. Support Vector Machine classification using all 2D-3D motion features classified 100% of the dyads in their group meaning that motion behaviours are sufficient to distinguish high-risk from low-risk dyads. The proposed method may present a promising, low-cost methodology that can uniquely use artificial technology to detect meaningful features of human interactions and may have several implications for studying dyadic behaviours in psychiatry. Combining both global rating scales and computerized methods may enable a continuum of time scale from a summary of entire interactions to second-by-second dynamics.
authors.affiliation: Institut des Systèmes Intelligents et de Robotiques, CNRS, UMR 7222, Sorbonne Universités, Université Pierre et Marie Curie, Paris, France.|Department of Child and Adolescent Psychiatry, Pitié-Salpêtrière Hospital, AP-HP, Paris, France.|Laboratoire de Psychologie Clinique et Psychopathologie, Psychanalyse, EA4056, Paris V René Descartes University, Boulogne, France.
authors.forename: C
authors.initials: C
authors.lastname: Leclère
authors.affiliation: Institut des Systèmes Intelligents et de Robotiques, CNRS, UMR 7222, Sorbonne Universités, Université Pierre et Marie Curie, Paris, France.
authors.forename: M
authors.initials: M
authors.lastname: Avril
authors.affiliation: Institut des Systèmes Intelligents et de Robotiques, CNRS, UMR 7222, Sorbonne Universités, Université Pierre et Marie Curie, Paris, France.|Department of Child and Adolescent Psychiatry, Pitié-Salpêtrière Hospital, AP-HP, Paris, France.
authors.forename: S
authors.initials: S
authors.lastname: Viaux-Savelon
authors.affiliation: Department of Child and Adolescent Psychiatry, Pitié-Salpêtrière Hospital, AP-HP, Paris, France.
authors.forename: N
authors.initials: N
authors.lastname: Bodeau
authors.affiliation: Institut des Systèmes Intelligents et de Robotiques, CNRS, UMR 7222, Sorbonne Universités, Université Pierre et Marie Curie, Paris, France.
authors.forename: C
authors.initials: C
authors.lastname: Achard
authors.affiliation: Laboratoire de Psychologie Clinique et Psychopathologie, Psychanalyse, EA4056, Paris V René Descartes University, Boulogne, France.
authors.forename: S
authors.initials: S
authors.lastname: Missonnier
authors.affiliation: Department of Psychiatry, Infant Mental Health Unit, Geha Hospital, Tel Aviv University, Tel Aviv, Israel.
authors.forename: M
authors.initials: M
authors.lastname: Keren
authors.affiliation: Department of Psychology and the Gonda Brain Sciences Center, Bar-Ilan University, Ramat-Gan, Israel.
authors.forename: R
authors.initials: R
authors.lastname: Feldman
authors.affiliation: Institut des Systèmes Intelligents et de Robotiques, CNRS, UMR 7222, Sorbonne Universités, Université Pierre et Marie Curie, Paris, France.
authors.forename: M
authors.initials: M
authors.lastname: Chetouani
authors.affiliation: Institut des Systèmes Intelligents et de Robotiques, CNRS, UMR 7222, Sorbonne Universités, Université Pierre et Marie Curie, Paris, France.|Department of Child and Adolescent Psychiatry, Pitié-Salpêtrière Hospital, AP-HP, Paris, France.
authors.forename: D
authors.initials: D
authors.lastname: Cohen
mesh_terms: D000328:Adult; D002675:Child, Preschool; D005260:Female; D006801:Humans; D021621:Imaging, Three-Dimensional; D007223:Infant; D008297:Male; D009034:Mother-Child Relations; D014741:Video Recording