title: Embedding of semantic predications.
abstract: This paper concerns the generation of distributed vector representations of biomedical concepts from structured knowledge, in the form of subject-relation-object triplets known as semantic predications. Specifically, we evaluate the extent to which a representational approach we have developed for this purpose previously, known as Predication-based Semantic Indexing (PSI), might benefit from insights gleaned from neural-probabilistic language models, which have enjoyed a surge in popularity in recent years as a means to generate distributed vector representations of terms from free text. To do so, we develop a novel neural-probabilistic approach to encoding predications, called Embedding of Semantic Predications (ESP), by adapting aspects of the Skipgram with Negative Sampling (SGNS) algorithm to this purpose. We compare ESP and PSI across a number of tasks including recovery of encoded information, estimation of semantic similarity and relatedness, and identification of potentially therapeutic and harmful relationships using both analogical retrieval and supervised learning. We find advantages for ESP in some, but not all of these tasks, revealing the contexts in which the additional computational work of neural-probabilistic modeling is justified.
authors.affiliation: School of Biomedical Informatics, The University of Texas Health Science Center, Houston, TX, United States. Electronic address: trevor.cohen@uth.tmc.edu.
authors.forename: Trevor
authors.initials: T
authors.lastname: Cohen
authors.affiliation: Grab, Inc., Seattle, WA, United States.
authors.forename: Dominic
authors.initials: D
authors.lastname: Widdows
mesh_terms: D000465:Algorithms; D006801:Humans; D009323:Natural Language Processing; D012660:Semantics
keywords: Distributional semantics; Literature-based discovery; Pharmacovigilance; Predication-based semantic indexing; Semantic predications; Word embeddings