title: How accurately does the VIVO Harvester reflect actual Clinical and Translational Sciences Award-affiliated faculty member publications?
abstract: OBJECTIVE
  The research tested the accuracy of the VIVO Harvester software in identifying publications authored by faculty members affiliated with a National Institutes of Health Clinical and Translational Sciences Award (CTSA) site.
  
  
  METHODS
  Health sciences librarians created "gold standard" lists of references for the years 2001 to 2011 from PubMed for twenty-five randomly selected investigators from one CTSA site. These gold standard lists were compared to the same twenty-five investigators' reference lists produced by VIVO Harvester. The authors subjected the discrepancies between the lists to sensitivity and specificity analyses.
  
  
  RESULTS
  The VIVO Harvester correctly identified only about 65% of the total eligible PubMed references for the years 2001-2011 for the CTSA-affiliated investigators. The identified references produced by VIVO Harvester were precise yet incomplete. The sensitivity rate was 0.65, and the specificity rate was 1.00.
  
  
  CONCLUSIONS
  While the references produced by VIVO Harvester could be confirmed in PubMed, the VIVO Harvester retrieved only two-thirds of the required references from PubMed. National Institutes of Health CTSA sites will need to supplement VIVO Harvester-produced references with the expert searching skills of health sciences librarians.
  
  
  CONCLUSIONS
  Health sciences librarians with searching skills need to alert their CTSA sites about these deficiencies and offer their skills to advance their sites' missions.
authors.affiliation: jeldredge@ unm.edu , Associate Professor, Biomedical Informatics Research, Training and Scholarship, Health Sciences Library and Informatics Center/Family and Community Medicine, University of New Mexico, MSC09 5100, Albuquerque, NM 87131-0001; pkroth@salud.unm.edu , Director, Biomedical Informatics, Research, Training and Scholarship, and Associate Professor and Section Chief for Clinical Informatics, Divisions of Translational Informatics and General Internal Medicine, Department of Internal Medicine, School of Medicine, University of New Mexico, MSC09 5100, Albuquerque, NM 87131-0001; cmurray-krezan@unm.edu , Research Assistant Professor, Department of Internal Medicine, Division of Epidemiology, Biostatistics, and Preventive Medicine, University of New Mexico, MSC10 0555, Albuquerque, NM 87131-0001; MHantak@unm.edu , Analyst/Programmer, Clinical and Translational Sciences Center, University of New Mexico, MSC 08 4635, Albuquerque, NM 87131-0001; EdWeagel@unm.edu , Biomedical Informatics Manager, Clinical and Translational Sciences Center, University of New Mexico, MSC 08 4635, Albuquerque, NM 87131-0001; ghannigan@salud.unm.edu , Research Professor, Health\Sciences Library and Informatics Center, University of New Mexico, MSC 09 5100, Albuquerque, NM 87131-0001.
authors.forename: Jonathan D
authors.initials: JD
authors.lastname: Eldredge
authors.affiliation: jeldredge@ unm.edu , Associate Professor, Biomedical Informatics Research, Training and Scholarship, Health Sciences Library and Informatics Center/Family and Community Medicine, University of New Mexico, MSC09 5100, Albuquerque, NM 87131-0001; pkroth@salud.unm.edu , Director, Biomedical Informatics, Research, Training and Scholarship, and Associate Professor and Section Chief for Clinical Informatics, Divisions of Translational Informatics and General Internal Medicine, Department of Internal Medicine, School of Medicine, University of New Mexico, MSC09 5100, Albuquerque, NM 87131-0001; cmurray-krezan@unm.edu , Research Assistant Professor, Department of Internal Medicine, Division of Epidemiology, Biostatistics, and Preventive Medicine, University of New Mexico, MSC10 0555, Albuquerque, NM 87131-0001; MHantak@unm.edu , Analyst/Programmer, Clinical and Translational Sciences Center, University of New Mexico, MSC 08 4635, Albuquerque, NM 87131-0001; EdWeagel@unm.edu , Biomedical Informatics Manager, Clinical and Translational Sciences Center, University of New Mexico, MSC 08 4635, Albuquerque, NM 87131-0001; ghannigan@salud.unm.edu , Research Professor, Health\Sciences Library and Informatics Center, University of New Mexico, MSC 09 5100, Albuquerque, NM 87131-0001.
authors.forename: Philip J
authors.initials: PJ
authors.lastname: Kroth
authors.affiliation: jeldredge@ unm.edu , Associate Professor, Biomedical Informatics Research, Training and Scholarship, Health Sciences Library and Informatics Center/Family and Community Medicine, University of New Mexico, MSC09 5100, Albuquerque, NM 87131-0001; pkroth@salud.unm.edu , Director, Biomedical Informatics, Research, Training and Scholarship, and Associate Professor and Section Chief for Clinical Informatics, Divisions of Translational Informatics and General Internal Medicine, Department of Internal Medicine, School of Medicine, University of New Mexico, MSC09 5100, Albuquerque, NM 87131-0001; cmurray-krezan@unm.edu , Research Assistant Professor, Department of Internal Medicine, Division of Epidemiology, Biostatistics, and Preventive Medicine, University of New Mexico, MSC10 0555, Albuquerque, NM 87131-0001; MHantak@unm.edu , Analyst/Programmer, Clinical and Translational Sciences Center, University of New Mexico, MSC 08 4635, Albuquerque, NM 87131-0001; EdWeagel@unm.edu , Biomedical Informatics Manager, Clinical and Translational Sciences Center, University of New Mexico, MSC 08 4635, Albuquerque, NM 87131-0001; ghannigan@salud.unm.edu , Research Professor, Health\Sciences Library and Informatics Center, University of New Mexico, MSC 09 5100, Albuquerque, NM 87131-0001.
authors.forename: Cristina
authors.initials: C
authors.lastname: Murray-Krezan
authors.affiliation: jeldredge@ unm.edu , Associate Professor, Biomedical Informatics Research, Training and Scholarship, Health Sciences Library and Informatics Center/Family and Community Medicine, University of New Mexico, MSC09 5100, Albuquerque, NM 87131-0001; pkroth@salud.unm.edu , Director, Biomedical Informatics, Research, Training and Scholarship, and Associate Professor and Section Chief for Clinical Informatics, Divisions of Translational Informatics and General Internal Medicine, Department of Internal Medicine, School of Medicine, University of New Mexico, MSC09 5100, Albuquerque, NM 87131-0001; cmurray-krezan@unm.edu , Research Assistant Professor, Department of Internal Medicine, Division of Epidemiology, Biostatistics, and Preventive Medicine, University of New Mexico, MSC10 0555, Albuquerque, NM 87131-0001; MHantak@unm.edu , Analyst/Programmer, Clinical and Translational Sciences Center, University of New Mexico, MSC 08 4635, Albuquerque, NM 87131-0001; EdWeagel@unm.edu , Biomedical Informatics Manager, Clinical and Translational Sciences Center, University of New Mexico, MSC 08 4635, Albuquerque, NM 87131-0001; ghannigan@salud.unm.edu , Research Professor, Health\Sciences Library and Informatics Center, University of New Mexico, MSC 09 5100, Albuquerque, NM 87131-0001.
authors.forename: Chad M
authors.initials: CM
authors.lastname: Hantak
authors.affiliation: jeldredge@ unm.edu , Associate Professor, Biomedical Informatics Research, Training and Scholarship, Health Sciences Library and Informatics Center/Family and Community Medicine, University of New Mexico, MSC09 5100, Albuquerque, NM 87131-0001; pkroth@salud.unm.edu , Director, Biomedical Informatics, Research, Training and Scholarship, and Associate Professor and Section Chief for Clinical Informatics, Divisions of Translational Informatics and General Internal Medicine, Department of Internal Medicine, School of Medicine, University of New Mexico, MSC09 5100, Albuquerque, NM 87131-0001; cmurray-krezan@unm.edu , Research Assistant Professor, Department of Internal Medicine, Division of Epidemiology, Biostatistics, and Preventive Medicine, University of New Mexico, MSC10 0555, Albuquerque, NM 87131-0001; MHantak@unm.edu , Analyst/Programmer, Clinical and Translational Sciences Center, University of New Mexico, MSC 08 4635, Albuquerque, NM 87131-0001; EdWeagel@unm.edu , Biomedical Informatics Manager, Clinical and Translational Sciences Center, University of New Mexico, MSC 08 4635, Albuquerque, NM 87131-0001; ghannigan@salud.unm.edu , Research Professor, Health\Sciences Library and Informatics Center, University of New Mexico, MSC 09 5100, Albuquerque, NM 87131-0001.
authors.forename: Edward F
authors.initials: EF
authors.lastname: Weagel
authors.affiliation: jeldredge@ unm.edu , Associate Professor, Biomedical Informatics Research, Training and Scholarship, Health Sciences Library and Informatics Center/Family and Community Medicine, University of New Mexico, MSC09 5100, Albuquerque, NM 87131-0001; pkroth@salud.unm.edu , Director, Biomedical Informatics, Research, Training and Scholarship, and Associate Professor and Section Chief for Clinical Informatics, Divisions of Translational Informatics and General Internal Medicine, Department of Internal Medicine, School of Medicine, University of New Mexico, MSC09 5100, Albuquerque, NM 87131-0001; cmurray-krezan@unm.edu , Research Assistant Professor, Department of Internal Medicine, Division of Epidemiology, Biostatistics, and Preventive Medicine, University of New Mexico, MSC10 0555, Albuquerque, NM 87131-0001; MHantak@unm.edu , Analyst/Programmer, Clinical and Translational Sciences Center, University of New Mexico, MSC 08 4635, Albuquerque, NM 87131-0001; EdWeagel@unm.edu , Biomedical Informatics Manager, Clinical and Translational Sciences Center, University of New Mexico, MSC 08 4635, Albuquerque, NM 87131-0001; ghannigan@salud.unm.edu , Research Professor, Health\Sciences Library and Informatics Center, University of New Mexico, MSC 09 5100, Albuquerque, NM 87131-0001.
authors.forename: Gale G
authors.initials: GG
authors.lastname: Hannigan
mesh_terms: D001363:Awards and Prizes; D035843:Biomedical Research; D006801:Humans; D033181:Information Dissemination; D016247:Information Storage and Retrieval / Q000706:statistics & numerical data*; D007993:Libraries, Medical / Q000458:organization & administration*; D016239:MEDLINE / Q000706:statistics & numerical data*; D010506:Periodicals as Topic / Q000706:statistics & numerical data*; D057170:Translational Research, Biomedical / Q000706:statistics & numerical data*