title: Professional and citizen bibliometrics: complementarities and ambivalences in the development and use of indicators-a state-of-the-art report.
abstract: Bibliometric indicators such as journal impact factors,h-indices, and total citation counts are algorithmic artifacts that can be used in research evaluation and management. These artifacts have no meaning by themselves, but receive their meaning from attributions in institutional practices. We distinguish four main stakeholders in these practices: (1) producers of bibliometric data and indicators; (2) bibliometricians who develop and test indicators; (3) research managers who apply the indicators; and (4) the scientists being evaluated with potentially competing career interests. These different positions may lead to different and sometimes conflicting perspectives on the meaning and value of the indicators. The indicators can thus be considered as boundary objects which are socially constructed in translations among these perspectives. This paper proposes an analytical clarification by listing an informed set of (sometimes unsolved) problems in bibliometrics which can also shed light on the tension between simple but invalid indicators that are widely used (e.g., theh-index) and more sophisticated indicators that are not used or cannot be used in evaluation practices because they are not transparent for users, cannot be calculated, or are difficult to interpret.
authors.affiliation: Amsterdam School of Communication Research (ASCoR), University of Amsterdam, P.O. Box 15793, 1001 NG Amsterdam, The Netherlands.
authors.forename: Loet
authors.identifier: 0000-0002-7835-3098
authors.initials: L
authors.lastname: Leydesdorff
authors.affiliation: Centre for Science and Technology Studies CWTS, Leiden University, P.O. Box 905, 2300 AX Leiden, The Netherlands.
authors.forename: Paul
authors.initials: P
authors.lastname: Wouters
authors.affiliation: Division for Science and Innovation Studies, Administrative Headquarters of the Max Planck Society, Hofgartenstr. 8, 80539 Munich, Germany.
authors.forename: Lutz
authors.initials: L
authors.lastname: Bornmann
keywords: Boundary object; Evaluative bibliometrics; Scientometric indicators; Validity