title: Identifying potential indicators to measure the outcome of translational cancer research: a mixed methods approach.
abstract: BACKGROUND
  In a context where there is an increasing demand to evaluate the outcome of bio-medical research, our work aims to develop a set of indicators to measure the impact of translational cancer research. The objective of our study was to explore the scope and issues of translational research relevant to evaluation, explore the views of researchers on the evaluation of oncological translational research, and select indicators measuring the outcomes and outputs of translational research in oncology by consensus.
  
  
  METHODS
  Semi-structured interviews amongst 23 researchers involved in translational cancer research were conducted and analysed using thematic analysis. A two-round modified Delphi survey of 35 participants with similar characteristics was then performed followed by a physical meeting. Participants rated the feasibility and validity of 60 indicators. The physical meeting was held to discuss the methodology of the new indicators.
  
  
  RESULTS
  The main themes emerging from the interviews included a common definition for translational research but disagreements about the exact scope and limits of this research, the importance of multidisciplinarity and collaboration for the success of translational research, the disadvantages that translational research faces in current evaluation systems, the relative lack of pertinence of existing indicators, and propositions to measure translational cancer research in terms of clinical applications and patient outcomes. A total of 35 participants took part in the first round survey and 12 in the second round. The two-round survey helped us select a set of 18 indicators, including four that seemed to be particularly adapted to measure translational cancer research impact on health service research (number of biomarkers identified, generation of clinical guidelines, citation of research in clinical guidelines, and citation of research in public health guidelines). The feedback from participants helped refine the methodology and definition of indicators not commonly used.
  
  
  CONCLUSIONS
  Indicators need to be accepted by stakeholders under evaluation. This study helped the selection and refinement of indicators considered as the most relevant by researchers in translational cancer research. The feasibility and validity of those indicators will be tested in a scientometric study.
authors.affiliation: European and International Affairs Unit, Gustave Roussy, Villejuif, France. frederique.thonon@gustaveroussy.fr.|AP-HP, Hôpital Robert Debré, Unité d'épidémiologie clinique, Paris, France. frederique.thonon@gustaveroussy.fr.|Université Paris Diderot, Sorbonne Paris Cité, UMR-S 1123 and CIC-EC 1426, ECEVE, Paris, France. frederique.thonon@gustaveroussy.fr.|INSERM, U 1123 and CIC-EC 1426, ECEVE, Paris, France. frederique.thonon@gustaveroussy.fr.
authors.forename: Frédérique
authors.initials: F
authors.lastname: Thonon
authors.affiliation: AP-HP, Hôpital Robert Debré, Unité d'épidémiologie clinique, Paris, France. rym.boulkedid@aphp.fr.|Université Paris Diderot, Sorbonne Paris Cité, UMR-S 1123 and CIC-EC 1426, ECEVE, Paris, France. rym.boulkedid@aphp.fr.|INSERM, U 1123 and CIC-EC 1426, ECEVE, Paris, France. rym.boulkedid@aphp.fr.
authors.forename: Rym
authors.initials: R
authors.lastname: Boulkedid
authors.affiliation: AP-HP, Hôpital Robert Debré, Unité d'épidémiologie clinique, Paris, France. maria.teixeira@aphp.fr.
authors.forename: Maria
authors.initials: M
authors.lastname: Teixeira
authors.affiliation: AP-HP, Hôpital Robert Debré, Unité d'épidémiologie clinique, Paris, France. serge.gottot@rdb.aphp.fr.|Université Paris Diderot, Sorbonne Paris Cité, UMR-S 1123 and CIC-EC 1426, ECEVE, Paris, France. serge.gottot@rdb.aphp.fr.|INSERM, U 1123 and CIC-EC 1426, ECEVE, Paris, France. serge.gottot@rdb.aphp.fr.
authors.forename: Serge
authors.initials: S
authors.lastname: Gottot
authors.affiliation: European and International Affairs Unit, Gustave Roussy, Villejuif, France. mahasti.sagahtchian@gustaveroussy.fr.
authors.forename: Mahasti
authors.initials: M
authors.lastname: Saghatchian
authors.affiliation: AP-HP, Hôpital Robert Debré, Unité d'épidémiologie clinique, Paris, France. corinne.alberti@inserm.fr.|Université Paris Diderot, Sorbonne Paris Cité, UMR-S 1123 and CIC-EC 1426, ECEVE, Paris, France. corinne.alberti@inserm.fr.|INSERM, U 1123 and CIC-EC 1426, ECEVE, Paris, France. corinne.alberti@inserm.fr.
authors.forename: Corinne
authors.initials: C
authors.lastname: Alberti
mesh_terms: D000328:Adult; D001291:Attitude of Health Personnel; D035843:Biomedical Research; D002985:Clinical Protocols; D032921:Consensus; D005260:Female; D006302:Health Services Research; D006801:Humans; D008297:Male; D009369:Neoplasms; D017064:Process Assessment, Health Care; D019984:Quality Indicators, Health Care; D012108:Research Personnel; D011795:Surveys and Questionnaires; D057170:Translational Research, Biomedical