Prioritising and incentivising productivity within indicator-based approaches to Research Impact Assessment: a commentary
- PMID: 38110938
- PMCID: PMC10726490
- DOI: 10.1186/s12961-023-01082-7
Prioritising and incentivising productivity within indicator-based approaches to Research Impact Assessment: a commentary
Abstract
Research Impact Assessment (RIA) represents one of a suite of policies intended to improve the impact generated from investment in health and medical research (HMR). Positivist indicator-based approaches to RIA are widely implemented but increasingly criticised as theoretically problematic, unfair, and burdensome. This commentary proposes there are useful outcomes that emerge from the process of applying an indicator-based RIA framework, separate from those encapsulated in the metrics themselves. The aim for this commentary is to demonstrate how the act of conducting an indicator-based approach to RIA can serve to optimise the productive gains from the investment in HMR. Prior research found that the issues regarding RIA are less about the choice of indicators/metrics, and more about the discussions prompted and activities incentivised by the process. This insight provides an opportunity to utilise indicator-based methods to purposely optimise the research impact. An indicator-based RIA framework specifically designed to optimise research impacts should: focus on researchers and the research process, rather than institution-level measures; utilise a project level unit of analysis that provides control to researchers and supports collaboration and accountability; provide for prospective implementation of RIA and the prospective orientation of research; establish a line of sight to the ultimate anticipated beneficiaries and impacts; Include process metrics/indicators to acknowledge interim steps on the pathway to final impacts; integrate 'next' users and prioritise the utilisation of research outputs as a critical measure; Integrate and align the incentives for researchers/research projects arising from RIA, with those existing within the prevailing research system; integrate with existing peer-review processes; and, adopt a system-wide approach where incremental improvements in the probability of translation from individual research projects, yields higher impact across the whole funding portfolio.Optimisation of the impacts from HMR investment represents the primary purpose of Research Impact policy. The process of conducting an indicator-based approach to RIA, which engages the researcher during the inception and planning phase, can directly contribute to this goal through improvements in the probability that an individual project will generate interim impacts. The research project funding process represents a promising forum to integrate this approach within the existing research system.
Keywords: Australia; Health research; Medical research; Productivity; Research assessment; Research impact.
© 2023. The Author(s).
Conflict of interest statement
The authors declare that they have no competing interests.
Figures
Similar articles
-
Measuring research impact in medical research institutes: a qualitative study of the attitudes and opinions of Australian medical research institutes towards research impact assessment frameworks.Health Res Policy Syst. 2018 Mar 16;16(1):28. doi: 10.1186/s12961-018-0300-6. Health Res Policy Syst. 2018. PMID: 29548331 Free PMC article.
-
Measuring research impact in Australia's medical research institutes: a scoping literature review of the objectives for and an assessment of the capabilities of research impact assessment frameworks.Health Res Policy Syst. 2017 Mar 21;15(1):22. doi: 10.1186/s12961-017-0180-1. Health Res Policy Syst. 2017. PMID: 28327199 Free PMC article. Review.
-
The future of Cochrane Neonatal.Early Hum Dev. 2020 Nov;150:105191. doi: 10.1016/j.earlhumdev.2020.105191. Epub 2020 Sep 12. Early Hum Dev. 2020. PMID: 33036834
-
Critical Care Network in the State of Qatar.Qatar Med J. 2019 Nov 7;2019(2):2. doi: 10.5339/qmj.2019.qccc.2. eCollection 2019. Qatar Med J. 2019. PMID: 31763205 Free PMC article.
-
What funders are doing to assess the impact of their investments in health and biomedical research.Health Res Policy Syst. 2022 Aug 9;20(1):88. doi: 10.1186/s12961-022-00888-1. Health Res Policy Syst. 2022. PMID: 35945538 Free PMC article. Review.
Cited by
-
Barriers and facilitators of translating doctoral research findings into policy: The case of a selected health sciences school in a South African university.Heliyon. 2024 Aug 31;10(18):e37314. doi: 10.1016/j.heliyon.2024.e37314. eCollection 2024 Sep 30. Heliyon. 2024. PMID: 39347414 Free PMC article.
References
-
- Deeming S. PhD Thesis: Measuring Research Impact in Australia's Medical Research Institutes: Prioritising productivity within Research Impact Assessment. Newcastle, New South Wales, Australia: University of Newcastle; 2022.
-
- The Cancer Council. Smoking prevalence and tobacco control in Australia. 2019. https://www.tobaccoinaustralia.org.au/appendix-1/a1-6-history-of-tobacco.... Accessed 1 Aug 2020.
-
- Australian Institute of Health and Welfare. Monitoring the health impacts of mandatory folic acid and iodine fortification. 2016.
-
- National Archives of Australia. Migrant Doctor Victor Chang's artificial heart valve Canberra 1991. https://www.naa.gov.au/learn/learning-resources/learning-resource-themes.... Accessed 1 Aug 2020.
MeSH terms
LinkOut - more resources
Full Text Sources