Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2023 Dec 18;21(1):136.
doi: 10.1186/s12961-023-01082-7.

Prioritising and incentivising productivity within indicator-based approaches to Research Impact Assessment: a commentary

Affiliations

Prioritising and incentivising productivity within indicator-based approaches to Research Impact Assessment: a commentary

Simon Deeming et al. Health Res Policy Syst. .

Abstract

Research Impact Assessment (RIA) represents one of a suite of policies intended to improve the impact generated from investment in health and medical research (HMR). Positivist indicator-based approaches to RIA are widely implemented but increasingly criticised as theoretically problematic, unfair, and burdensome. This commentary proposes there are useful outcomes that emerge from the process of applying an indicator-based RIA framework, separate from those encapsulated in the metrics themselves. The aim for this commentary is to demonstrate how the act of conducting an indicator-based approach to RIA can serve to optimise the productive gains from the investment in HMR. Prior research found that the issues regarding RIA are less about the choice of indicators/metrics, and more about the discussions prompted and activities incentivised by the process. This insight provides an opportunity to utilise indicator-based methods to purposely optimise the research impact. An indicator-based RIA framework specifically designed to optimise research impacts should: focus on researchers and the research process, rather than institution-level measures; utilise a project level unit of analysis that provides control to researchers and supports collaboration and accountability; provide for prospective implementation of RIA and the prospective orientation of research; establish a line of sight to the ultimate anticipated beneficiaries and impacts; Include process metrics/indicators to acknowledge interim steps on the pathway to final impacts; integrate 'next' users and prioritise the utilisation of research outputs as a critical measure; Integrate and align the incentives for researchers/research projects arising from RIA, with those existing within the prevailing research system; integrate with existing peer-review processes; and, adopt a system-wide approach where incremental improvements in the probability of translation from individual research projects, yields higher impact across the whole funding portfolio.Optimisation of the impacts from HMR investment represents the primary purpose of Research Impact policy. The process of conducting an indicator-based approach to RIA, which engages the researcher during the inception and planning phase, can directly contribute to this goal through improvements in the probability that an individual project will generate interim impacts. The research project funding process represents a promising forum to integrate this approach within the existing research system.

Keywords: Australia; Health research; Medical research; Productivity; Research assessment; Research impact.

PubMed Disclaimer

Conflict of interest statement

The authors declare that they have no competing interests.

Figures

Fig. 1
Fig. 1
Generic subprocess of a research study demonstrating the guiding principles

Similar articles

Cited by

References

    1. Dyke T, Anderson WP. A history of health and medical research in Australia. Med J Aust. 2014;201(S1):S33–S36. doi: 10.5694/mja14.00347. - DOI - PubMed
    1. Deeming S. PhD Thesis: Measuring Research Impact in Australia's Medical Research Institutes: Prioritising productivity within Research Impact Assessment. Newcastle, New South Wales, Australia: University of Newcastle; 2022.
    1. The Cancer Council. Smoking prevalence and tobacco control in Australia. 2019. https://www.tobaccoinaustralia.org.au/appendix-1/a1-6-history-of-tobacco.... Accessed 1 Aug 2020.
    1. Australian Institute of Health and Welfare. Monitoring the health impacts of mandatory folic acid and iodine fortification. 2016.
    1. National Archives of Australia. Migrant Doctor Victor Chang's artificial heart valve Canberra 1991. https://www.naa.gov.au/learn/learning-resources/learning-resource-themes.... Accessed 1 Aug 2020.

LinkOut - more resources