Interventions to prevent misconduct and promote integrity in research and publication
- PMID: 27040721
- PMCID: PMC7149854
- DOI: 10.1002/14651858.MR000038.pub2
Interventions to prevent misconduct and promote integrity in research and publication
Abstract
Background: Improper practices and unprofessional conduct in clinical research have been shown to waste a significant portion of healthcare funds and harm public health.
Objectives: Our objective was to evaluate the effectiveness of educational or policy interventions in research integrity or responsible conduct of research on the behaviour and attitudes of researchers in health and other research areas.
Search methods: We searched the CENTRAL, MEDLINE, LILACS and CINAHL health research bibliographical databases, as well as the Academic Search Complete, AGRICOLA, GeoRef, PsycINFO, ERIC, SCOPUS and Web of Science databases. We performed the last search on 15 April 2015 and the search was limited to articles published between 1990 and 2014, inclusive. We also searched conference proceedings and abstracts from research integrity conferences and specialized websites. We handsearched 14 journals that regularly publish research integrity research.
Selection criteria: We included studies that measured the effects of one or more interventions, i.e. any direct or indirect procedure that may have an impact on research integrity and responsible conduct of research in its broadest sense, where participants were any stakeholders in research and publication processes, from students to policy makers. We included randomized and non-randomized controlled trials, such as controlled before-and-after studies, with comparisons of outcomes in the intervention versus non-intervention group or before versus after the intervention. Studies without a control group were not included in the review.
Data collection and analysis: We used the standard methodological procedures expected by Cochrane. To assess the risk of bias in non-randomized studies, we used a modified Cochrane tool, in which we used four out of six original domains (blinding, incomplete outcome data, selective outcome reporting, other sources of bias) and two additional domains (comparability of groups and confounding factors). We categorized our primary outcome into the following levels: 1) organizational change attributable to intervention, 2) behavioural change, 3) acquisition of knowledge/skills and 4) modification of attitudes/perceptions. The secondary outcome was participants' reaction to the intervention.
Main results: Thirty-one studies involving 9571 participants, described in 33 articles, met the inclusion criteria. All were published in English. Fifteen studies were randomized controlled trials, nine were controlled before-and-after studies, four were non-equivalent controlled studies with a historical control, one was a non-equivalent controlled study with a post-test only and two were non-equivalent controlled studies with pre- and post-test findings for the intervention group and post-test for the control group. Twenty-one studies assessed the effects of interventions related to plagiarism and 10 studies assessed interventions in research integrity/ethics. Participants included undergraduates, postgraduates and academics from a range of research disciplines and countries, and the studies assessed different types of outcomes.We judged most of the included randomized controlled trials to have a high risk of bias in at least one of the assessed domains, and in the case of non-randomized trials there were no attempts to alleviate the potential biases inherent in the non-randomized designs.We identified a range of interventions aimed at reducing research misconduct. Most interventions involved some kind of training, but methods and content varied greatly and included face-to-face and online lectures, interactive online modules, discussion groups, homework and practical exercises. Most studies did not use standardized or validated outcome measures and it was impossible to synthesize findings from studies with such diverse interventions, outcomes and participants. Overall, there is very low quality evidence that various methods of training in research integrity had some effects on participants' attitudes to ethical issues but minimal (or short-lived) effects on their knowledge. Training about plagiarism and paraphrasing had varying effects on participants' attitudes towards plagiarism and their confidence in avoiding it, but training that included practical exercises appeared to be more effective. Training on plagiarism had inconsistent effects on participants' knowledge about and ability to recognize plagiarism. Active training, particularly if it involved practical exercises or use of text-matching software, generally decreased the occurrence of plagiarism although results were not consistent. The design of a journal's author contribution form affected the truthfulness of information supplied about individuals' contributions and the proportion of listed contributors who met authorship criteria. We identified no studies testing interventions for outcomes at the organizational level. The numbers of events and the magnitude of intervention effects were generally small, so the evidence is likely to be imprecise. No adverse effects were reported.
Authors' conclusions: The evidence base relating to interventions to improve research integrity is incomplete and the studies that have been done are heterogeneous, inappropriate for meta-analyses and their applicability to other settings and population is uncertain. Many studies had a high risk of bias because of the choice of study design and interventions were often inadequately reported. Even when randomized designs were used, findings were difficult to generalize. Due to the very low quality of evidence, the effects of training in responsible conduct of research on reducing research misconduct are uncertain. Low quality evidence indicates that training about plagiarism, especially if it involves practical exercises and use of text-matching software, may reduce the occurrence of plagiarism.
Conflict of interest statement
This review will be used by some of the authors as part of other research projects. AM reports that she was a co‐author on two studies included in the review. EW does not report conflict of Interest. HRR is one of the authors of the Comprehensive Meta Analysis (CMA) software. AU does not report conflict of interest. DS reports that he was a co‐author on one of the studies included in the review. Measures were taken within the review team to prevent biased handling of their own studies by the review authors.
Figures
Update of
- doi: 10.1002/14651858.MR000038
Similar articles
-
Folic acid supplementation and malaria susceptibility and severity among people taking antifolate antimalarial drugs in endemic areas.Cochrane Database Syst Rev. 2022 Feb 1;2(2022):CD014217. doi: 10.1002/14651858.CD014217. Cochrane Database Syst Rev. 2022. PMID: 36321557 Free PMC article.
-
The future of Cochrane Neonatal.Early Hum Dev. 2020 Nov;150:105191. doi: 10.1016/j.earlhumdev.2020.105191. Epub 2020 Sep 12. Early Hum Dev. 2020. PMID: 33036834
-
School-based interventions for reducing disciplinary school exclusion: a systematic review.Campbell Syst Rev. 2018 Jan 9;14(1):i-216. doi: 10.4073/csr.2018.1. eCollection 2018. Campbell Syst Rev. 2018. PMID: 37131379 Free PMC article.
-
Interventions for primary prevention of suicide in university and other post-secondary educational settings.Cochrane Database Syst Rev. 2014 Oct 29;2014(10):CD009439. doi: 10.1002/14651858.CD009439.pub2. Cochrane Database Syst Rev. 2014. PMID: 25353703 Free PMC article. Review.
-
Face-to-face interventions for informing or educating parents about early childhood vaccination.Cochrane Database Syst Rev. 2018 May 8;5(5):CD010038. doi: 10.1002/14651858.CD010038.pub3. Cochrane Database Syst Rev. 2018. PMID: 29736980 Free PMC article. Review.
Cited by
-
Institutional Approaches to Research Integrity in Ghana.Sci Eng Ethics. 2020 Dec;26(6):3037-3052. doi: 10.1007/s11948-020-00257-7. Epub 2020 Aug 10. Sci Eng Ethics. 2020. PMID: 32779114 Free PMC article. Review.
-
Quality of Occupational Therapy Research in India - A Descriptive Review.Indian J Occup Ther. 2022 Nov 16;54(3):91-95. doi: 10.4103/ijoth.ijoth_59_22. Indian J Occup Ther. 2022. PMID: 36506784 Free PMC article.
-
Ranking major and minor research misbehaviors: results from a survey among participants of four World Conferences on Research Integrity.Res Integr Peer Rev. 2016 Nov 21;1:17. doi: 10.1186/s41073-016-0024-5. eCollection 2016. Res Integr Peer Rev. 2016. PMID: 29451551 Free PMC article.
-
A Taxonomy for Research Intergrity Training: Design, Conduct, and Improvements in Research Integrity Courses.Sci Eng Ethics. 2023 Apr 25;29(3):14. doi: 10.1007/s11948-022-00425-x. Sci Eng Ethics. 2023. PMID: 37097508 Free PMC article.
-
Testing an active intervention to deter researchers' use of questionable research practices.Res Integr Peer Rev. 2019 Nov 29;4:24. doi: 10.1186/s41073-019-0085-3. eCollection 2019. Res Integr Peer Rev. 2019. PMID: 31798975 Free PMC article.
References
References to studies included in this review
Aggarwal 2011 {published data only}
Arnott 2008 {published data only}
-
- Arnott E, Hastings P, Allbritton D. Research Methods Tutor: evaluation of a dialogue‐based tutoring system in the classroom. Behavior Research Methods 2008;40:694‐8. - PubMed
Ballard 2013 {published data only}
-
- Ballard IB. The impact of an academic integrity module and Turnitin on similarity index scores of undergraduate student papers. Research in the Schools 2013;20:1‐13.
Barry 2006 {published data only}
-
- Barry ES. Can paraphrasing practice help students define plagiarism. College Student Journal 2006;40:377‐84.
Belter 2009 {published data only}
-
- Belter RW, du Pre A. A strategy to reduce plagiarism in an undergraduate course. Teaching of Psychology 2009;36:257‐61.
Bilić‐Zulle 2008 {published data only}
-
- Bilic Zulle L, Azman J, Frkovic V, Petrovecki M. Is there an effective approach to deterring students from plagiarizing?. Science and Engineering Ethics 2008;14:139‐47. - PubMed
-
- Bilić‐Zulle L, Frković V, Turk T, Ažman J, Petrovečki M. Prevalence of plagiarism among medical students. Croatian Medical Journal 2005;46:126‐31. - PubMed
Brown 2001 {published data only}
-
- Brown VJ, Howell ME. The efficacy of policy statements on plagiarism: do they change students' views?. Research in Higher Education 2001;42:103‐18.
Chao 2009 {published data only}
-
- Chao C‐A, Wilhelm WJ, Neureuther BD. A study of electronic detection and pedagogical approaches for reducing plagiarism. The Delta Pi Epsilon Journal 2009;51:31‐42.
Chertok 2014 {published data only}
-
- Chertok IRA, Barnes ER, Gilleland D. Academic integrity in the online learning environment for health science students. Nurse Education Today 2014;34:1324‐9. - PubMed
Clarkeburn 2002 {published data only}
-
- Clarkeburn H, Downie JR, Matthew B. Impact of an ethics programme in a life sciences curriculum. Teaching in Higher Education 2002;7:65‐79.
Compton 2008 {published data only}
-
- Compton J, Pfau M. Inoculating against pro‐plagiarism justifications: rational and affective strategies. Journal of Applied Communication Research 2008;36:98‐119.
Dee 2012 {published data only}
-
- Dee TS, Jacob BA. Rational ignorance in education: a field experiment in student plagiarism. Journal of Human Resources 2012;47:397‐434.
Estow 2011 {published data only}
-
- Estow S, Lawrence EK, Adams KA. Practice makes perfect: improving students’ skills in understanding and avoiding plagiarism with a themed methods course. Teaching of Psychology 2011;38:255‐9.
Fisher 1997 {published data only}
-
- Fisher CB, Kuther TL. Integrating research ethics into the introductory psychology course curriculum. Teaching of Psychology 1997;24:172‐5.
Hull 1994 {published data only}
-
- Hull R, Wurm‐Schaar M, James‐Valutis M, Triggle RD. The effect of a research ethics course on graduate student’s moral reasoning. http://www.richard‐t‐hull.com/publications/effect_research_ethics.pdf 1994.
Ivaniš 2008 {published data only}
Kose 2011 {published data only}
-
- Köse Ö, Arikan A. Reducing plagiarism by using online software: an experimental study. Contemporary Online Language Education Journal 2011;1:122‐9.
Landau 2002 {published data only}
-
- Landau JS, Druen PB, Arcuri JA. Methods for helping students avoid plagiarism. Teaching of Psychology 2002;29:112‐5.
Marshall 2011 {published data only}
-
- Marshall T, Taylor B, Hothersall E, Perez‐Martin L. Plagiarism: a case study of quality improvement in a taught postgraduate programme. Medical Teacher 2011;33:e375‐81. - PubMed
Marušić 2006 {published data only}
-
- Marušić A, Bates T, Anić A, Marušić M. How the structure of contribution disclosure statements affects validity of authorship: a randomized study in a general medical journal. Current Medical Research and Opinion 2006;22:1035‐44. - PubMed
May 2013 {published data only}
-
- May DR, Luth MT. The effectiveness of ethics education: a quasi‐experimental field study. Science and Engineering Ethics 2013;19:545‐68. - PubMed
Moniz 2008 {published data only}
-
- Moniz R, Fine J, Bliss L. The effectiveness of direct‐instruction and student‐centered teaching methods on students' functional understanding of plagiarism. College & Undergraduate Libraries 2008;15:255‐79.
Newton 2014 {published data only}
-
- Newton FJ, Wright JD, Newton JD. Skills training to avoid inadvertent plagiarism: results from a randomized study. Higher Education and Research 2014;33:1180‐93.
Risquez 2011 {published data only}
-
- Risquez A, O’Dwyer M, Ledwith A. Technology enhanced learning and plagiarism in entrepreneurship education. Education and Training 2011;53:750‐61.
Roberts 2007 {published data only}
-
- Roberts LW, Warner TD, Dunn LB, Brody JL, Hammond KAG, Roberts BB. Shaping medical students’ attitudes toward ethically important aspects of clinical research: results of a randomized, controlled educational intervention. Ethics and Behavior 2007;17:19‐50.
-
- Roberts LW, Warner TD, Hammond KAG, Brody JL, Kaminsky A, Roberts BB. Teaching medical students to discern ethical problems is human clinical research studies. Academic Medicine 2005;80:925‐30. - PubMed
Rolfe 2011 {published data only}
-
- Rolfe V. Can Turnitin be used to provide instant formative feedback. British Journal of Educational Technology 2011;42:701‐10.
Rose 1998 {published data only}
-
- Rose MR, Fischer K. Do authorship policies impact students’ judgments of perceived wrongdoings?. Ethics and Behavior 1988;8:59‐79. - PubMed
Schuetze 2004 {published data only}
-
- Schuetze P. Evaluation of a brief homework assignment designed to reduce citation problems. Teaching of Psychology 2004;31:257‐9.
Strohmetz 1992 {published data only}
-
- Strohmetz DB, Skleder AA. The use of role‐play in teaching research ethics: a validation study. Teaching of Psychology 1992;19:106‐8. - PubMed
Walker 2008 {published data only}
-
- Walker AL. Preventing unintentional plagiarism: a method for strengthening paraphrasing skills. Journal of Instructional Psychology 2008;35:387‐95.
Youmans 2011 {published data only}
-
- Youmans RJ. Does the adoption of plagiarism‐detection software in higher education reduce plagiarism?. Studies in Higher Education 2011;36:749‐61.
References to studies excluded from this review
Ali 2014 {published data only}
Bagdasarov 2013 {published data only}
-
- Bagdasarov Z, Thiel CE, Johnson JF, Connelly S, Harkrider LN, Devenport LD, et al. Case‐based ethics instruction: the influence of contextual and individual factors in case content on ethical decision‐making. Science and Engineering Ethics 2013;19:1305‐22. - PubMed
Goldie 2001 {published data only}
-
- Goldie J, Schwartz L, McConnachie A, Morrison J. Impact of a new course on students' potential behaviour on encountering ethical dilemmas. Medical Education 2001;35:295‐302. - PubMed
-
- Goldie J, Schwartz L, McConnachie A, Morrison J. The impact of three years’ ethics teaching, in an integrated medical curriculum, on students’ proposed behaviour on meeting ethical dilemmas. Medical Education 2002;36:489‐97. - PubMed
Gurung 2012 {published data only}
-
- Gurung RAR, Wilhelm TM, Filz T. Optimizing honor codes for online exam administration. Ethics and Behavior 2012;22:158‐62.
Harkrider 2012 {published and unpublished data}
-
- Harkrider LN, Thie CE, Bagdasarov Z, Mumford MD, Johnson JF, Connelly S, et al. Improving case‐based ethics training with codes of conduct and forecasting content. Ethics and Behavior 2012;22:258‐80.
Hren 2007 {published and unpublished data}
Kligyte 2008 {published data only}
-
- Kligyte V, Marcy RT, Waples EP, Sevier ST, Godfrey ES, Mumford MD, et al. Application of a sensemaking approach to ethics training in the physical sciences and engineering. Science and Engineering Ethics 2008;14:251‐78. - PubMed
May 2014 {published data only}
-
- May DR, Luth MT, Schwoerer CE. The influence of business ethics education on moral efficacy, moral meaningfulness, and moral courage: a quasi‐experimental study. Journal of Business Ethics 2014;124:67‐80.
McDonalds 2010 {published data only}
Mumford 2008 {published data only}
Pollock 1995 {published data only}
Powell 2007 {published data only}
-
- Powell ST, Allison MA, Kalichman MW. Effectiveness of a responsible conduct of research course: a preliminary study. Science and Engineering Ethics 2007;13:249‐64. - PubMed
Vallero 2007 {published data only}
-
- Vallero DA. Beyond responsible conduct in research: new pedagogies to address macroethics of nanobiotechnologies. Journal of Long‐Term Effects of Medical Implants 2007;17:1‐12. - PubMed
Additional references
Ajzen 2005
-
- Ajzen I, Fishbein M. The influence of attitudes on behavior. In: Albarracin D, Johnson BT, Zanna MP editor(s). The Handbook of Attitudes. Mahwah: Lawrence Erlbaum Associates, 2005.
Anderson 2007
-
- Anderson MS, Horn AS, Risbey KR, Ronning EA, Vries R, Martinson BC. What do mentoring and training in the responsible conduct of research have to do with scientists' misbehavior? Findings from a National Survey of NIH‐funded scientists. Academic Medicine 2007;82:853‐60. - PubMed
Angel 2004
-
- Angel M. The Truth About Drug Companies: How They Deceive Us and What to Do About It. New York: Random House, 2004.
Antes 2009
Armitage 2001
-
- Armitage CJ, Conner M. Efficacy of the theory of planned behaviour: a meta‐analytic review. British Journal of Social Psychology 2001;40:471‐99. - PubMed
Barr 2000
-
- Barr H, Freeth D, Hammick M, Koppel I, Reeves S. Evaluations of Interprofessional Education: A United Kingdom Review of Health and Social Care. London: Centre for the Advancement of Interprofessional Education (CAIPE), British Educational Research Association, 2000.
Boyd 2004
-
- Boyd EA, Lipton S, Bero LA. Implementation of financial disclosure policies to manage conflicts of interest. Health Affairs (Milwood) 2004;23:206‐14. - PubMed
Burnham 2006
Cogan 1953
-
- Cogan ML. Towards a definition of a profession. Harvard Educational Review 1953;23:33‐50.
Fanelli 2009
Funk 2007
-
- Funk CL, Barrett KA, Macrina FL. Authorship and publication practices: evaluation of the effect of responsible conduct of research instruction to postdoctoral trainees. Accountability in Research 2007;14:269‐305. - PubMed
Grade Working Group 2004
Headrick 2010
-
- Headrick TC. Statistical Simulation: Power Method Polynomials and Other Transformations. Boca Raton, FL, USA: Chapman & Hall/CRC, 2010:137.
Higgins 2011
-
- Higgins JPT, Green S (editors). Cochrane Handbook for Systematic Reviews of Interventions version 5.1.0 [updated March 2011]. The Cochrane Collaboration, 2011. Available from www.cochrane‐handbook.org.
Horsley 2011
Huwaldt 2014 [Computer program]
-
- Huwaldt JA. Plot Digitizer 2.6.6. Sourceforge.net, 2014.
ICAI 2013
-
- International Center for Academic Integrity, Fishman T(editor). The Fundamental Values of Academic Integrity. International Center for Academic Integrity, 2013.
ICMJE 2014
-
- International Committee of Medical Journal Editors. Recommendations for the conduct, reporting, editing, and publication of scholarly work in medical journals. http://icmje.org/recommendations/browse/roles‐and‐responsibilities/defin... December 2014. - PubMed
Institute of Medicine 2002
-
- Committee on Assessing Integrity in Research Environments. Integrity in Scientific Research. Washington DC: Institute of Medicine, National Research Council, 2002.
Kalichman 2014
Kirkpatrick 1967
-
- Kirkpatrick DL. Evaluation of training. In: Craig R, Bittel L editor(s). Training and Development Handbook. New York: McGraw Hill, 1967.
Komic 2015
Marusic 2011
Marusic 2013
Mhaskar 2015
Michalek 2010
Nylenna 1999
-
- Nylenna M, Andersen D, Dahlquist G, Sarvas M, Aakvaag A. Handling of scientific dishonesty in the Nordic countries. National committees on scientific dishonesty in the Nordic countries. Lancet 1999;354:57‐61. - PubMed
Plemmons 2006
-
- Plemmons DK, Brody SA, Kalichman MW. Student perceptions of the effectiveness of education in the responsible conduct of research. Science and Engineering Ethics 2006;12:571‐82. - PubMed
Plint 2006
-
- Plint AC, Moher D, Morrison A, Schulz K, Altman DG, Hill C, et al. Does the CONSORT checklist improve the quality of reports of randomised controlled trials? A systematic review. Medical Journal of Australia 2006;4:263‐7. - PubMed
Reich 2011
-
- Reich ES. Cancer trial errors revealed. Nature 2011;469:139‐40. - PubMed
Resnik 2011
RevMan 2014 [Computer program]
-
- The Nordic Cochrane Centre, The Cochrane Collaboration. Review Manager (RevMan). Version 5.3. Copenhagen: The Nordic Cochrane Centre, The Cochrane Collaboration, 2014.
Roig 1997
-
- Roig M. Can undergraduate students determine whether text has been plagiarized?. The Psychological Record 1997;47:113‐22.
Steneck 2006
-
- Steneck NH. Fostering integrity in research: definitions, current knowledge, and future directions. Science and Engineering Ethics 2006;12:53‐74. - PubMed
Sterne 2014
-
- Sterne JAC, Higgins JPT, Reeves BC on behalf of the development group for ACROBAT‐NRSI. A Cochrane Risk Of Bias Assessment Tool: for Non‐Randomized Studies of Interventions (ACROBAT‐NRSI), Version 1.0.0, 24 September 2014. Available from http://www.riskofbias.info (accessed 29 December 2015) .
Thomson Reuters 2011
-
- Thompson Reuters. EndNote X5. Thompson Reuters 2011.
Turner 2012
-
- Turner L, Shamseer L, Altman DG, Weeks L, Peters J, Kober T, et al. Consolidated standards of reporting trials (CONSORT) and the completeness of reporting of randomised controlled trials (RCTs) published in medical journals. Cochrane Database of Systematic Reviews 2012, Issue 11. [DOI: 10.1002/14651858.MR000030.pub2] - DOI - PMC - PubMed
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources
Miscellaneous