Enhancing retrieval of best evidence for health care from bibliographic databases: calibration of the hand search of the literature
- PMID: 11604770
Enhancing retrieval of best evidence for health care from bibliographic databases: calibration of the hand search of the literature
Abstract
Background: Medical practitioners have unmet information needs. Health care research dissemination suffers from both "supply" and "demand" problems. One possible solution is to develop methodologic search filters ("hedges") to improve the retrieval of clinically relevant and scientifically sound study reports from bibliographic databases. To develop and test such filters a hand search of the literature was required to determine directly which articles should be retrieved, and which not retrieved.
Objective: To determine the extent to which 6 research associates can agree on the classification of articles according to explicit research criteria when hand searching the literature.
Design: Blinded, inter-rater reliability study.
Setting: Health Information Research Unit, McMaster University, Hamilton, Ontario, Canada.
Participants: 6 research associates with extensive training and experience in research methods for health care research.
Main outcome measure: Inter-rater reliability measured using the kappa statistic for multiple raters.
Results: After one year of intensive calibration exercises research staff were able to attain a level of agreement at least 80% greater than that expected by chance (kappa statistic) for all classes of articles.
Conclusion: With extensive training multiple raters are able to attain a high level of agreement when classifying articles in a hand search of the literature.
Similar articles
-
Optimal search strategies for detecting clinically sound prognostic studies in EMBASE: an analytic survey.J Am Med Inform Assoc. 2005 Jul-Aug;12(4):481-5. doi: 10.1197/jamia.M1752. Epub 2005 Mar 31. J Am Med Inform Assoc. 2005. PMID: 15802476 Free PMC article.
-
Optimal search strategies for detecting cost and economic studies in EMBASE.BMC Health Serv Res. 2006 Jun 6;6:67. doi: 10.1186/1472-6963-6-67. BMC Health Serv Res. 2006. PMID: 16756662 Free PMC article.
-
An overview of the design and methods for retrieving high-quality studies for clinical care.BMC Med Inform Decis Mak. 2005 Jun 21;5:20. doi: 10.1186/1472-6947-5-20. BMC Med Inform Decis Mak. 2005. PMID: 15969765 Free PMC article.
-
Evaluation of methodological search filters--a review.Health Info Libr J. 2004 Sep;21(3):148-63. doi: 10.1111/j.1471-1842.2004.00511.x. Health Info Libr J. 2004. PMID: 15318913 Review.
-
Understanding the information needs of public health practitioners: a literature review to inform design of an interactive digital knowledge management system.J Biomed Inform. 2007 Aug;40(4):410-21. doi: 10.1016/j.jbi.2006.12.008. Epub 2007 Jan 11. J Biomed Inform. 2007. PMID: 17324632 Review.
Cited by
-
The effect of CETP inhibitors on new-onset diabetes: a systematic review and meta-analysis.Eur Heart J Cardiovasc Pharmacother. 2022 Sep 3;8(6):622-632. doi: 10.1093/ehjcvp/pvac025. Eur Heart J Cardiovasc Pharmacother. 2022. PMID: 35441656 Free PMC article.
-
Suicide Mortality Rate as a Sustainable Development Goal (SDG): A Bibliometric Analysis.Psychiatr Q. 2022 Mar;93(1):15-26. doi: 10.1007/s11126-020-09858-8. Epub 2020 Nov 19. Psychiatr Q. 2022. PMID: 33211227 Review.
-
Primary health care quality indicators: An umbrella review.PLoS One. 2019 Aug 16;14(8):e0220888. doi: 10.1371/journal.pone.0220888. eCollection 2019. PLoS One. 2019. PMID: 31419235 Free PMC article.
-
A Deep Learning Method to Automatically Identify Reports of Scientifically Rigorous Clinical Research from the Biomedical Literature: Comparative Analytic Study.J Med Internet Res. 2018 Jun 25;20(6):e10281. doi: 10.2196/10281. J Med Internet Res. 2018. PMID: 29941415 Free PMC article.
-
Optimal Timing of Complete Revascularization in Acute Coronary Syndrome: A Systematic Review and Meta-Analysis.J Am Heart Assoc. 2017 Apr 10;6(4):e005381. doi: 10.1161/JAHA.116.005381. J Am Heart Assoc. 2017. PMID: 28396570 Free PMC article. Review.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources