The measurement of observer agreement for categorical data
- PMID: 843571
Item in Clipboard
The measurement of observer agreement for categorical data
Biometrics.
1977 Mar.
Abstract
This paper presents a general statistical methodology for the analysis of multivariate categorical data arising from observer reliability studies. The procedure essentially involves the construction of functions of the observed proportions which are directed at the extent to which the observers agree among themselves and the construction of test statistics for hypotheses involving these functions. Tests for interobserver bias are presented in terms of first-order marginal homogeneity and measures of interobserver agreement are developed as generalized kappa-type statistics. These procedures are illustrated with a clinical diagnosis example from the epidemiological literature.
Similar articles
-
Graphical aids for visualizing and interpreting patterns in departures from agreement in ordinal categorical observer agreement data.J Biopharm Stat. 2017;27(5):773-783. doi: 10.1080/10543406.2016.1273941. Epub 2017 Feb 13. J Biopharm Stat. 2017. PMID: 28010186
-
A computer program for the generalized chi-square analysis of categorical data using weighted least squares (GENCAT).Comput Programs Biomed. 1976 Dec;6(4):196-231. doi: 10.1016/0010-468x(76)90037-4. Comput Programs Biomed. 1976. PMID: 1009762
-
Interobserver and intraobserver reliability in the load sharing classification of the assessment of thoracolumbar burst fractures.Spine (Phila Pa 1976). 2005 Feb 1;30(3):354-8. doi: 10.1097/01.brs.0000152095.85927.24. Spine (Phila Pa 1976). 2005. PMID: 15682019
-
Statistical methods in epidemiology. v. Towards an understanding of the kappa coefficient.Disabil Rehabil. 2000 May 20;22(8):339-44. doi: 10.1080/096382800296575. Disabil Rehabil. 2000. PMID: 10896093 Review.
-
Measures of interrater agreement.J Thorac Oncol. 2011 Jan;6(1):6-7. doi: 10.1097/JTO.0b013e318200f983. J Thorac Oncol. 2011. PMID: 21178713 Review.
Cited by
-
Lithium disilicate, full coverage crowns: what is the effect of using conventional impressions compared to digital impression with respect to the internal fit of the restoration? A systematic review.Evid Based Dent. 2024 Oct 30. doi: 10.1038/s41432-024-01075-7. Online ahead of print. Evid Based Dent. 2024. PMID: 39472507
-
Diagnostic significance of peritumoral enhancement in distinguishing between muscle-invasive and non-muscle-invasive bladder cancer.Abdom Radiol (NY). 2024 Oct 30. doi: 10.1007/s00261-024-04658-1. Online ahead of print. Abdom Radiol (NY). 2024. PMID: 39472381
-
Methods to optimize optical sensing of biotic plant stress - combined effects of hyperspectral imaging at night and spatial binning.Plant Methods. 2024 Oct 28;20(1):163. doi: 10.1186/s13007-024-01292-2. Plant Methods. 2024. PMID: 39468668 Free PMC article.
-
Pericardial adhesion and performance of hemodynamically significant constrictive pericarditis using cine magnetic resonance feature tracking.Int J Cardiovasc Imaging. 2024 Oct 28. doi: 10.1007/s10554-024-03272-y. Online ahead of print. Int J Cardiovasc Imaging. 2024. PMID: 39466497
-
Reply to Letter to the Editor: Enhancing methodological rigor in the evaluation of microvascular flow imaging for recurrent thyroid cancer.Eur Radiol. 2024 Oct 28. doi: 10.1007/s00330-024-11113-8. Online ahead of print. Eur Radiol. 2024. PMID: 39466395 No abstract available.
Publication types
MeSH terms
LinkOut - more resources
Other Literature Sources