Chi 2 tests: how useful are they in the analysis of medical research data?
- PMID: 2483622
Chi 2 tests: how useful are they in the analysis of medical research data?
Abstract
This paper has outlined analyses of data for which the chi 2 test is commonly applied and has shown that on its own, a chi 2 test provides very little information about the interpretation of the data. In goodness to fit tests, at best, the chi 2 test is a mere first step in the interpretation of the data and much more information can be gleaned from the deviations between the observed and theoretical distributions, and graphical methods are more sensitive for assessing Normality. Similarly, the chi 2 test as the analysis of a 2 x 2 contingency table misses the most important features of the data. A chi 2 value and associated p value should not be presented without an estimation of the effect and its confidence interval. The use of NS, (not significant), after a chi 2 value (or any other test statistic) is particularly meaningless as it does not even specify a level of significance. The analysis of 2 x 2 contingency tables should specify a measure of the effect such as the difference between two proportions, their ratio or the odds ratio. Confidence intervals should be calculated and least importantly, statistical significance assessed by the Standard Normal Deviate. Chi 2 has no useful role to play in the analysis of 2 x 2 contingency tables. In fact, even with larger two dimensional tables, although chi 2 can be used to test the significance of associations between the rows and columns, such results are seldom of much interest as they give no indication of where in the table associations may exist. They are insensitive particularly if the categories of the row or column variables are quantitative since chi 2 takes no account of the ordering of the rows and columns. Although simple analyses of such tables are inefficient the advent of desk-top computers means that more sophisticated techniques such as logistic regression for proportions and Poisson regression for larger or multidimensional contingency tables can be applied. Although these methods may involve chi 2 tests for testing the significance of including or excluding variables, they are always associated with estimates of effects as measured by regression coefficients. The use of chi 2 for the simple analysis of contingency tables has no place in the interpretation of medical research data.
Similar articles
-
[Meta-analysis of the Italian studies on short-term effects of air pollution].Epidemiol Prev. 2001 Mar-Apr;25(2 Suppl):1-71. Epidemiol Prev. 2001. PMID: 11515188 Italian.
-
Power comparison of two-sided exact tests for association in 2 x 2 contingency tables using standard, mid p and randomized test versions.Stat Med. 2003 Dec 30;22(24):3859-71. doi: 10.1002/sim.1671. Stat Med. 2003. PMID: 14673943
-
The score test for independence in R x C contingency tables with missing data.Biometrics. 1996 Jun;52(2):751-62. Biometrics. 1996. PMID: 8672711
-
Formulae and tables for the determination of sample sizes and power in clinical trials for testing differences in proportions for the two-sample design: a review.Stat Med. 1996 Jan 15;15(1):1-21. doi: 10.1002/(SICI)1097-0258(19960115)15:1<1::AID-SIM134>3.0.CO;2-E. Stat Med. 1996. PMID: 8614740 Review.
-
Safety and nutritional assessment of GM plants and derived food and feed: the role of animal feeding trials.Food Chem Toxicol. 2008 Mar;46 Suppl 1:S2-70. doi: 10.1016/j.fct.2008.02.008. Epub 2008 Feb 13. Food Chem Toxicol. 2008. PMID: 18328408 Review.
Cited by
-
Neonatal care during the COVID-19 pandemic - a global survey of parents' experiences regarding infant and family-centred developmental care.EClinicalMedicine. 2021 Aug 6;39:101056. doi: 10.1016/j.eclinm.2021.101056. eCollection 2021 Sep. EClinicalMedicine. 2021. PMID: 34401688 Free PMC article.
MeSH terms
LinkOut - more resources
Miscellaneous