A solution to the problem of separation in logistic regression
- PMID: 12210625
- DOI: 10.1002/sim.1047
A solution to the problem of separation in logistic regression
Abstract
The phenomenon of separation or monotone likelihood is observed in the fitting process of a logistic model if the likelihood converges while at least one parameter estimate diverges to +/- infinity. Separation primarily occurs in small samples with several unbalanced and highly predictive risk factors. A procedure by Firth originally developed to reduce the bias of maximum likelihood estimates is shown to provide an ideal solution to separation. It produces finite parameter estimates by means of penalized maximum likelihood estimation. Corresponding Wald tests and confidence intervals are available but it is shown that penalized likelihood ratio tests and profile penalized likelihood confidence intervals are often preferable. The clear advantage of the procedure over previous options of analysis is impressively demonstrated by the statistical analysis of two cancer studies.
Copyright 2002 John Wiley & Sons, Ltd.
Similar articles
-
A solution to the problem of monotone likelihood in Cox regression.Biometrics. 2001 Mar;57(1):114-9. doi: 10.1111/j.0006-341x.2001.00114.x. Biometrics. 2001. PMID: 11252585
-
Avoiding infinite estimates of time-dependent effects in small-sample survival studies.Stat Med. 2008 Dec 30;27(30):6455-69. doi: 10.1002/sim.3418. Stat Med. 2008. PMID: 18816502
-
Bias-reduced and separation-proof conditional logistic regression with small or sparse data sets.Stat Med. 2010 Mar 30;29(7-8):770-7. doi: 10.1002/sim.3794. Stat Med. 2010. PMID: 20213709
-
On estimation for accelerated failure time models with small or rare event survival data.BMC Med Res Methodol. 2022 Jun 11;22(1):169. doi: 10.1186/s12874-022-01638-1. BMC Med Res Methodol. 2022. PMID: 35689190 Free PMC article.
-
Applications of Monte Carlo Simulation in Modelling of Biochemical Processes.In: Mode CJ, editor. Applications of Monte Carlo Methods in Biology, Medicine and Other Fields of Science [Internet]. Rijeka (HR): InTech; 2011 Feb 28. Chapter 4. In: Mode CJ, editor. Applications of Monte Carlo Methods in Biology, Medicine and Other Fields of Science [Internet]. Rijeka (HR): InTech; 2011 Feb 28. Chapter 4. PMID: 28045483 Free Books & Documents. Review.
Cited by
-
Cryptic extended brood care in the facultatively eusocial sweat bee Megalopta genalis.Insectes Soc. 2015;62(3):307-313. doi: 10.1007/s00040-015-0409-3. Epub 2015 Apr 26. Insectes Soc. 2015. PMID: 26097252 Free PMC article.
-
Will My Tibial Fracture Heal? Predicting Nonunion at the Time of Definitive Fixation Based on Commonly Available Variables.Clin Orthop Relat Res. 2016 Jun;474(6):1385-95. doi: 10.1007/s11999-016-4821-4. Clin Orthop Relat Res. 2016. PMID: 27125823 Free PMC article.
-
Association of Sleepwalking and REM Sleep Behavior Disorder With Parkinson Disease in Men.JAMA Netw Open. 2021 Apr 1;4(4):e215713. doi: 10.1001/jamanetworkopen.2021.5713. JAMA Netw Open. 2021. PMID: 33847749 Free PMC article.
-
Clinical presentations, diagnosis, mortality and prognostic markers of tuberculous meningitis in Vietnamese children: a prospective descriptive study.BMC Infect Dis. 2016 Oct 18;16(1):573. doi: 10.1186/s12879-016-1923-2. BMC Infect Dis. 2016. PMID: 27756256 Free PMC article.
-
A statistical method for studying correlated rare events and their risk factors.Stat Methods Med Res. 2017 Jun;26(3):1416-1428. doi: 10.1177/0962280215581112. Epub 2015 Apr 8. Stat Methods Med Res. 2017. PMID: 25854937 Free PMC article.
Publication types
MeSH terms
LinkOut - more resources
Other Literature Sources