Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2014 Jul;67(7):821-9.
doi: 10.1016/j.jclinepi.2014.02.008. Epub 2014 Apr 24.

Exploring interaction effects in small samples increases rates of false-positive and false-negative findings: results from a systematic review and simulation study

Amand F Schmidt  1 , Rolf H H Groenwold  2 , Mirjam J Knol  3 , Arno W Hoes  4 , Mirjam Nielen  5 , Kit C B Roes  4 , Anthonius de Boer  6 , Olaf H Klungel  2
Affiliations

Exploring interaction effects in small samples increases rates of false-positive and false-negative findings: results from a systematic review and simulation study

Amand F Schmidt et al. J Clin Epidemiol. 2014 Jul.

Abstract

Objective: To give a comprehensive comparison of the performance of commonly applied interaction tests.

Methods: A literature review and simulation study was performed evaluating interaction tests on the odds ratio (OR) or the risk difference (RD) scales: Cochran Q (Q), Breslow-Day (BD), Tarone, unconditional score, likelihood ratio (LR), Wald, and relative excess risk due to interaction (RERI)-based tests.

Results: Review results agreed with results from our simulation study, which showed that on the OR scale, in small sample sizes (eg, number of subjects ≤ 250) the type 1 error rates of the LR test was 0.10; the BD and Tarone tests showed results around 0.05. On the RD scale, the LR and RERI tests had error rates around 0.05. On both scales, tests did not differ regarding power. When exposure prevented the outcome RERI-based tests were relatively underpowered (eg, N = 100; RERI power = 5% vs. Wald power = 18%). With increasing sample size, difference decreased.

Conclusion: In small samples, interaction tests differed. On the OR scale, the Tarone and BD tests are recommended. On the RD scale, the LR and RERI-based tests performed best. However, RERI-based tests are underpowered compared with other tests, when exposure prevents the outcome, and sample size is limited.

Keywords: Effect modification; Epidemiologic methods; Interaction; Odds ratio; Relative excess risk due to interaction; Review; Risk ratio; Simulation; Statistics; Subgroups.

PubMed Disclaimer

Similar articles

See all similar articles

Cited by

See all "Cited by" articles

Publication types

LinkOut - more resources