Power failure: why small sample size undermines the reliability of neuroscience
- PMID: 23571845
- DOI: 10.1038/nrn3475
Power failure: why small sample size undermines the reliability of neuroscience
Erratum in
- Nat Rev Neurosci. 2013 Jun;14(6):451
Abstract
A study with low statistical power has a reduced chance of detecting a true effect, but it is less well appreciated that low power also reduces the likelihood that a statistically significant result reflects a true effect. Here, we show that the average statistical power of studies in the neurosciences is very low. The consequences of this include overestimates of effect size and low reproducibility of results. There are also ethical dimensions to this problem, as unreliable research is inefficient and wasteful. Improving reproducibility in neuroscience is a key priority and requires attention to well-established but often ignored methodological principles.
Comment in
-
Misuse of power: in defence of small-scale science.Nat Rev Neurosci. 2013 Aug;14(8):585. doi: 10.1038/nrn3475-c1. Epub 2013 Jul 3. Nat Rev Neurosci. 2013. PMID: 23820772 No abstract available.
-
Small sample size is not the real problem.Nat Rev Neurosci. 2013 Aug;14(8):585. doi: 10.1038/nrn3475-c3. Epub 2013 Jul 3. Nat Rev Neurosci. 2013. PMID: 23820775 No abstract available.
-
Experimental power comes from powerful theories - the real problem in null hypothesis testing.Nat Rev Neurosci. 2013 Aug;14(8):585. doi: 10.1038/nrn3475-c2. Epub 2013 Jul 3. Nat Rev Neurosci. 2013. PMID: 23820777 No abstract available.
-
Confidence and precision increase with high statistical power.Nat Rev Neurosci. 2013 Aug;14(8):585-6. doi: 10.1038/nrn3475-c4. Epub 2013 Jul 3. Nat Rev Neurosci. 2013. PMID: 23820778 No abstract available.
-
Empirical evidence for low reproducibility indicates low pre-study odds.Nat Rev Neurosci. 2013 Dec;14(12):877. doi: 10.1038/nrn3475-c6. Epub 2013 Oct 23. Nat Rev Neurosci. 2013. PMID: 24149186 No abstract available.
-
A test is not a test.Nat Rev Neurosci. 2013 Dec;14(12):877. doi: 10.1038/nrn3475-c5. Epub 2013 Oct 23. Nat Rev Neurosci. 2013. PMID: 24149189 No abstract available.
Similar articles
-
Power-up: A Reanalysis of 'Power Failure' in Neuroscience Using Mixture Modeling.J Neurosci. 2017 Aug 23;37(34):8051-8061. doi: 10.1523/JNEUROSCI.3592-16.2017. Epub 2017 Jul 13. J Neurosci. 2017. PMID: 28706080 Free PMC article.
-
Enhancing precision in human neuroscience.Elife. 2023 Aug 9;12:e85980. doi: 10.7554/eLife.85980. Elife. 2023. PMID: 37555830 Free PMC article. Review.
-
Brain-behavior correlations: Two paths toward reliability.Neuron. 2022 May 4;110(9):1446-1449. doi: 10.1016/j.neuron.2022.04.018. Neuron. 2022. PMID: 35512638
-
Consideration of Sample Size in Neuroscience Studies.J Neurosci. 2020 May 20;40(21):4076-4077. doi: 10.1523/JNEUROSCI.0866-20.2020. J Neurosci. 2020. PMID: 32434857 Free PMC article. No abstract available.
-
Effect size: utility and application in neuroscience nursing.J Neurosci Nurs. 2001 Aug;33(4):216-8. doi: 10.1097/01376517-200108000-00008. J Neurosci Nurs. 2001. PMID: 11497075 Review.
Cited by
-
PanicRoom: a virtual reality-based Pavlovian fear conditioning paradigm.Front Psychol. 2024 Oct 4;15:1432141. doi: 10.3389/fpsyg.2024.1432141. eCollection 2024. Front Psychol. 2024. PMID: 39430907 Free PMC article.
-
Why experimental variation in neuroimaging should be embraced.Nat Commun. 2024 Oct 31;15(1):9411. doi: 10.1038/s41467-024-53743-y. Nat Commun. 2024. PMID: 39482294 Free PMC article. Review.
-
Thinking About Data, Research Methods, and Statistical Analyses: Commentary on Sijtsma's (2014) "Playing with Data".Psychometrika. 2016 Mar;81(1):16-26. doi: 10.1007/s11336-015-9447-z. Psychometrika. 2016. PMID: 25820981
-
Sex-related differences in the efficacy of immune checkpoint inhibitors in malignancy: a systematic review and meta-analysis.Aging (Albany NY). 2021 Jun 4;13(11):15413-15432. doi: 10.18632/aging.203100. Epub 2021 Jun 4. Aging (Albany NY). 2021. PMID: 34086601 Free PMC article.
-
The Power of Theory, Research Design, and Transdisciplinary Integration in Moving Psychopathology Forward.Psychol Inq. 2015;26(3):209-230. doi: 10.1080/1047840X.2015.1015367. Epub 2015 Aug 28. Psychol Inq. 2015. PMID: 27030789 Free PMC article.
References
Publication types
MeSH terms
Grants and funding
LinkOut - more resources
Full Text Sources
Other Literature Sources