Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2023 Jan 27:56:e12475.
doi: 10.1590/1414-431X2023e12475. eCollection 2023.

Data-driven decision making for the screening of cognitive impairment in primary care: a machine learning approach using data from the ELSA-Brasil study

Affiliations

Data-driven decision making for the screening of cognitive impairment in primary care: a machine learning approach using data from the ELSA-Brasil study

C Szlejf et al. Braz J Med Biol Res. .

Abstract

The systematic assessment of cognitive performance of older people without cognitive complaints is controversial and unfeasible. Identifying individuals at higher risk of cognitive impairment could optimize resource allocation. We aimed to develop and test machine learning models to predict cognitive impairment using variables obtainable in primary care settings. In this cross-sectional study, we included 8,291 participants of the baseline assessment of the ELSA-Brasil study, who were aged between 50 and 74 years and were free of dementia. Cognitive performance was assessed with a neuropsychological battery and cognitive impairment was defined as global cognitive z-score below 2 standard deviations. Variables used as input to the prediction models included demographics, social determinants, clinical conditions, family history, lifestyle, and laboratory tests. We developed machine learning models using logistic regression, neural networks, and gradient boosted trees. Participants' mean age was 58.3±6.2 years, 55% were female. Cognitive impairment was present in 328 individuals (4%). Machine learning algorithms presented fair to good discrimination (areas under the ROC curve between 0.801 and 0.873). Extreme Gradient Boosting presented the highest discrimination, high specificity (97%), and negative predictive value (97%). Seventy-six percent of the individuals with cognitive impairment were included among the highest ranked individuals by this algorithm. In conclusion, we developed and tested a machine learning model to predict cognitive impairment based on primary care data that presented good discrimination and high specificity. These characteristics could support the detection of patients who would not benefit from cognitive assessment, facilitating the allocation of human and economic resources.

PubMed Disclaimer

Figures

Figure 1
Figure 1. Distribution of the receiver operating characteristic curves of the different machine learning algorithms on the test set. ANN: Artificial Neural Network; AUC: area under the receiver operating characteristic curve; LightGBM: Light Gradient Boosting Machine; LR: Logistic Regression; XGBOOST: Extreme Gradient Boosting Machine.
Figure 2
Figure 2. Importance of variables according to the Shapley values for the Extreme Gradient Boosting algorithm on the test set. The vertical axis lists the input variables and the horizontal axis measures their contribution in classifying cognitive deficit. The color red represents higher values and blue lower values. SHAP: Shapley Additive exPlanations.

Similar articles

Cited by

References

    1. Institute for Health Metrics and Evaluation GBD Compare. [Accessed August 31, 2021]. https://vizhub.healthdata.org/gbd-compare/
    1. Livingston G, Huntley J, Sommerlad A, Ames D, Ballard C, Banerjee S, et al. Dementia prevention, intervention, and care: 2020 report of the Lancet Commission. Lancet. 2020;396:413–446. doi: 10.1016/S0140-6736(20)30367-6. - DOI - PMC - PubMed
    1. The Gerontological Society of America The Gerontological Society of America Workgroup on Cognitive Impairment Detection and Earlier Diagnosis: Report and Recommendations. [Accessed August 31, 2021]. https://www.geron.org/images/gsa/documents/gsaciworkgroup2015report.pdf
    1. Alzheimer's Association Policy Brief: early detection and diagnosis of Alzheimer's dementia. [Accessed August 31, 2021]. https://www.alz.org/media/documents/policy-brief-early-detection-diagnos...
    1. US Preventive Services Task Force. Owens DK, Davidson KW, Krist AH, Barry MJ, Cabana M, et al. Screening for Cognitive impairment in older adults: US Preventive services task force recommendation statement. JAMA. 2020;323:757–763. doi: 10.1001/jama.2020.0435. - DOI - PubMed