Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2023 Mar 9:11:1143019.
doi: 10.3389/fpubh.2023.1143019. eCollection 2023.

A risk prediction model based on machine learning for early cognitive impairment in hypertension: Development and validation study

Affiliations

A risk prediction model based on machine learning for early cognitive impairment in hypertension: Development and validation study

Xia Zhong et al. Front Public Health. .

Abstract

Background: Clinical practice guidelines recommend early identification of cognitive impairment in individuals with hypertension with the help of risk prediction tools based on risk factors.

Objective: The aim of this study was to develop a superior machine learning model based on easily collected variables to predict the risk of early cognitive impairment in hypertensive individuals, which could be used to optimize early cognitive impairment risk assessment strategies.

Methods: For this cross-sectional study, 733 patients with hypertension (aged 30-85, 48.98% male) enrolled in multi-center hospitals in China were divided into a training group (70%) and a validation group (30%). After least absolute shrinkage and selection operator (LASSO) regression analysis with 5-fold cross-validation determined the modeling variables, three machine learning classifiers, logistic regression (LR), XGBoost (XGB), and gaussian naive bayes (GNB), were developed. The area under the ROC curve (AUC), accuracy, sensitivity, specificity, and F1 score were used to evaluate the model performance. Shape Additive explanation (SHAP) analysis was performed to rank feature importance. Further decision curve analysis (DCA) assessed the clinical performance of the established model and visualized it by nomogram.

Results: Hip circumference, age, education levels, and physical activity were considered significant predictors of early cognitive impairment in hypertension. The AUC (0.88), F1 score (0.59), accuracy (0.81), sensitivity (0.84), and specificity (0.80) of the XGB model were superior to LR and GNB classifiers.

Conclusion: The XGB model based on hip circumference, age, educational level, and physical activity has superior predictive performance and it shows promise in predicting the risk of cognitive impairment in hypertensive clinical settings.

Keywords: cognitive impairment; hypertension; machine learning; prediction model; risk factors.

PubMed Disclaimer

Conflict of interest statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Figures

Figure 1
Figure 1
Study flow diagram. Flowchart illustrating patient selection and machine learning model development pipeline. Following standard inclusion and exclusion procedures, a total of 733 individuals were selected, including 122 patients with cognitive impairment and 611 NCI. We developed machine learning models using three classifiers, LR, XGB, and GNB, and synthesized them into an integrated model. All individuals were randomly assigned to one of two groups: 70% training and 30% verification. Five-fold cross-validation (CV) was used to train and verify the model for 10 repetitions. MMSE, mini-mental state examination; NCI, no cognitive impairment; LR, logistic regression; XGB, XGBoost; GNB, gaussian naive bayes; ROC, receiver operating characteristic; SHAP, shape additive explanation.
Figure 2
Figure 2
ROC curve for the XGB model. (A) ROC analysis results of the XGB model based on training set data by 5-fold cross-validation. (B) ROC analysis results of the XGB model based on 5-fold cross-validation of verification set data. ROC curve, receiver operating characteristic curve; AUC, area under curve; XGB, XGBoost.
Figure 3
Figure 3
Feature importance based on SHAP results. The vertical axis shows the features, the horizontal axis represents SHAP observations. Points were colored differently with reference to their eigenvalues, pink indicating a positive correlation with early cognitive decline, and blue indicating a negative correlation with early cognitive decline.
Figure 4
Figure 4
SHAP force plot for predicting early cognitive decline. (A) SHAP forces plot to correctly predict early cognitive decline. (B) SHAP forces plot to correctly predict NCI. (C) SHAP force plot of mispredicted early cognitive decline. (D) SHAP force plot of mispredicted NCI. Pink represents predictors of early cognitive decline, while blue represents predictors of NCI. Bold values show the likelihood of early cognitive decline in the ensemble model.
Figure 5
Figure 5
DCA analysis was performed to evaluate the clinical usefulness of the XGB model. The y-axis indicated the net benefit; the x-axis indicated the threshold probability. The solid red line shows the net benefit rate of the XGB forecast model. Within a certain threshold range, the XGB model has a higher net benefit. DCA, Decision curve analysis.
Figure 6
Figure 6
Nomogram construction for early cognitive impairment in hypertension. We established a nomogram based on the four high-risk predictors for early cognitive impairment in hypertension. In this plot, to use the nomogram model, a single node value is loaded on each variable axis and the line is drawn upwards to determine the number of points. Then, the sum of these numbers is located on the total point axis, and the line is drawn downwards to the risk of early diagnosis of cognitive impairment.

Similar articles

Cited by

References

    1. Ungvari Z, Toth P, Tarantini S, Prodan CI, Sorond F, Merkely B, et al. . Hypertension-induced cognitive impairment: from pathophysiology to public health. Nat Rev Nephrol. (2021) 17:639–54. 10.1038/s41581-021-00430-6 - DOI - PMC - PubMed
    1. Jia L, Du Y, Chu L, Zhang Z, Li F, Lyu D, et al. . Prevalence, risk factors, and management of dementia and mild cognitive impairment in adults aged 60 years or older in China: a cross-sectional study. Lancet Public Health. (2020) 5:e661–71; 30185–7 10.1016/S2468-2667(20)30185-7 - DOI - PubMed
    1. Santisteban MM, Iadecola C, Carnevale D. Hypertension, neurovascular dysfunction, and cognitive impairment. Hypertension. (2023) 80:22–34. 10.1161/HYPERTENSIONAHA.122.18085 - DOI - PMC - PubMed
    1. Baker AB, Resch JA, Loewenson RB. Hypertension and cerebral atherosclerosis. Circulation. (1969) 39:701–10. 10.1161/01.CIR.39.5.701 - DOI - PubMed
    1. Iadecola C, Yaffe K, Biller J, Bratzke LC, Faraci FM, Gorelick PB, et al. . Impact of hypertension on cognitive function: a scientific statement from the American heart association. Hypertension. (2016) 68:e67–94. 10.1161/HYP.0000000000000053 - DOI - PMC - PubMed

Publication types

Grants and funding

This study was supported by the Young Qihuang Scholars of the National Administration of Traditional Chinese Medicine (No. 2022-256).