Skip to main content
Journal of Korean Medical Science logoLink to Journal of Korean Medical Science
. 2023 Apr 25;38(21):e162. doi: 10.3346/jkms.2023.38.e162

A Prediction Model for Osteoporosis Risk Using a Machine-Learning Approach and Its Validation in a Large Cohort

Xuangao Wu 1, Sunmin Park 1,2,
PMCID: PMC10226854  PMID: 37270917

Abstract

Background

Osteoporosis develops in the elderly due to decreased bone mineral density (BMD), potentially increasing bone fracture risk. However, the BMD is not regularly measured in a clinical setting. This study aimed to develop a good prediction model for the osteoporosis risk using a machine learning (ML) approach in adults over 40 years in the Ansan/Anseong cohort and the association of predicted osteoporosis risk with a fracture in the Health Examinees (HEXA) cohort.

Methods

The 109 demographic, anthropometric, biochemical, genetic, nutrient, and lifestyle variables of 8,842 participants were manually selected in an Ansan/Anseong cohort and included in the ML algorithm. The polygenic risk score (PRS) of osteoporosis was generated with a genome-wide association study and added for the genetic impact of osteoporosis. Osteoporosis was defined with < −2.5 T scores of the tibia or radius compared to people in their 20s–30s. They were divided randomly into the training (n = 7,074) and test (n = 1,768) sets—Pearson’s correlation between the predicted osteoporosis risk and fracture in the HEXA cohort.

Results

XGBoost, deep neural network, and random forest generated the prediction model with a high area under the curve (AUC, 0.86) of the receiver operating characteristic (ROC) with 10, 15, and 20 features; the prediction model by XGBoost had the highest AUC of ROC, high accuracy and k-fold values (> 0.85) in 15 features among seven ML approaches. The model included the genetic factor, genders, number of children and breastfed children, age, residence area, education, seasons to measure, height, smoking status, hormone replacement therapy, serum albumin, hip circumferences, vitamin B6 intake, and body weight. The prediction models for women alone were similar to those for both genders, with lower accuracy. When the prediction model was applied to the HEXA study, the correlation between the fracture incidence and predicted osteoporosis risk was significant but weak (r = 0.173, P < 0.001).

Conclusion

The prediction model for osteoporosis risk generated by XGBoost can be applied to estimate osteoporosis risk. The biomarkers can be considered for enhancing the prevention, detection, and early therapy of osteoporosis risk in Asians.

Keywords: Osteoporosis, Genetic Risk Scores, Machine Learning, XGboost, Deep Neural Network, Nutrient Intake, Hormone Replacement Therapy

Graphical Abstract

graphic file with name jkms-38-e162-abf001.jpg

INTRODUCTION

Osteoporosis is a disease involving weakened bones caused by loss of bone mineral density (BMD) that increases the risk of bone fracture and shortens height, resulting in decreased quality of life.1 Osteoporosis prevalence is increasing, with age reaching 19.6% and 4.4% in women and men aged over 50, according to the National Health and Nutrition Examination Survey 2017 to 2018 in the USA.2 The osteoporosis prevalence in Asia is similar to or higher than in the USA. Furthermore, it has increased from 2007–2008 to 2017–2018 only in women.3,4 In parallel with osteoporosis, fracture incidence has increased until 2013 and is 2.5% in Korea.4

BMD depends on bone formation and resorption balance and is modified by genetic and environmental factors that interact to modulate the prevalence of osteoporosis.1 Osteoporosis can be prevented by altering the modifiable risk factors, including dietary factors, lifestyles, disease status, and medication.5,6 Furthermore, unmodifiable osteoporosis risk factors, such as age, gender, body frame size, and genetic factor, interact with modifiable ones. They also need to be considered to explore preventable measures for osteoporosis.6 Osteoporosis is positively associated with age, women, low body weight, low physical activity, poor nutritional status, some medications, including cortisol, and endocrine-related diseases, including type 1 diabetes and menopause.7 Women are much more susceptible to osteoporosis than men due to lower peak bone mass in young adults, and BMD loss markedly increases due to estrogen deficiency in menopausal women.8 Moreover, hand grip strength is positively associated with BMD and inversely related to fracture in postmenopausal Korean women.9 The association between obesity and osteoporosis remains controversial.10 Although Asians have a lower calcium intake and lower body mass index (BMI), their fractures are not higher than Caucasians in men and women.11 Therefore, the prediction model for osteoporosis risk has practical significance for people who do not regularly measure BMD. The classification model of osteoporosis can be applied to the general population to predict the osteoporosis risk and to carry out early prevention according to the risk factors of the model.

Multi-omics analysis of diseases has become a recent research hotspot. In recent studies, osteoporosis is not only related to metabolomics but also to gut microbes and genes.12 Machine learning (ML) approaches can integrate different variables in the multi-omics analysis, perform accurate classification and regression, and evaluate the importance of variables as risk factors for the disease.13 ML has been used in multiple disease predictions, including health-related quality of life and chronic diseases, using various experimental types such as cross-sectional, case-control, and prospective cohorts.14,15 The ML algorithm enables us to make data-driven predictions or decisions to predict the early detection of chronic diseases, including osteoporosis risk.15,16 The biomarkers in the prediction model can be studied for preventing and therapeutic agents.

Previous studies have reported that osteoporosis is associated with genetics, which interacts with lifestyles to modulate its development and progression.16,17 However, more studies are needed in different ethnicities since it has been studied primarily in European descent. Furthermore, a few studies have shown that the prediction model includes genetic factors such as polygenic risk scores (PRS).17 The genetic impact can be represented with PRS generated from the selected genetic variants for osteoporosis risk using genome-wide association study (GWAS) analysis. The present study aimed to generate the prediction model for osteoporosis risk using several machine-learning algorithms in an Ansan/Anseong cohort, of which the BMD was measured using quantitative ultrasound and densitometric peripheral bone densitometry. The generated prediction model was applied to predict the osteoporosis risk of the participants in the Health Examinees in multi-center hospitals (HEXA) cohort, which did not measure BMD. The association of the predicted osteoporosis risk with a fracture experience was determined in the HEXA.

METHODS

General characteristics of participants in the Ansan/Anseong cohort

Korean Genome and Epidemiology Study (KoGES) consisted of three cohorts in population-based studies, including Ansan/Anseong from 2001 to 2002 and HEXA, to study genetic and lifestyle factors in Korea.18 Ansan/Anseong cohort represented the residence area of the 8,842 participants in urban (Ansan) and rural (Anseong) areas. The participants were recruited from those who lived in the areas for at least 6 months before participating in the Ansan/Anseong cohort study. The participants volunteered for the HEXA cohort when visiting the assigned hospitals.

Most parameters were determined in both Ansan/Anseong and HEXA cohorts, but a few parameters, including BMD and fracture experience, were measured in one of them. BMD was measured at the lower limb (the tibia) and lower arm (the radius) by a PIXI (GE, Boston, MA, USA), a quantitative ultrasound, and densitometric peripheral bone densitometry. However, no fracture experience was reported in the participants of the Ansan/Anseong cohort (n = 8,842). However, BMD was not measured in the HEXA cohort, the large cohort (n = 58,701), where the answer of the osteoporosis diagnosed by a physician previously was included. However, the previous diagnosis of osteoporosis might not reflect BMD during the survey period; osteoporosis incidence was underestimated or overestimated since the persons did not measure BMD often as a regular checkup in Korea, and the BMD diagnosis was dependent on the person's memory. Therefore, the model for osteoporosis risk determined with BMD was generated with a ML approach from Ansan/Anseong cohorts. The osteoporosis risk of the participants in the HEXA cohort was predicted using the predicting model generated from Ansan/Anseong cohort.

The participants in this cohort resided in Ansan, a city area (n = 4,205), or Anseong, a rural area (n = 4,637) from 2001 to 2002, for a least six months before voluntarily participating in the study. The demographic and dietary information was provided by a health interview and had anthropometric and biochemical measurements. The anthropometric measurements, including height, weight, waist, and hip circumference, were conducted by a skilled technician, with the participants wearing a light gown as described previously. The lean body mass and fat mass were assessed by bioelectrical impedance analysis (Inbody 3.0, Biospace, Seoul, Korea). The pulse was counted for 1 min, and the blood pressure was then calculated with an average of three measurements conducted on the right arm at the same height as the heart in the sitting positions.

The participants also answered a question about taking medication for various diseases as none, past and current medication, including hormone replacement therapy. The smoking status was defined as follows: smoking more than 100 cigarettes throughout their lifetime was considered a current smoker, and smokers who had not been smoking for the last six months were considered former smokers.19 The daily alcohol intake was calculated with the alcohol amount in each drinking event and the drinking frequencies during the last six months before the interview. Regular exercise was defined as moderate exercise (brisk walking, mowing, badminton, swimming, tennis, and others) for > 30 minutes or vigorous exercise (climbing, running, football, basketball, volleyball, and others) for > 20 minutes at least five times per week.

Overnight fasting blood samples were collected from each participant, and the serum and plasma were separated. The biochemical variables were measured. Glucose, total cholesterol, high-density lipoprotein (HDL)-cholesterol, triglycerides, platelet, alanine aminotransferase (ALT), aspartate aminotransferase (AST), γ-glutamyl transpeptidase, creatinine, and total bilirubin in serum were assessed using an automatic analyzer (ZEUS 9.9; Takeda, Tokyo, Japan). The fasting serum insulin and high-sensitive C-reactive protein (CRP) concentrations were analyzed using ELISA kits (DiaSorin, Stillwater, MN, USA). The HOMA-IR was calculated using the equation of the serum glucose concentration (mM) × serum insulin concentration (µU/mL)/22.5.

Osteoporosis definition

BMD was measured 1) at the middle of the wrist and the elbow in the lower arm (the distal radius) and 2) at the middle of the knee and the astragalus in the leg (midshaft tibia) by the PIXI (GE, USA), quantitative ultrasound and densitometric peripheral bone densitometry in the Asan/Anseong cohort. Although dual-energy X-ray absorptiometry (DEXA) is a primary tool for estimating BMD, it cannot be applied in a clinical setting. Multisite BMD by quantitative ultrasound densitometry exhibits a positive correlation with that by DEXA in the Canadian Multicentre Osteoporosis Study.20 BMD measurement by ultrasound densitometry is a valuable tool for assessing osteoporosis risk in a clinical setting. In Koreans, quantitative ultrasonographic measurements are used for defining osteoporosis risk.21 Therefore, osteoporosis was defined as a radius or tibia BMD T score of -2.5 standard deviations below that of a healthy 20–39-year-old adult of the same gender as the subject. The participants with and without osteoporosis were called the osteoporosis and control groups, respectively. Four hundred and twelve people (4.66%) had missing values for the BMD, and they were excluded from the prediction of osteoporosis.

In a HEXA cohort, the BMD was not measured, but the osteoporosis diagnosis by a physician was questioned. A diagnosis of osteoporosis was used for further analysis. Unlike the Ansan/Anseong cohort, fracture experience was reported in the HEXA cohort.

Genetic variants for osteoporosis risk

The genomic DNA was extracted from the blood, and its genotypes were determined using an Affymetrix Genome-Wide Human SNP Array 5.0 (Affymetrix, Santa Clara, CA, USA). The genotype accuracy and quality were controlled with Bayesian Robust Linear Modeling using the Mahalanobis Distance Genotyping Algorithm.16 In a previous study,1 the genetic variants to interact with each other were selected to assess the osteoporosis risk in the Ansan/Anseong cohort using a GWAS and generalized multifactor dimensionality reduction procedures. The genetic model with selected genetic variants included AKAP11_rs238340, KCNMA1_rs628948, PUM1_rs7529390, SPTBN1_rs6752877, and EPDR1_rs2722298. The PRS of the 5 SNPs was calculated by summing the number of the given allele from each SNP selected in the five SNPs of the genetic model. The PRS was used as the genetic factor.

Assessment of the food and nutrient intake using semi-quantitative food frequency questionnaires (SQFFQ)

During the last six months, the usual food intake was assessed with the eating frequencies and portion size using SQFFQ for Korean diets.22 The SQFFQ included 103 common Korean foods, and their eating frequencies were divided into the following: never or seldom, once a month, two to three times a month, one to two times a week, three to four times a week, five to six times a week, once a day, twice a day, and three times or more per day. The amount of food at each eating event was answered as more, equal, or less based on the portion size shown by the food photographs in each food. Each participant's food intake was determined by multiplying the midpoint of the frequencies by the portion size of each food. The intake of energy and nutrients was calculated from the food intake assessed by the SQFFQ, using the Can-Pro 2.0 nutrient assessment software designed by the Korean Nutrition Society.23

Experimental design for ML for predicting osteoporosis

One hundred and nine variables potentially related to osteoporosis risk were selected from 1,411 variables in the Ansan/Anseong. Among 119 variables, the correlated variables were excluded (Fig. 1). However, body weight, waist and hip circumferences, body fat, and lean body mass were included to find a better predictor for the osteoporosis risk. BMI was omitted since body weight and height were included.

Fig. 1. Processing scheme for generating a prediction model of osteoporosis risk in the Ansan/Anseong cohort. The 8,421 adults measured with bone mineral density participated, and 109 variables were selected manually from 1,411 in the Ansan/Anseong cohort to predict the osteoporosis risk using the seven ML approach. Osteoporosis was defined as < −2.5 T scores of BMD in the tibia and wrist compared to the '20s–'30s. Missing data were filled with the mean and mode values for continuous and categorical variables, respectively. Data were normalized using the z-score. The prediction models for osteoporosis risk were generated using seven ML algorithms. The Ansan/Anseong cohort participants were divided randomly into a training set of 80% and a test set of 20% participants. The optimal model was selected with a random grid search after 1,000 repetitions in seven different ML algorithms, such as linear regression, support vector machines, XGBoost, decision tree, random forest, K-nearest neighbor, and DNN. The optimal prediction model was selected using the AUC of the ROC. The accuracy and k-fold cross-validation of the predicted models were assessed in the test set.

Fig. 1

BMD = bone mineral density, AUC = area under the curve, ROC = receiver operating characteristic, ML = machine learning, DNN = deep neural network.

The missing values (4.66%) are not allowed in the ML algorithms, and they were filled with the mode for the categorical variables and the mean for continuous variables. Each continuous variable was normalized to the z-score (Fig. 1). The data were divided randomly into 80% (n = 7,074) for the training set and 20% (n = 1,768) for the testing set. Standardized 109 variables were used to generate training and test sets using the randomized grid search method (Fig. 1). Appropriate models were selected to improve the area of receiver operating characteristic (ROC) curve, accuracy, and K-fold in the test data set. The algorithm models fitted for predicting the metabolic status were as follows: logistic regression, support vector machines (SMV), extreme gradient boosting (XGBoost), decision tree, random forest, K-nearest neighbor (KNN), and deep neural network (DNN).24 DNN was analyzed with 70 epochs, 0.2 validation split, and 100 layers.

Training for the variables for generating osteoporosis risk prediction model and testing the models for verifying the prediction model

After running the 109 variables, the relative importance of the random forest and XGBoost algorithm models was used to identify the genetic model in the training set. The best model with the highest area under the curve (AUC) of ROC, accuracy, and K-fold in the test data set was selected from the random forest and XGBoost algorithm models. However, the algorithm models did not indicate a positive or negative relationship. The SHapley Additive exPlanation (SHAP; https://shap.readthedocs.io/en/latest/index.html) was used to explain the models selected from the random forest and XGBoost.25

Predictions of the osteoporosis risk in the urban hospital-based cohort using the predictive algorithm models

Three prediction models generated by XGBoost, DNN, and random forest algorithms were selected to predict osteoporosis risk in the urban hospital-based cohort. Pearson’s correlation coefficients between osteoporosis and fracture experience were investigated.

Statistical analysis

Statistical analysis was conducted using SAS (Cary, NC, USA), Scikit-learn in Python 3.8.5 (https://www.python.org/downloads/windows/), and the TensorFlow platform. Six prediction models for osteoporosis risk were generated by logistic regression, XGBoost, random forest, KNN, SMV, and decision tree algorithms using Scikit-learn in Python 3.8.5. The DNN prediction model was made with the Tensor Flow platform.

The results are presented as the means ± standard deviations or number and percentage in the general characteristics of the variables. The significance of the differences between the variables was determined according to gender and the osteoporosis risk using the two-way ANOVA in the Ansan/Anseong cohort. P < 0.05 were considered significant.

Ethics statement

The Institutional Review Board of the Korean National Institute of Health approved the KoGES (KBP-2015-055) and Hoseo University approved the study (1041231-150811-HR-034-01). Written informed consent was obtained from all participants.

RESULTS

General characteristics and nutrient intake of the participants according to gender and BMD status

The participants in the osteoporosis group were older, less educated, and with lower income than those in the control group, and women had a much higher prevalence of low BMD than men (Table 1). The participants in the city area had lower BMD than those in rural areas. The participants with a high number of children and breastfed children were higher in osteoporosis than those with a low number (Table 1). A higher frequency of insomnia and sleep disorders elevated the osteoporosis incidence only in women. Menstrual and menopause age was not significantly different between the osteoporosis and control groups in women (Table 1).

Table 1. General characteristics and nutrient intake of the participants according to genders and osteoporosisa .

Variables Men (n = 4,037) Women (n = 4,385)
Control (n = 3,911) Osteoporosis (n = 126) Control (n = 3,488) Osteoporosis (n = 897)
Age 52.3 ± 0.16e 55.0 ± 0.50d 50.3 ± 0.16f 56.5 ± 0.26c***+++###
Gender (%) 52.8 18.9 47.2 81.1
Area (city) 2,186 (55.9) 188 (69.1)*** 1,752 (50.2) 512 (43.8)***
Education
< High school 1,635 (42.0) 121 (44.7)*** 2,242 (64.8) 907 (78.9)***
High school 1,417 (36.4) 101 (37.3) 986 (28.5) 204 (17.8)
> High school 839 (21.6) 49 (18.1) 234 (6.76) 38 (3.31)
Income
< $2,000/mon 1,645 (42.5) 120 (44.4) 1,808 (53.2) 818 (71.4)***
$2,000–4,000/mon 1,843 (47.6) 134 (49.6) 1,372 (40.4) 287 (25.1)
> $4,000/mon 384 (9.92) 16 (5.93) 219 (6.44) 40 (3.49)
Pregnancy (yes) 2,592 (74.2) 830 (70.9)*
Children ≥ 3 1,669 (64.4) 671 (80.9)***
Children who breastfed 1,737 (67.0) 666 (80.3)***
Pregnancy age, yr 23.8 ± 0.05 23.7 ± 0.09
Sleep hardness 123 (3.14) 7 (2.57) 229 (6.56) 108 (9.23)**
Insomnia 423 (10.97) 38 (14.2) 683 (19.84) 296 (25.6)***
Menstrual age, yr 16.0 ± 0.05 16.0 ± 0.09
Menopausal age, yr 47.8 ± 0.07 47.8 ± 0.13
Polygenic risk scoresb 6.35 ± 0.03d 6.68 ± 0.04c 6.31 ± 0.06d 6.65 ± 0.08c+++
Non-smokers (yes) 727 (18.7) 80 (29.6) 1,573 (95.0) 646 (94.4)
Former smokers 1,229 (31.6) 64 (23.7) 23 (1.39) 10 (1.46)
Smokers 1,938 (49.8) 126 (46.7)*** 60 (3.62) 28 (4.09)
Alcohol intake ≥ 20 g/day (yes) 1,271 (32.5) 81 (29.8) 20 (1.19) 9 (1.29)
Coffee intake ≥ 1 cup/day (yes) 1,283 (32.8) 79 (29.0) 271 (16.1) 92 (13.2)
Physical activity ≥ 20 min/day (yes) 2,020 (53.6) 116 (44.1)** 939 (57.8) 395 (58.9)
Energy (EER %) 96.1 ± 0.75e 97.9 ± 2.39e 105 ± 0.76d 109 ± 1.22c***+
Carbohydrates (En %) 70.2 ± 0.12d 69.7 ± 0.41d 71.2 ± 0.13c 71.4 ± 0.21c***
Protein (En %) 13.5 ± 0.05 13.7 ± 0.15 13.7 ± 0.05 13.6 ± 0.08
Fat (En %) 14.9 ± 0.10c 15.3 ± 0.31c 13.9 ± 0.10d 13.8 ± 0.16d***
Cholesterol (mg/day) 173 ± 2.83 181 ± 9.07 173 ± 2.89 173 ± 4.62
Fiber (g/day) 20.4 ± 0.20 21.2 ± 0.63 20.4 ± 0.20 20.9 ± 0.32
Vitamin C (mg/day) 118 ± 1.84d 124 ± 5.88cd 126 ± 1.87cd 129 ± 3.00c**
Vitamin B6 (mg/day) 0.89 ± 0.01d 0.92 ± 0.03c 0.86 ± 0.01e 0.88 ± 0.02d***++
Vitamin D (ug/day) 5.51 ± 0.11 5.09 ± 0.35 6.21 ± 0.11 6.00 ± 0.18
Calcium (mg/day) 469 ± 5.40 464 ± 17.2 477 ± 5.50 482 ± 8.78
Sodium (g/day) 3.27 ± 0.03c 3.23 ± 0.11cd 3.05 ± 0.03d 3.12 ± 0.05cd*
Dietary inflammatory index (scores) −23.5 ± 2.28c −26.7 ± 1.41d −22.7 ± 23.1c −23.0 ± 5.09c**+
Total phenol (g/day) 1.97 ± 0.26d 2.04 ± 0.83cd 2.14 ± 0.27c 2.16 ± 0.42c**
Total flavonoids (g/day) 1.46 ± 0.12cd 1.48 ± 0.39c 1.45 ± 0.12d 1.49 ± 0.20c*

Values are presented as number (%) or mean standard ± deviation.

aOsteoporosis was defined as either a BMD T score in the tibia or a radius < −2.5; bThe sum of the number of risk alleles in the 5-SNP good model for osteoporosis, including AKAP11_rs238340, KCNMA1_rs628948, PUM1_rs7529390, SPTBN1_rs6752877, and EPDR1_rs2722298.

*Significant difference in gender in two-ANOVA at P < 0.05, **P < 0.01, and ***P < 0.001.

+Significant difference in osteoporosis in two-ANOVA at P < 0.05, ++P < 0.01, and +++P < 0.001.

#interaction between gender and osteoporosis at P < 0.05, ##P < 0.01, and ###P < 0.001.

c,d,e,fValues on the same row with different superscript letters were significantly different among groups by Tukey test at P < 0.05.

Smokers had lower levels of osteoporosis than non-smokers and former smokers, only in men. Alcohol and coffee intake did not influence the incidence of osteoporosis (Table 1). The participants with regular exercise had a lower incidence of osteoporosis in men, but there was no significant difference in the osteoporosis incidence with physical activity in women. Daily energy intake based on the dietary reference intake was higher in the osteoporosis group than in the control group in both men and women (Table 1). The osteoporosis and control groups had similar carbohydrate, protein, and fat intake, including saturated, monounsaturated, and polyunsaturated fatty acids. Meanwhile, carbohydrate and fat intake showed gender differences, but the cholesterol, fiber, and calcium intakes were similar regardless of gender and BMI (Table 1). The vitamin C and sodium intake were higher in women than in men, but there was no significant difference in BMI. The vitamin B6 intake was higher in men than women and higher in those with the osteoporosis group than the control (Table 1). The dietary inflammatory index was lower in men than women and lowered in the osteoporosis group than in the control group (Table 1).

Metabolic parameters of the participants according to gender and osteoporosis

Height was lower in the osteoporosis group and women than in the control group and men (Table 2). On the other hand, the BMI, waist circumferences, hip circumferences, and body fat were higher in the osteoporosis group than in the control group in both genders. However, the muscle mass was similar in the osteoporosis and control groups. Surprisingly, the serum glucose and HbA1c concentrations were similar in the osteoporosis and control groups (Table 2). The HOMA-IR indicated the insulin resistance index, which was similar in the two groups. On the other hand, dyslipidemia was related to osteoporosis (Table 2). The serum HDL cholesterol concentrations were lower and the serum triglyceride concentrations were higher in the osteoporosis group than in the control group (Table 2). The systolic and diastolic blood pressure, estimated glomerular filtration rate (GFR) from serum creatinine levels, and serum ALT and AST concentrations were similar in the osteoporosis and control. The serum CRP concentrations were similar in the two groups, but the white blood cell (WBC) in circulation was lower in the osteoporosis group than in the control group (Table 2). The serum albumin concentrations were lower in the osteoporosis group than in the control group. The hematocrit and blood hemoglobin concentrations were higher in the osteoporosis group than in the control group (Table 2). The serum renin concentration was lower in the osteoporosis than in the control.

Table 2. Metabolic parameters of the participants according to genders and osteoporosisa .

Variables Men (n = 4,037) Women (n = 4,385)
Control (n = 3,911) Osteoporosis (n = 126) Control (n = 3,488) Osteoporosis (n = 897)
Height, cm 166.8 ± 0.10b 166.0 ± 0.34b 154.2 ± 0.11c 153.4 ± 0.17d***+++
Body weight, kg 68.0 ± 0.18c 69.4 ± 0.56b 58.2 ± 0.18e 60.3 ± 0.29d***+++
BMI, kg/m2 24.5 ± 0.07c 25.1 ± 0.20b 24.4 ± 0.07c 25.6 ± 0.11b+++#
Waist circumference, cm 84.0 ± 0.17c 86.3 ± 0.53b 80.5 ± 0.17d 83.3 ± 0.27c***+++
Hip circumference, cm 93.7 ± 0.11c 94.6 ± 0.35b 93.3 ± 0.11c 94.6 ± 0.18b+++
Body fat, % 22.2 ± 0.11d 22.8 ± 0.33d 31.1 ± 0.11c 32.4 ± 0.18b***+++
Muscle mass, kg 37.0 ± 0.07b 37.0 ± 0.21b 28.0 ± 0.07c 28.0 ± 0.11***
Fasting serum glucose, mg/dL 91.3 ± 0.50b 88.6 ± 1.53b 85.4 ± 0.51c 85.0 ± 0.84c***
HbA1c, % 5.80 ± 0.02 5.76 ± 0.06 5.81 ± 0.02 5.75 ± 0.03
HOMA-IR 1.65 ± 0.02 1.67 ± 0.08 1.65 ± 0.03 1.65 ± 0.04
Total-C, mg/dL 192 ± 0.71c 182 ± 2.24d 192 ± 0.72c 197 ± 1.15b***###
LDL-C, mg/dL 114 ± 0.66c 106 ± 2.10d 115 ± 0.67c 119 ± 1.08b**+
HDL-C, mg/dL 43.3 ± 0.20d 40.4 ± 0.63e 46.4 ± 0.20b 45.0 ± 0.32c***+++#
Triglyceride, mg/dL 171 ± 2.09b 179 ± 6.60b 153 ± 3.12d 163 ± 3.39c***+++
SBP, mmHg 118 ± 0.33b 118 ± 1.05b 116 ± 0.34c 118 ± 0.54b#
DBP, mmHg 76.9 ± 0.22b 76.4 ± 0.70b 73.0 ± 0.70c 74.5 ± 0.36c***
eGFR, mL/min/1.73m2 77.3 ± 0.23c 79.4 ± 0.83c 84.0 ± 0.27b 83.1 ± 0.43b***##
Serum ALT, mg/dL 33.6 ± 0.55b 32.9 ± 1.72b 23.2 ± 0.55c 24.5 ± 0.89c***
Serum AST, mg/dL 31.9 ± 0.36 30.3 ± 1.14 28.0 ± 0.37 27.7 ± 0.59
Serum CRP, mg/dL 0.23 ± 0.01 0.25 ± 0.03 0.23 ± 0.01 0.19 ± 0.0
WBC, ×109/L 6.51 ± 0.04bc 6.27 ± 0.12c 6.76 ± 0.04b 6.58 ± 0.06bc**++
Serum albumin, mg/dL 4.40 ± 0.01b 4.19 ± 0.02c 4.17 ± 0.01d 4.16 ± 0.01d***+++###
Hematocrit, % 44.2 ± 0.07b 44.4 ± 0.21b 38.1 ± 0.07d 38.5 ± 0.11c***+
Blood hemoglobin, g/L 14.7 ± 0.02b 14.9 ± 0.07b 12.5 ± 0.02d 12.7 ± 0.04c***++
Serum BUN, mg/dL 15.2 ± 0.07b 15.3 ± 0.23b 13.5 ± 0.07c 13.7 ± 0.12c***
Serum renin, pg/mL 3.27 ± 0.06b 2.31 ± 0.19c 2.29 ± 0.07c 1.93 ± 0.11d***+++#

BMI = body mass index, HOMA-IR = Homeostatic model assessment for insulin resistance, Total-C = total cholesterol, HDL = high-density lipoprotein, LDL = low-density lipoprotein, SBP = systolic blood pressure, DBP = diastolic blood pressure, eGFR = glomerular filtration rate, ALT = alanine aminotransferase, AST = aspartate aminotransferase, CRP = high-sensitive C-reactive protein, WBC = white blood cells, BUN = blood urinary nitrogen.

aOsteoporosis was defined as either BMD in the tibia or wrist < −2.5.

*Significant difference in gender in two-ANOVA at P < 0.05, **P < 0.01, and ***P < 0.001.

+Significant difference in osteoporosis in two-ANOVA at P < 0.05, ++P < 0.01, and +++P < 0.001.

#Interaction between gender and osteoporosis at P < 0.05, ##P < 0.01, and ###P < 0.001.

b,c,d,eValues on the same row with different superscript letters were significantly different among groups by Tukey test at P < 0.05.

The model for osteoporosis risk using the ML approach

In order to explore the prediction model for osteoporosis risk, 109 osteoporosis-related features were chosen manually and applied to train the seven ML algorithms in Ansan/Anseong cohort (Table 3). The prediction model for osteoporosis is defined by < −2.5 T scores of tibia or radius based on people aged in their 20s–30s. After the participants in Ansan/Anseong cohort were categorized into training (n = 7,398) and test (n = 1,023) sets, the best prediction model for the osteoporosis risk was generated by including 10, 15, and 20 features (Table 3). The AUC of the ROC curves was 0.601–0.890 in different ML algorithms, and the prediction model with 15 features showed the highest AUC. Among the seven algorithms, XGBoost, random forest, and DNN showed a high AUC of the ROC (> 0.85) in the prediction models with 10, 15, and 20 features (Table 3).

Table 3. The AUC of the ROC curve, accuracy, and k-fold of prediction models for bone mineral density using machine learning algorithms in the Ansan/Anseong cohort.

Variables Logistic regression XGboost Decision tree KNN SVM Random forest DNN
20 variables
AUC of ROC 0.783 (0.782–0.784) 0.886 (0.884–0.887) 0.715 (0.714–0.716) 0.679 (0.679–0.681) 0.601 (0.598–0.604) 0.876 (0.875–0.877) 0.860
Accuracy 0.848 (0.847–0.848) 0.878 (0.877–0.878) 0.837 (0.837–0.838) 0.815 (0.814–0.815) 0.833 (0.832–0.833) 0.884 (0.883–0.884) 0.845
k-fold 0.851 (0.841–0.860) 0.895 (0.881–0.910) 0.831 (0.822–0.839) 0.826 (0.820–0.832) 0.850 (0.850–0.850) 0.868 (0.861–0.875) 0.850
Top 15 variables
AUC of ROC 0.773 (0.772–0.774) 0.890 (0.896–0.890) 0.722 (0.721–0.723) 0.733 (0.732–0.734) 0.616 (0.616–0.616) 0.872 (0.871–0.872) 0.860
Accuracy 0.867 (0.867–0.868) 0.902 (0.902–0.903) 0.856 (0.855–0.856) 0.847 (0.846–0.847) 0.867 (0.866–0.867) 0.903 (0.903–0.904) 0.857
k-fold 0.862 (0.855–0.869) 0.901 (0.889–0.912) 0.821 (0.816–0.826) 0.823 (0.814–0.832) 0.842 (0.840–0.843) 0.895 (0.887–0.903) 0.860
14 variables (without PRS from the top 15 variables)
AUC of ROC 0.777 (0.772–0.774) 0.852 (0.851–0.853) 0.606 (0.605–0.607) 0.654 (0.653–0.655) 0.589 (0.587–0.589) 0.846 (0.845–0.846) 0.818
Accuracy 0.850 (0.850–0.852) 0.860 (0.859–0.860) 0.787 (0.786–0.787) 0.821 (0.821–0.822) 0.815 (0.814–0.816) 0.856 (0.855–0.856) 0.811
k-fold 0.846 (0.838–0.853) 0.839 (0.829–0.849) 0.804 (0.798–0.810) 0.828 (0.821–0.835) 0.814 (0.813–0.815) 0.837 (0.830–0.844) 0.814
Top 10 variables
AUC of ROC 0.756 (0.757–0.759) 0.864 (0.853–0.854) 0.719 (0.718–0.720) 0.761 (0.760–0.763) 0.609 (0.608–0.609) 0.846 (0.846–0.847) 0.855
Accuracy 0.851 (0.851–0.852) 0.878 (0.877–0.878) 0.839 (0.839–0.840) 0.850 (0.850–0.851) 0.854 (0.853–0.855) 0.885 (0.884–0.885) 0.858
k-fold 0.851 (0.846–0.857) 0.880 (0.867–0.893) 0.833 (0.826–0.840) 0.834 (0.828–0.839) 0.845 (0.844–0.846) 0.886 (0.881–0.893) 0.850

Prediction models were generated from the training set with 80% of the Ansan/Anseong cohort, and 20% was used as a test set.

The prediction model with the top ten variables generated from XGBoost included genders, genetic risk scores for osteoporosis, number of children, number of breastfed children, age, seasons to measure, residence area, education, height, and estrogen therapy. The prediction model with 15 variables contained those with the top 10 variables plus smoking status, serum albumin, hip circumferences, vitamin B6, and weight. The prediction models containing the top 20 variables included 15 variables plus energy intake, waist circumferences, hematocrit, vitamin D, and total flavonoid intake.

AUC = area under the curve, ROC = receiver operating characteristic, XGBoost = extreme gradient boosting, KNN = k-nearest neighbors algorithm, SVM = support vector machines, DNN = deep neural network.

The AUC of the ROC with the 15 top variables was the highest in XGBoost (0.890), random forest (0.872), and DNN (0.860) (Table 3). Furthermore, the AUC of the ROC with XGBoost, random forest, and DNN decreased to 0.864, 0.846, and 0.855 when the most important variables were reduced to ten variables (Table 3). The accuracy and k-fold of all the models with 10, 15, and 20 variables were higher than 0.815 (Table 3). The top 15 variables were selected to predict osteoporosis from each model because the AUC of the ROC was highest than in the other models. The accuracy and k-fold were approximately 0.90 in the XGBoost model with 15 features (Table 3).

The relative importance of the parameters in the random forest and XGBoost prediction models in total participants

Relatively essential features of the predicted models from the XGBoost and random forest algorithms were obtained. The prediction models by XGBoost, random forest algorithms, and DNN selected 20 features, including genders, genetic risk scores for osteoporosis, number of children, number of breastfed children, age, seasons to measure, residence area, education, height, hip, serum albumin, smoking status, vitamin B6, weight, energy intake, waist circumferences, estrogen replacement, hematocrit, vitamin D, and total flavonoids intake (Table 3). Both algorithms showed the same parameters, but the relative importance of each was different in XGBoost, random forest, and DNN model (Table 3). The importance scores showed a significant difference among the features included in the XGBoost algorithm, random forest, and DNN algorithm (Fig. 2A and B). However, the AUC of ROC, accuracy, and k-fold were higher in the XGBoost algorithm than in other models. Therefore, the XGBoost model gave a better prediction of the osteoporosis risk. SHAP analysis for the 20-variable model revealed the features positively or negatively related to the osteoporosis risk (Fig. 2C). The red part indicated a positive association with the SHAP value for osteoporosis incidence. For example, age was red in the positive SHAP values, indicating that age was positively associated with osteoporosis, while height was blue in the positive SHAP, indicating that height was negatively related to osteoporosis.

Fig. 2. The relative importance of the top 20 variables for predicting the osteoporosis risk, as determined by the XGBoost and random forest algorithms. (A) Osteoporosis prediction model by the XGBoost algorithm. (B) Osteoporosis prediction model by the random forest algorithm. (C) Explanation of the variables in the osteoporosis prediction model by the XGBoost algorithm.

Fig. 2

PRS = a polygenic risk score of 5 genetic variants explored for osteoporosis risk, ChildNo = the number of children, BrstC = the number of children who breastfed, Edatemo = the month of participating in the study, Waist = waist circumferences, Hip = hip circumferences, Vit_B6 = vitamin B6 intake, hematocrit, VD = vitamin D intake, EER_Per = the percentage of energy intake by estimated energy requirement, EduA = education level, HRT = the experience of hormone-replacement therapy.

The prediction models by XGBoost, random forest, and DNN algorithms selected 15 features, including genders, genetic risk scores for osteoporosis, gender, number of children, age, the number of breastfed children, residence area, education, seasons to measure, height, estrogen replacement, smoking status, serum albumin, hip circumferences, Vit B6, and weight (Table 3). The prediction model with 15 variables also showed a similar result in the XGBoost, random forest, and DNN algorithms (Fig. 3A and B). The 15-feature model showed the highest AUC of the ROC, accuracy, and k-fold scores, and the XGBoost model was the optimum for predicting the osteoporosis incidence of a HEXA cohort (Table 3). In the DNN algorithm with epochs 30–40, the training loss was equalized with validation loss, training accuracy was improved from 30 epochs, and Keras AUC was 0.86 (Supplementary Fig. 1). The DNN model with 15 variables was sufficient to predict osteoporosis risk. SHAP analysis for the 15-variable model revealed the features positively or negatively related to osteoporosis risk in XGBoost and DNNs (Fig. 3C and D).

Fig. 3. The relative importance of the top 15 variables for predicting osteoporosis risk as determined by the XGBoost and random forest algorithms. (A) Osteoporosis prediction model using the XGBoost algorithm. (B) Osteoporosis prediction model using the random forest algorithm. (C) Explanation of the variables in the osteoporosis prediction model using the XGBoost algorithm. (D) Explanation of the variables in the osteoporosis prediction model using the deep neural network algorithm.

Fig. 3

PRS = a polygenic risk score of 5 genetic variants explored for osteoporosis risk, ChildNo = the number of children, BrstC = the number of children who breastfed, Edatemo = the month of participating in the study, Waist = waist circumferences, Hip = hip circumferences, Vit_B6 = vitamin B6 intake, hematocrit, VD = vitamin D intake, EER_Per = the percentage of energy intake by estimated energy requirement, EduA = education level, HRT = the experience of hormone-replacement therapy.

Since PRS is challenging to apply to the people visiting a clinic, PRS was eliminated to predict the model, and 14 variables were used to generate the prediction model. The prediction model with 14 variables showed 0.7-0.85 AUC of ROC, accuracy, and k-fold (Table 3). Although the validation values in the 14-variable prediction model were lower than those with the 15 variables, including PRS, it was sufficient for predicting osteoporosis risk (Supplementary Fig. 2).

The ten-feature prediction model generated by the XGBoost algorithm included genders, PRS for osteoporosis, number of children and breastfed children, age, seasons to measure, residence area, education, height, and hormone replacement therapy (Fig. 4A). The variables were well separated to show the positive or negative association with osteoporosis risk in the SHAP values (Fig. 4B).

Fig. 4. The relative importance of the top 10 variables for predicting osteoporosis risk as determined by the XGBoost and random forest algorithms. (A) Osteoporosis prediction model using the XGBoost algorithm. (B) Explanation of the variables in the osteoporosis prediction model using the XGBoost algorithm.

Fig. 4

PRS = a polygenic risk score of 5 genetic variants explored for osteoporosis risk, ChildNo = the number of children, BrstC = the number of children who breastfed, Edatemo = the month of participating in the study, EduA = education level, DrugOS = Medication for osteoporosis, HRT = the experience of hormone-replacement therapy.

The relative importance of the parameters in the random forest and XGBoost prediction models in women alone

Since women are known to be susceptible to osteoporosis risk and some parameters are related to females, the prediction model for women was generated. The results for females were similar to all participants. However, the accuracy (0.835–0.84) was lower, and the separation of some variables was not clear between the osteoporosis and control groups since the number of samples was reduced. Therefore, the model generated from both genders was better to be applied to people in a clinical setting. The models from women participants were shown in Supplementary Figs. 3, 4, and 5. The prediction models with 20, 15, and 10 variables were similar between total and female participants. However, the female prediction model included variables such as GFR, frequencies of difficulty sleeping at night, and urinary pH. These results indicated that managing menopausal symptoms might be critical for osteoporosis risk.

Association of osteoporosis predicted by the optimal model with a fracture in a HEXA cohort

Osteoporosis incidence detected by the question about the osteoporosis diagnosis history from a physician was weakly correlated with the fracture experience in the HEXA cohort (r2 = 0.071, P < 0.001; Table 4). Additionally, osteoporosis risk predicted by the BMD using XGBoost, random forest, and DNN algorithms with 15 variables was weakly correlated with osteoporosis incidence. Osteoporosis predicted by XGBoost was correlated with fracture incidence and osteoporosis diagnosis (r2 = 0.035 and r2s = 0.176, respectively; P < 0.001; Table 4). On the other hand, osteoporosis predicted by DNN and the random forest showed a lower correlation with the presence of osteoporosis and fracture experience in the HEXA cohort.

Table 4. Correlation between osteoporosis predicted by several XGBoost, random forest, and DNN.

Variables Osteoporosis Fracture Osteoporosis prediction from XGBoost Osteoporosis prediction from DNN Osteoporosis prediction from random forest
Osteoporosis 1.0000 0.0713 0.1769 0.0909 0.1165
< 0.001 < 0.001 < 0.001 < 0.001
58,612 58,612 58,612 58,612 58,612
Fracture 0.0713 1.0000 0.0348 0.0196 −0.0046
< 0.001 < 0.001 < 0.001 0.2630
58,612 58,701 58,701 58,701 58,701
Osteoporosis prediction from XGBoost 0.1759 0.0348 1.0000 0.2941 0.2674
< 0.001 < 0.001 < 0.001 < 0.001
58,612 58,701 58,701 58,701 58,701
Osteoporosis prediction from DNN 0.0909 0.0196 0.2941 1.0000 0.1371
< 0.001 < 0.001 < 0.001 < 0.001
58,612 58,701 58,701 58,701 58,701
Osteoporosis prediction from random forest 0.1165 −0.0046 0.2674 0.1371 1.0000
< 0.001 0.2633 < 0.001 < 0.001
58,612 58,701 58,701 58,701 58,701

XGBoost = extreme gradient boosting, DNN = deep neural network.

DISCUSSION

Osteoporosis is a disease in the elderly that increases fracture risk, decreases the quality of life, and increases mortality. On the other hand, fractures and osteoporosis are weakly correlated because fractures are associated with various risk factors. Osteoporosis leads to reduce bond strength, which is one of the primary factors in increased fracture risk.26 Osteoporosis is not checked routinely, and it is difficult to notice its risk. Therefore, it is better to generate a good prediction model for osteoporosis. The present study explored the prediction model for osteoporosis using critical features. It was validated with an osteoporosis diagnosis by a physician and fracture experience in a HEXA cohort. The present study showed that the prediction model for osteoporosis risk included gender, polygenetic variants, number of children and breastfed children, age, season to measure the BMD, residence area, serum albumin concentrations, height, body weight, hormone replacement therapy, vitamin B6 intake, and hip circumferences. The prediction model generated by XGBoost showed the highest AUC of the ROC (0.890), accuracy (0.902), and k-fold (0.901). When the prediction model was applied to the HEXA cohort, the predicted osteoporosis risk was weakly correlated with the osteoporosis diagnosis by a doctor (r2 = 0.176, P < 0.001). The incidence of osteoporosis diagnosed by a physician and predicted by the XGBoost algorithm was similarly but weakly correlated with fractures. Therefore, the prediction model by XGBoost may predict osteoporosis status correctly.

Osteoporosis risk is associated with gender and is probably related to the higher peak bone mass in men during their 20s –30s than in women. Before menopause, estrogen protects against the BMD decrement to prevent the development of osteoporosis in women. However, an estrogen deficiency accelerates bone loss, increasing osteoporosis risk in menopausal women. According to a meta-analysis, hormone replacement therapy prevents or treats osteoporosis in menopausal women, and estrogen-progestin therapy has a better impact on increasing BMD than estrogen therapy.27 In the present study, hormonal replacement therapy did not differ between osteoporosis and control groups. This result might be due to a small sample size. However, it was positively associated with some participants with osteoporosis and negatively associated with others with osteoporosis in SHAP analysis. Therefore, hormonal replacement therapy may prevent BMD loss after menopause.

The association between body weight and osteoporosis risk remains controversial,28,29 but body fat content is negatively associated with osteoporosis risk in middle-aged adults in previous studies.30,31 In the present study, the body weight, BMI, and waist and hip circumferences were higher in the osteoporosis group than in the control group in both genders. On the other hand, the body fat contents showed the same trend as the body weight only in women but not men, and the muscle mass was similar in the osteoporosis and control groups. Furthermore, the osteoporosis group had higher energy intake than the control group women. In the prediction model, body weight and hip circumferences were positively associated with the risk of osteoporosis. Therefore, obesity adversely affects women aged over 40 years of age. In addition to obesity, height was smaller in the osteoporosis group than in the control group of women over 40 years in the present study. It suggests that height was reduced due to low BMD. A decreased stature is a known osteoporosis phenotype in the elderly.32 Therefore, a decreased height in women was reflected in BMD loss in the prediction model.

Women are more susceptible to osteoporosis, which may be associated with pregnancy and breastfeeding. Although increased calcium absorption and more estrogen secretion protected against bone loss during pregnancy and lactation, prolonged breastfeeding was positively associated with osteoporosis risk in postmenopausal women (n = 1,222), according to the KNHANES 2010–2011.33 On the other hand, childbirth age and the number of deliveries do not affect BMD in postmenopausal women. In the present study, the number of bearing and breastfed children was higher in the osteoporosis group than in the control group. On the other hand, the pregnancy experience was rather higher in the control group, and the pregnancy age was similar in the osteoporosis and control groups. Menstrual and menopausal ages did not differ between the two groups.

The genetic risk scores for osteoporosis were strongly associated with predicting osteoporosis, and they were involved in the balance of osteogenesis and osteoclastogenesis in the present study. Osteogenesis is associated with TGF-β and Wnt signaling through COL1A1, COL1A2, LRP5, PLS3, and WNT1. 34,35,36 Furthermore, rs6086746 in the PLCB4 promoter alters the binding affinity to RUNX2 to influence the osteoporosis risk.37 Osteoclastogenesis is involved in RANKL-induced bone resorption with runt domain transcription factor 2 (RUNX2), osteoprotegerin (OPG), and NF-κB activation.38 In a previous study, the polygenetic-risk scores of AKAP11_rs238340, KCNMA1_rs628948, PUM1_rs7529390, SPTBN1_rs6752877, and EPDR1_rs2722298 were positively associated with the susceptibility to osteoporosis by 1.7-fold.1 The scores interacted with coffee and caffeine intake to influence the osteoporosis risk. Participants with low intake had an approximately 2.3-fold higher osteoporosis risk than those with a high intake. Thus, genetic impacts should be studied with lifestyle interaction for osteoporosis risk. The present study used the PRS as the genetic factor to predict osteoporosis risk and was ranked as a high-importance factor.

Nutrient intake, including calcium, vitamin D, flavonoids, sodium, physical exercise, smoking status, and alcohol, was related to the osteoporosis risk. The participants consumed low calcium (average of approximately 450 mg/day), and the calcium and vitamin D intake were similar in the osteoporosis and Control groups. Vitamin B6 intake was higher in the Control group than in the osteoporosis group. Interestingly, the intakes of other nutrients except for vitamin B6 were similar in the osteoporosis and Control groups. Although vitamin B6 acts as a coenzyme in amino acid metabolism, neurotransmitter production, and the nervous and immune system, it has not been highlighted, like vitamin D and calcium for BMD. Osteoporosis risk is 61% higher in the low level of serum vitamin B6 than in the high level. However, there was no association with vitamin D in Chinese postmenopausal women.39 Serum vitamin B6 concentrations are negatively correlated to bone turnover markers. The other study has also demonstrated that they are positively associated with a fractured ankle.40 Therefore, vitamin B6 intake is potentially related to bone health, and adults need to consume foods rich in vitamin B6. Vitamin B6-rich foods are beef liver, tuna, salmon, chicken breast, chickpeas, bananas, cottage cheese, nuts, and onion. The recommended intake is 1.3 mg/day for adults (19-50 years) and 1.7 and 1.5 mg/day for men and women > 50 years, respectively. The dietary inflammatory index was significantly lower in the osteoporosis group than in the Control group. However, these results did not show consistent nutrient intakes on the osteoporosis risk because the study was cross-sectional, and the results were not related to a cause-and-effect. Therefore, it needed to be validated using large randomized clinical trials or prospective cohort studies.

Although nutrient intake and lifestyles were not related to the osteoporosis risk, HDL, triglyceride, WBC, albumin, renin, and hemoglobin concentrations in the blood circulation were significantly different in the osteoporosis and control groups. In Japan, low serum albumin concentrations are associated with osteoporosis risk in postmenopausal women,41 even though serum albumin concentration was lower in the osteoporosis group than in the control group only in men in the present study. In Chinese menopausal women, the red blood cells, platelet, and hemoglobin levels of postmenopausal women in the osteoporosis group were higher than those in the non-osteoporosis group,42 which is consistent with the present study. On the other hand, the association between WBC concentration and osteoporosis risk remains controversial.43

Although fracture risk is weakly associated with BMD, the fracture risk assessment tool (FRAT) includes BMD and BMD-related parameters. It suggests that fracture risk is partly related to osteoporosis risk. In the present study, BMD prediction included age, gender, body weight, height, and smoking status, which are included in FRAT. In the present study, taking glucocorticoids, rheumatic arthritis incidence, and alcohol intake in the FRAT were used to predict BMD. However, they were not included in the prediction model for osteoarthritis risk. Since Ansan/Anseong cohort did not measure fracture-related parameters and secondary osteoporosis, the parameters were not considered as the prediction model for osteoporosis risk. The results suggested that similar anthropometry and demographic parameters were involved, but some lifestyle-related parameters were differently related to the prediction models for osteoporosis and fracture risk.

The factors included in the prediction model for osteoporosis risk were fitness in Koreans aged > 40. The prediction model with 15 features expected osteoporosis very well (AUC of ROC in test set = 0.890, accuracy = 0.902, k-fold = 0.901) in the Korean cohort, and the prediction model was used to categorize the participants in the HEXA cohort according to osteoporosis risk. The predicted incidence of osteoporosis was weakly and positively correlated with osteoporosis diagnosed by a physician in the HEXA cohort. The weak correlation was related to the under- or over-estimation of osteoporosis. Only limited people are checked for BMD in regular medical checkups in Korea, and its diagnosis might not be conducted with BMD measurement. Moreover, the persons diagnosed with osteoporosis by a physician had medical treatment and lifestyle changes, and the BMD status could be changed in the HEXA cohort. The present study also showed that fracture experiences were weakly correlated with the osteoporosis incidence diagnosed by a physician and predicted by the prediction model. Previous studies showed that fracture and the risk of osteoporosis are weakly correlated because the fracture is involved in various factors except for a low BMD.44,45 Therefore, the prediction model was suitable for estimating osteoporosis risk.

This study had some limitations. First, this study was cross-sectionally conducted to measure the biomarkers at a single point, which may be different from the actual state of the participants. However, this study was large enough to overcome the issue. Second, the BMD measurement was conducted with a peripheral densitometer, which is less accurate than DEXA. However, BMD measured with a peripheral densitometer can be used to assess osteoporosis risk in a clinical setting in the previous studies.20 , 21 Third, the WHO definition of osteoporosis was made with the BMD in the lumbar spine and femur measured with DEXA. However, BMD was measured in the wrist and tibia using a peripheral densitometer in the Ansan/Anseong cohort. The osteoporosis definition may be overestimated, corresponding to the results of the Rhee et al. study.21 However, the BMD measured with a peripheral densitometer was worthwhile to generate the prediction model for osteoporosis risk and used in a clinical setting. Fourth, the genetic impact was measured with a person’s PRS, which cannot be easily measured in a clinical setting. It can be substituted with family history, but the family history of osteoporosis was provided only in one-third of the participants in the Ansan/Anseong cohort. The family history data were not incorporated in the prediction model as genetic impact. Fifth, the prediction model did not include the parameters related to secondary osteoporosis, such as endocrine diseases, cancer, and their medications which were reported to be predominant parameters. It might be due to the small number of patients with endocrine diseases and cancer influencing BMD. Further study is needed to generate a prediction model for osteoporosis with a bigger sample size with various diseases and taking medications to influence osteoporosis risk. Finally, the direct association of BMD with the fracture experience was not determined. However, it was estimated using predicted osteoporosis risk in the HEXA cohort because fracture experience was not reported in the Ansan/Anseong cohort.

In conclusion, the osteoporosis prediction model by XGBoost was appropriate for its estimation in Asians. The model included the genetic factor, gender, number of children, age, the number of breastfed children, residence area, education, seasons, height, smoking status, estrogen replacement, serum albumin, hip circumferences, vitamin B6, and body weight. The values for the exposure risk factors in the prediction model can be applied to predict or self-monitor osteoporosis development and/or progression in a clinical setting. The modifiable parameters in the prediction model can also be applied to preventive and therapeutic measures for osteoporosis and fracture risk in Asians.

Footnotes

Funding: This research was supported by the National Research Foundation of Korea (RS-2023-00208567).

Disclosure: The authors have no potential conflicts of interest to disclose.

Data Availability Statement: The data presented in this study are available on request from the corresponding author.

Author Contributions:
  • Formal analysis: Park S, Wu X.
  • Methodology: Wu X.
  • Visualization: Park S.
  • Writing - original draft: Park S.
  • Writing - review & editing: Wu X.

SUPPLEMENTARY MATERIALS

Supplementary Fig. 1

The accuracy and validation of the prediction model for osteoporosis risk with deep neural network (DNN). (A) Training and validation loss. (B) Keras area under the curve (AUC). (C) Training and validation accuracy.

jkms-38-e162-s001.doc (82KB, doc)
Supplementary Fig. 2

The relative importance of the top 14 variablesa for predicting osteoporosis risk without polygenic risk scores as determined by the XGBoost and random forest algorithms in all participants. (A) Osteoporosis prediction model using the XGBoost algorithm. (B) Explanation of the variables in the osteoporosis prediction model using the XGBoost algorithm. (C) Explanation of the variables in the osteoporosis prediction model using the random forest algorithm.

jkms-38-e162-s002.doc (155.5KB, doc)
Supplementary Fig. 3

The relative importance of the top 20 variables for predicting the osteoporosis risk, as determined by the XGBoost and random forest algorithms in women only. (A) Osteoporosis prediction model by the XGBoost algorithm. (B) Explanation of the variables in the osteoporosis prediction model by the XGBoost algorithm. (C) Area under the curve of receiver operating characteristic curve.

jkms-38-e162-s003.doc (168KB, doc)
Supplementary Fig. 4

The relative importance of the top 15 variables for predicting osteoporosis risk as determined by the XGBoost and random forest algorithms in women only. (A) Osteoporosis prediction model using the XGBoost algorithm. (B) Osteoporosis prediction model using the random forest algorithm. (C) Explanation of the variables in the osteoporosis prediction model using the XGBoost algorithm.

jkms-38-e162-s004.doc (157.5KB, doc)
Supplementary Fig. 5

The relative importance of the top 10 variables for predicting osteoporosis risk as determined by the XGBoost and random forest algorithms in women only. (A) Osteoporosis prediction model using the XGBoost algorithm. (B) Osteoporosis prediction model using the random forest algorithm. (C) Explanation of the variables in the osteoporosis prediction model using the XGBoost algorithm.

jkms-38-e162-s005.doc (135KB, doc)

References

  • 1.Park S, Daily JW, Song MY, Kwon HK. Gene-gene and gene-lifestyle interactions of AKAP11, KCNMA1, PUM1, SPTBN1, and EPDR1 on osteoporosis risk in middle-aged adults. Nutrition. 2020;79-80:110859. doi: 10.1016/j.nut.2020.110859. [DOI] [PubMed] [Google Scholar]
  • 2.Sarafrazi N, Wambogo EA, Shepherd JA. Osteoporosis or low bone mass in older adults: United States, 2017–2018. NCHS Data Brief. 2021;405(405):1–8. [PubMed] [Google Scholar]
  • 3.Wang Y, Tao Y, Hyman ME, Li J, Chen Y. Osteoporosis in China. Osteoporos Int. 2009;20(10):1651–1662. doi: 10.1007/s00198-009-0925-y. [DOI] [PubMed] [Google Scholar]
  • 4.Ha Y. Epidemiology of osteoporosis in Korea. J Korean Med Assoc. 2016;59(11):836–841. [Google Scholar]
  • 5.Yoo JE, Park HS. Prevalence and associated risk factors for osteoporosis in Korean men. Arch Osteoporos. 2018;13(1):88. doi: 10.1007/s11657-018-0506-9. [DOI] [PubMed] [Google Scholar]
  • 6.Lee JH, Kim JH, Hong AR, Kim SW, Shin CS. Optimal body mass index for minimizing the risk for osteoporosis and type 2 diabetes. Korean J Intern Med. 2020;35(6):1432–1442. doi: 10.3904/kjim.2018.223. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Park SJ, Jung JH, Kim MS, Lee HJ. High dairy products intake reduces osteoporosis risk in Korean postmenopausal women: a 4 year follow-up study. Nutr Res Pract. 2018;12(5):436–442. doi: 10.4162/nrp.2018.12.5.436. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Park S, Kang S, Kim DS. Severe calcium deficiency increased visceral fat accumulation, down-regulating genes associated with fat oxidation, and increased insulin resistance while elevating serum parathyroid hormone in estrogen-deficient rats. Nutr Res. 2020;73:48–57. doi: 10.1016/j.nutres.2019.09.008. [DOI] [PubMed] [Google Scholar]
  • 9.Kim SW, Lee HA, Cho EH. Low handgrip strength is associated with low bone mineral density and fragility fractures in postmenopausal healthy Korean women. J Korean Med Sci. 2012;27(7):744–747. doi: 10.3346/jkms.2012.27.7.744. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Hou J, He C, He W, Yang M, Luo X, Li C. Obesity and bone health: a complex link. Front Cell Dev Biol. 2020;8:600181. doi: 10.3389/fcell.2020.600181. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Pouresmaeili F, Kamalidehghan B, Kamarehei M, Goh YM. A comprehensive overview on osteoporosis and its risk factors. Ther Clin Risk Manag. 2018;14:2029–2049. doi: 10.2147/TCRM.S138000. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Greenbaum J, Lin X, Su KJ, Gong R, Shen H, Shen J, et al. Integration of the human gut microbiome and serum metabolome reveals novel biological factors involved in the regulation of bone mineral density. Front Cell Infect Microbiol. 2022;12:853499. doi: 10.3389/fcimb.2022.853499. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Reel PS, Reel S, Pearson E, Trucco E, Jefferson E. Using machine learning approaches for multi-omics data analysis: a review. Biotechnol Adv. 2021;49:107739. doi: 10.1016/j.biotechadv.2021.107739. [DOI] [PubMed] [Google Scholar]
  • 14.Battineni G, Sagaro GG, Chinatalapudi N, Amenta F. Applications of machine learning predictive models in the chronic disease diagnosis. J Pers Med. 2020;10(2):21. doi: 10.3390/jpm10020021. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Lee SK, Son YJ, Kim J, Kim HG, Lee JI, Kang BY, et al. Prediction model for health-related quality of life of elderly with chronic diseases using machine learning techniques. Healthc Inform Res. 2014;20(2):125–134. doi: 10.4258/hir.2014.20.2.125. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Rabbee N, Speed TP. A genotype calling algorithm for affymetrix SNP arrays. Bioinformatics. 2006;22(1):7–12. doi: 10.1093/bioinformatics/bti741. [DOI] [PubMed] [Google Scholar]
  • 17.Zhu X, Bai W, Zheng H. Twelve years of GWAS discoveries for osteoporosis and related traits: advances, challenges and applications. Bone Res. 2021;9(1):23. doi: 10.1038/s41413-021-00143-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Kim Y, Han BG KoGES group. Cohort profile: the Korean Genome and Epidemiology Study (KoGES) consortium. Int J Epidemiol. 2017;46(2):e20. doi: 10.1093/ije/dyv316. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Ryan H, Trosclair A, Gfroerer J. Adult current smoking: differences in definitions and prevalence estimates--NHIS and NSDUH, 2008. J Environ Public Health. 2012;2012:918368. doi: 10.1155/2012/918368. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Olszynski WP, Adachi JD, Hanley DA, Davison KS, Brown JP. Comparison of speed of sound measures assessed by multisite quantitative ultrasound to bone mineral density measures assessed by dual-energy X-ray absorptiometry in a large canadian cohort: the Canadian Multicentre Osteoporosis Study (CaMos) J Clin Densitom. 2016;19(2):234–241. doi: 10.1016/j.jocd.2015.04.004. [DOI] [PubMed] [Google Scholar]
  • 21.Rhee Y, Lee J, Jung JY, Lee JE, Park SY, Kim YM, et al. Modifications of T-scores by quantitative ultrasonography for the diagnosis of osteoporosis in Koreans. J Korean Med Sci. 2009;24(2):232–236. doi: 10.3346/jkms.2009.24.2.232. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Park S, Daily JW, Zhang X, Jin HS, Lee HJ, Lee YH. Interactions with the MC4R rs17782313 variant, mental stress and energy intake and the risk of obesity in Genome Epidemiology Study. Nutr Metab (Lond) 2016;13(1):38. doi: 10.1186/s12986-016-0096-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Park S, Ham JO, Lee BK. Effects of total vitamin A, vitamin C, and fruit intake on risk for metabolic syndrome in Korean women and men. Nutrition. 2015;31(1):111–118. doi: 10.1016/j.nut.2014.05.011. [DOI] [PubMed] [Google Scholar]
  • 24.Wu X, Park S. An inverse relation between hyperglycemia and skeletal muscle mass predicted by using a machine learning approach in middle-aged and older adults in large cohorts. J Clin Med. 2021;10(10):2133. doi: 10.3390/jcm10102133. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Park S, Kim C, Wu X. Development and validation of an insulin resistance predicting model using a machine-learning approach in a population-based cohort in Korea. Diagnostics (Basel) 2022;12(1):212. doi: 10.3390/diagnostics12010212. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Porter J, Varacallo M. Osteoporosis. Treasure Island, FL, USA: StatPearls Publishing; 2022. [Google Scholar]
  • 27.Prior JC, Seifert-Klauss VR, Giustini D, Adachi JD, Kalyan S, Goshtasebi A. Estrogen-progestin therapy causes a greater increase in spinal bone mineral density than estrogen therapy - a systematic review and meta-analysis of controlled trials with direct randomization. J Musculoskelet Neuronal Interact. 2017;17(3):146–154. [PMC free article] [PubMed] [Google Scholar]
  • 28.Cherukuri L, Kinninger A, Birudaraju D, Lakshmanan S, Li D, Flores F, et al. Effect of body mass index on bone mineral density is age-specific. Nutr Metab Cardiovasc Dis. 2021;31(6):1767–1773. doi: 10.1016/j.numecd.2021.02.027. [DOI] [PubMed] [Google Scholar]
  • 29.Lee JH, Kim JH, Hong AR, Kim SW, Shin CS. Optimal body mass index for minimizing the risk for osteoporosis and type 2 diabetes. Korean J Intern Med. 2020;35(6):1432–1442. doi: 10.3904/kjim.2018.223. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Kim DH, Lim H, Chang S, Kim JN, Roh YK, Choi MK. Association between body fat and bone mineral density in normal-weight middle-aged Koreans. Korean J Fam Med. 2019;40(2):100–105. doi: 10.4082/kjfm.17.0082. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Chen YY, Fang WH, Wang CC, Kao TW, Chang YW, Wu CJ, et al. Body fat has stronger associations with bone mass density than body mass index in metabolically healthy obesity. PLoS One. 2018;13(11):e0206812. doi: 10.1371/journal.pone.0206812. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Mikula AL, Hetzel SJ, Binkley N, Anderson PA. Validity of height loss as a predictor for prevalent vertebral fractures, low bone mineral density, and vitamin D deficiency. Osteoporos Int. 2017;28(5):1659–1665. doi: 10.1007/s00198-017-3937-z. [DOI] [PubMed] [Google Scholar]
  • 33.Hwang IR, Choi YK, Lee WK, Kim JG, Lee IK, Kim SW, et al. Association between prolonged breastfeeding and bone mineral density and osteoporosis in postmenopausal women: KNHANES 2010-2011. Osteoporos Int. 2016;27(1):257–265. doi: 10.1007/s00198-015-3292-x. [DOI] [PubMed] [Google Scholar]
  • 34.Oheim R, Tsourdi E, Seefried L, Beller G, Schubach M, Vettorazzi E, et al. Genetic diagnostics in routine osteological assessment of adult low bone mass disorders. J Clin Endocrinol Metab. 2022;107(7):e3048–e3057. doi: 10.1210/clinem/dgac147. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Li X, Cheng J, Dong B, Yu X, Zhao X, Zhou Z. Common variants of the OPG gene are associated with osteoporosis risk: a meta-analysis. Genet Test Mol Biomarkers. 2021;25(9):600–610. doi: 10.1089/gtmb.2020.0282. [DOI] [PubMed] [Google Scholar]
  • 36.Varenna M, Crotti C, Bonati MT, Zucchi F, Gallazzi M, Caporali R. A novel mutation in collagen gene COL1A2 associated with transient regional osteoporosis. Osteoporos Int. 2022;33(1):299–303. doi: 10.1007/s00198-021-06135-7. [DOI] [PubMed] [Google Scholar]
  • 37.Tsai DJ, Fang WH, Wu LW, Tai MC, Kao CC, Huang SM, et al. The polymorphism at PLCB4 promoter (rs6086746) changes the binding affinity of RUNX2 and affects osteoporosis susceptibility: an analysis of bioinformatics-based case-control study and functional validation. Front Endocrinol (Lausanne) 2021;12:730686. doi: 10.3389/fendo.2021.730686. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Bogacz A, Gorska A, Kaminski A, Wolek M, Wolski H, Seremak-Mrozikiewicz A, et al. The importance of NFκB1 rs4648068 and RUNX2 rs7771980 polymorphisms in bone metabolism of postmenopausal Polish women. Ginekol Pol. 2021 doi: 10.5603/GP.a2021.0044. Forthcoming. [DOI] [PubMed] [Google Scholar]
  • 39.Wang J, Chen L, Zhang Y, Li CG, Zhang H, Wang Q, et al. Association between serum vitamin B6 concentration and risk of osteoporosis in the middle-aged and older people in China: a cross-sectional study. BMJ Open. 2019;9(7):e028129. doi: 10.1136/bmjopen-2018-028129. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Li Z, Zhang S, Wan L, Song X, Yuan D, Zhang S, et al. Vitamin B6 as a novel risk biomarker of fractured ankles. Medicine (Baltimore) 2021;100(40):e27442. doi: 10.1097/MD.0000000000027442. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Nagayama Y, Ebina K, Tsuboi H, Hirao M, Hashimoto J, Yoshikawa H, et al. Low serum albumin concentration is associated with increased risk of osteoporosis in postmenopausal patients with rheumatoid arthritis. J Orthop Sci. 2022;27(6):1283–1290. doi: 10.1016/j.jos.2021.08.018. [DOI] [PubMed] [Google Scholar]
  • 42.Li L, Ge JR, Chen J, Ye YJ, Xu PC, Li JY. Association of bone mineral density with peripheral blood cell counts and hemoglobin in Chinese postmenopausal women: a retrospective study. Medicine (Baltimore) 2020;99(28):e20906. doi: 10.1097/MD.0000000000020906. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Valderrábano RJ, Lui LY, Lee J, Cummings SR, Orwoll ES, Hoffman AR, et al. Bone density loss is associated with blood cell counts. J Bone Miner Res. 2017;32(2):212–220. doi: 10.1002/jbmr.3000. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Mai HT, Tran TS, Ho-Le TP, Center JR, Eisman JA, Nguyen TV. Two-thirds of all fractures are not attributable to osteoporosis and advancing age: implications for fracture prevention. J Clin Endocrinol Metab. 2019;104(8):3514–3520. doi: 10.1210/jc.2018-02614. [DOI] [PubMed] [Google Scholar]
  • 45.Leslie WD, Majumdar SR, Morin SN, Lix LM. Why does rate of bone density loss not predict fracture risk? J Clin Endocrinol Metab. 2015;100(2):679–683. doi: 10.1210/jc.2014-3777. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary Fig. 1

The accuracy and validation of the prediction model for osteoporosis risk with deep neural network (DNN). (A) Training and validation loss. (B) Keras area under the curve (AUC). (C) Training and validation accuracy.

jkms-38-e162-s001.doc (82KB, doc)
Supplementary Fig. 2

The relative importance of the top 14 variablesa for predicting osteoporosis risk without polygenic risk scores as determined by the XGBoost and random forest algorithms in all participants. (A) Osteoporosis prediction model using the XGBoost algorithm. (B) Explanation of the variables in the osteoporosis prediction model using the XGBoost algorithm. (C) Explanation of the variables in the osteoporosis prediction model using the random forest algorithm.

jkms-38-e162-s002.doc (155.5KB, doc)
Supplementary Fig. 3

The relative importance of the top 20 variables for predicting the osteoporosis risk, as determined by the XGBoost and random forest algorithms in women only. (A) Osteoporosis prediction model by the XGBoost algorithm. (B) Explanation of the variables in the osteoporosis prediction model by the XGBoost algorithm. (C) Area under the curve of receiver operating characteristic curve.

jkms-38-e162-s003.doc (168KB, doc)
Supplementary Fig. 4

The relative importance of the top 15 variables for predicting osteoporosis risk as determined by the XGBoost and random forest algorithms in women only. (A) Osteoporosis prediction model using the XGBoost algorithm. (B) Osteoporosis prediction model using the random forest algorithm. (C) Explanation of the variables in the osteoporosis prediction model using the XGBoost algorithm.

jkms-38-e162-s004.doc (157.5KB, doc)
Supplementary Fig. 5

The relative importance of the top 10 variables for predicting osteoporosis risk as determined by the XGBoost and random forest algorithms in women only. (A) Osteoporosis prediction model using the XGBoost algorithm. (B) Osteoporosis prediction model using the random forest algorithm. (C) Explanation of the variables in the osteoporosis prediction model using the XGBoost algorithm.

jkms-38-e162-s005.doc (135KB, doc)

Articles from Journal of Korean Medical Science are provided here courtesy of Korean Academy of Medical Sciences

RESOURCES