Abstract
Undercarboxylated osteocalcin (ucOC) could be a biomarker of glucose disturbances and cardiovascular risk. Our study aimed to determine the association between serum levels of ucOC and cardiovascular risk in metabolic syndrome (MetS) patients and to analyse its potential role as estimator of type 2 diabetes (T2D) risk in this population. This cross-sectional study included 235 patients with MetS, 53.2% women, aged 55–75 years. Circulating ucOC levels were measured by ELISA. Cardiovascular risk was determined as Z-score of the diagnostic criteria for MetS (CV-ZS). Linear regression model was performed to analyse the association between circulating ucOC and CV-ZS. A receiver operating curve (ROC) was performed to analyse the usefulness of ucOC as T2D risk estimator. Patients above the CV-ZS median showed significant lower ucOC levels. We found an inverse association between ucOC levels and CV-ZS in MetS patients without T2D. Patients with ucOC levels below the 25th percentile showed worse cardiometabolic profile and higher cardiovascular and T2D risk. The area under the curve performed better when ucOC levels were included along with the classic T2D risk factors. The measurement of circulating ucOC could be a useful tool to identify increased cardiovascular and T2D risk in MetS patients without T2D.
Subject terms: Biomarkers, Endocrinology, Risk factors
Introduction
Current lifestyle is causing a remarkable increase in overweight up to epidemic numbers globally1. In Spain, over 60% of the adult population is overweight or obese2. According to this trend, an increase of 16% in the number of cases is estimated by 2030 associated with a 58% increase in direct healthcare costs3. A large body of evidence has shown that all-cause mortality, and especially cardiovascular-related mortality, is associated with an increased central adiposity and overweight4. Visceral obesity in conjunction with other disorders, such as dyslipidaemia, hypertension and fasting hyperglycaemia lead to the metabolic syndrome (MetS), conferring thus a larger risk of developing cardiovascular disease (CVD)5.
An association between osteoporosis, CVD and cardiovascular-related mortality has been reported6,7. The common risk factors involved in bone fragility and CVD could partially explain this association. Therefore, the imbalance between bone formation and resorption occurring in bone disorders could play a role in the development of vascular complications8. Recent data suggest an influence of bone metabolism on energy balance, which may be relevant for CVD9. In this regard, angiogenesis plays a major role in bone fracture healing and repair10 and changes in the local vasculature are associated with the progression of numerous conditions affecting bone, such as osteoporosis, rheumatoid arthritis, bone cancer and metastasis11.
Bone-related proteins, such as osteocalcin (OC), are of special interest for the study of CVD. OC is a small non-collagenous protein of 49 amino acids produced exclusively by osteoblasts and it is one of the most abundant proteins in bone. OC has been classically linked to bone mineralisation12. Moreover, the role of OC as an endocrine hormone involved in the regulation of energy metabolism has been demonstrated in vitro and in animal models13. Most OC is incorporated into the extracellular bone matrix; however, its undercarboxylated fraction (ucOC) is released into the bloodstream. UcOC can act directly on pancreatic beta cells and on adipocytes, regulating insulin secretion and insulin sensitivity. These findings have assigned a new role to the bone as an endocrine organ with extra-skeletal functions14.
Several studies in humans have evaluated the relationship between circulating levels of total OC and impaired glucose metabolism15, pointing to OC as a marker that could predict changes in glucose homeostasis16.
Moreover, OC has been linked to atherosclerotic parameters, such as brachial-ankle pulse wave velocity and intima-media thickness in patients with T2D17 and previous atherosclerotic disease8.
Despite the large evidence about OC as a metabolic regulator18–20, the involvement of ucOC in cardiovascular risk in MetS patients remains unclear. This occurs because most of the studies in this regard have analysed the relationship between ucOC and individual cardiovascular parameters. To date, no studies evaluating the role of ucOC serum levels as a potential biomarker of cardiovascular risk determined as a global score are available.
In this context, the aims of the present study were: 1. To determine the serum levels of ucOC in adults with MetS in order to analyse the association between ucOC and cardiovascular risk scores. 2. To provide information on the possible usefulness of circulating ucOC level as estimator of T2D risk in this population.
Results
Characteristics of the study population
The clinical characteristics of the entire population according to the cardiovascular risk Z-score (CV-ZS) for 50th percentile (P50) are summarised in Table 1.
Table 1.
Total sample (N = 235) | <P50 CV-ZS (N = 117) | >P50 CV-ZS (N = 118) | p-value | ||||
---|---|---|---|---|---|---|---|
Men/Women | 111/124 | 52/65 | 65/59 | 0.394 | |||
Sedentarism (%) | 44.7% | 41.0% | 48.3% | 0.262 | |||
Current smoker (%) | 11.1% | 8.5% | 13.6% | 0.221 | |||
Presence of T2D (%) | 22.6 | 11.2% | 36.1% | <0.001 | |||
Antidiabetic drugs (%) | 23 | 12.0% | 33.9% | <0.001 | |||
Antihypertensive drugs (%) | 75.3 | 70.1% | 80.5% | 0.064 | |||
Hypolipidaemic drugs (%) | 37.4 | 41.9% | 33.9% | 0.207 | |||
mean | SD | mean | SD | mean | SD | ||
Age (years) | 63.9 | 4.9 | 64.4 | 4.8 | 63.6 | 4.9 | 0.211 |
BMI (m/kg2) | 32.5 | 3.5 | 30.9 | 2.9 | 34.0 | 3.4 | <0.001 |
WC (cm) | 107.7 | 10.2 | 102.9 | 8.4 | 112.4 | 9.6 | <0.001 |
Mean BP (mm Hg) | 103.3 | 11.4 | 99.4 | 9.8 | 107.2 | 11.6 | <0.001 |
FPG (mg/dL) | 102.3 | 25.3 | 91.5 | 12.2 | 113.0 | 30.0 | <0.001 |
Total cholesterol (mg/dL) | 202.3 | 36.9 | 206.8 | 36.1 | 197.8 | 37.2 | 0.062 |
HDL cholesterol (mg/dL) | 49.1 | 10.0 | 53.4 | 9.8 | 44.8 | 8.3 | <0.001 |
LDL cholesterol (mg/dL) | 124.3 | 33.9 | 126.6 | 31.5 | 122.1 | 36.1 | 0.309 |
TG levels (mg/dL) | 169.7 | 74.1 | 141.9 | 49.9 | 197.3 | 83.4 | <0.001 |
HbA1c (%) | 6.0 | 1.1 | 5.6 | 1.1 | 6.3 | 0.9 | <0.001 |
ucOC (ng/mL) | 5.9 | 5.1 | 6.9 | 6.0 | 4.9 | 3.7 | 0.004 |
Log ucOC (ng/mL) | 0.6 | 0.3 | 0.7 | 0.3 | 0.6 | 0.3 | <0.001 |
Framingham (%) | 14.38 | 7.37 | 12.55 | 7.11 | 16.26 | 7.20 | <0.001 |
REGICOR (%) | 6.27 | 3.15 | 5.21 | 2.30 | 7.31 | 3.51 | <0.001 |
BMI: body mass index; WC: waist circumference; FPG: fasting plasma glucose; TG: triglyceride; T2D: type 2 diabetes; ucOC: undercarboxylated osteocalcin; CV-ZS: cardiovascular risk score.
Data for continuous variables are expressed as mean ± SD. Data for categorical variables are expressed as percentages. Comparison was performed between groups with CV-ZS below and above P50. Student’s t test and χ2 test were used for comparisons of continuous and categorical variables, respectively, between groups. Significance was set at p < 0.05.
Both groups (<P50 CV-ZS and >P50 CV-ZS) were comparable in age and sex. As expected, the MetS patients with higher cardiovascular risk (>P50 CV-ZS) showed significantly worse cardiometabolic profile in terms of body mass index (BMI), waist circumference (WC), blood pressure (BP), fasting plasma glucose (FPG), high-density lipoprotein cholesterol (HDL-C), triglyceride (TG) levels and glycated haemoglobin (HbA1c). In addition, these patients showed significantly lower serum levels of ucOC than the group with CV-ZS below P50.
Considering cardiovascular risk scores estimated by Framingham and REGICOR, we found significant differences between groups according to P50 of CV-ZS, finding a significant positive correlation between CV-ZS and Framingham and REGICOR scores (Fig. 1).
We found significantly higher percentage of patients with prevalent T2D in the group above P50 of CV-ZS than in the group below P50 of CV-ZS.
Association between serum levels of ucOC and cardiovascular risk factors
Our results showed a correlation between the logarithm of serum ucOC levels and sex (r = 0.191, p = 0.004). Women showed higher serum levels of ucOC than men (0.70 ± 0.33 ng/mL vs. 0.57 ± 0.33 ng/mL, p = 0.004). No association was found between ucOC levels and age (r = 0.041, p = 0.535).
When patients were further divided according to the presence of T2D, we found that serum ucOC levels were significantly lower in T2D patients than in MetS patients without T2D (Fig. 2A). To prevent possible biases in the results related to the potential influence of T2D on serum levels of ucOC, the group of patients with MetS without T2D was analysed separately. In these patients, those presenting a higher cardiovascular risk (>P50 CV-ZS) showed significantly lower levels of ucOC than the group with lower cardiovascular risk (Fig. 2B). This trend remained close to significance after sex adjustment (0.65 ± 0.03 ng/mL vs. 0.75 ± 0.03 ng/mL; p = 0.074).
The association between circulating ucOC levels and cardiovascular risk factors showed a positive correlation between circulating levels of ucOC, HDL-C and total cholesterol and an inverse correlation between ucOC levels and WC, FPG, HbA1c and cardiovascular risk scores (CV-ZS, Framingham and REGICOR) in the entire sample. When T2D patients were excluded from the analysis, no association was found between ucOC and the variables related to glucose homeostasis (FPG and HbA1c). Nevertheless, the association between ucOC and WC, HDL-C, and cardiovascular risk scores remained significant (Table 2).
Table 2.
Log ucOC Total sample | Log ucOC MetS -T2D | |||
---|---|---|---|---|
r | p | r | p | |
WC | −0.163 | 0.014 | −0.169 | 0.026 |
HDL cholesterol | 0.281 | <0.001 | 0.295 | <0.001 |
FPG | −0.186 | 0.005 | −0.060 | 0.426 |
Total cholesterol | 0.143 | 0.032 | 0.092 | 0.226 |
HbA1c | −0.153 | 0.040 | 0.035 | 0.676 |
CV-ZS | −0.225 | 0.001 | −0.189 | 0.012 |
Framingham | −0.308 | <0.001 | −0.191 | 0.022 |
REGICOR | −0.192 | 0.004 | −0.199 | 0.008 |
ucOC: undercarboxylated osteocalcin; WC: waist circumference; FPG: fasting plasma glucose; CV-ZS: cardiovascular risk score. Significance was set at p < 0.05.
Relationship between serum levels of ucOC and cardiovascular risk
To determine the independent effect of circulating ucOC levels on cardiovascular risk expressed as CV-ZS (dependent variable), a multiple backward model of linear regression analysis was performed adjusting for the effect of cardiovascular risk-associated variables (age, sex, smoking status and sedentarism) and medication (hypolipidaemic, antidiabetic and antihypertensive drugs). These results showed that the only variables associated with CV-ZS were ucOC levels (B = −1.317, [−2.417/−0.217], p = 0.019) and hypolipidaemic drugs (B = −0.891, [−1.613/−0.169], p = 0.016), regardless of the effect of the other variables in MetS patients without T2D.
Evaluation of cardiovascular risk factors according to the 25th and 50th percentiles of ucOC serum levels
In order to establish the serum level of ucOC that determines significant differences in the metabolic profile and cardiovascular risk of the study population, MetS patients with and without T2D were divided into subgroups based on the percentiles of the ucOC levels. A comparative sex-adjustment study was performed according to the 25th and the 50th percentiles. Although statistically significant differences were found in some risk factors when study groups were divided according to the 50th percentile, the largest differences were found when the 25th percentile was considered in the whole sample. Therefore, MetS patients below 25th percentile of ucOC serum levels showed a significantly worse cardiometabolic profile and higher cardiovascular risk in terms of cardiovascular risk scores (CV-ZS, Framingham and REGICOR).
This trend of worse cardiometabolic profile associated with lower levels of ucOC was maintained in MetS patients without prevalent T2D. However, significant differences were found only between ucOC and HDL-C. In a similar way that with the entire population, patients below the 25th percentile of ucOC serum levels had significantly higher cardiovascular risk in terms of CV-ZS and REGICOR scores (Table 3).
Table 3.
Total sample | P25 of ucOC levels | P50 of ucOC levels | ||||||||
---|---|---|---|---|---|---|---|---|---|---|
<2.53 ng/mL (n = 57) | ≥2.53 ng/mL (n = 170) | p | <4.58 ng/mL (n = 114) | ≥4.58 ng/mL (n = 113) | p | |||||
mean | SD | mean | SD | mean | SD | mean | SD | |||
BMI | 32.73 | 3.37 | 32.41 | 3.61 | 0.535 | 32.58 | 3.23 | 32.41 | 3.85 | 0.701 |
WC | 109.78 | 9.80 | 106.88 | 10.27 | 0.260 | 108.77 | 10.01 | 106.44 | 10.31 | 0.353 |
mean BP | 103.74 | 12.16 | 103.17 | 11.15 | 0.819 | 103.25 | 11.26 | 103.38 | 11.56 | 0.488 |
HDL cholesterol | 45.35 | 7.79 | 50.76 | 10.28 | 0.002 | 47.31 | 9.13 | 51.52 | 10.39 | 0.009 |
FPG | 111.63 | 34.29 | 99.05 | 20.86 | 0.001 | 106.11 | 28.16 | 98.27 | 21.76 | 0.013 |
TG | 192.19 | 98.63 | 162.47 | 63.88 | 0.008 | 178.17 | 82.87 | 161.63 | 65.51 | 0.090 |
HbA1c | 6.33 | 0.99 | 5.84 | 1.08 | 0.006 | 6.09 | 0.94 | 5.86 | 1.19 | 0.126 |
CV-ZS | 1.06 | 3.38 | −0.40 | 2.41 | 0.000 | 0.42 | 2.95 | −0.49 | 2.47 | 0.011 |
Framingham | 17.56 | 8.29 | 13.19 | 6.75 | 0.001 | 15.66 | 8.01 | 12.84 | 6.41 | 0.015 |
REGICOR | 7.11 | 4.01 | 5.95 | 2.74 | 0.055 | 6.67 | 3.55 | 5.80 | 2.61 | 0.133 |
MetS – T2D group | P25 of ucOC levels | P50 of ucOC levels | ||||||||
<3.00 ng/mL (n = 44) | ≥3.00 ng/mL (n = 131) | p | 4.91 ng/mL (n = 88) | ≤4.91 ng/mL (n = 87) | p | |||||
mean | SD | mean | SD | mean | SD | mean | SD | |||
BMI | 32.75 | 3.16 | 32.37 | 3.73 | 0.743 | 32.57 | 3.32 | 32.40 | 3.82 | 0.697 |
WC | 109.79 | 9.81 | 106.51 | 10.26 | 0.277 | 108.50 | 9.75 | 106.49 | 10.70 | 0.959 |
mean BP | 104.64 | 11.53 | 102.64 | 11.29 | 0.421 | 103.46 | 11.49 | 103.12 | 11.32 | 0.789 |
HDL cholesterol | 45.92 | 7.86 | 51.16 | 10.49 | 0.006 | 47.73 | 9.24 | 51.53 | 10.52 | 0.038 |
FPG | 109.54 | 31.18 | 98.52 | 21.14 | 0.509 | 105.29 | 27.02 | 98.29 | 22.79 | 0.167 |
TG | 184.22 | 93.15 | 162.74 | 63.14 | 0.196 | 176.57 | 80.90 | 161.50 | 66.27 | 0.162 |
HbA1c | 6.19 | 0.97 | 5.86 | 1.12 | 0.438 | 6.04 | 0.90 | 5.89 | 1.26 | 0.373 |
CV-ZS | 0.96 | 3.15 | −0.53 | 2.39 | 0.010 | 0.31 | 2.91 | −0.47 | 2.49 | 0.097 |
Framingham | 16.57 | 8.15 | 13.17 | 6.75 | 0.726 | 15.50 | 7.82 | 12.71 | 6.50 | 0.481 |
REGICOR | 7.03 | 3.82 | 5.85 | 2.67 | 0.029 | 6.54 | 3.44 | 5.86 | 2.68 | 0.353 |
BMI: body mass index; WC: waist circumference; FPG: fasting plasma glucose; TG: triglyceride; ucOC: undercarboxylated osteocalcin; CV-ZS: cardiovascular risk score. Data for continuous variables are expressed as mean ± standard deviation (SD). Univariate analysis of variance using a general linear factorial model adjusted by sex was used for comparisons between quantitative variables. Significance was set at p < 0.05.
Usefulness of ucOC serum levels to estimate the T2D risk in MetS patients
A logistic regression model was performed to assess the variables related to T2D risk in MetS patients. The independent variables included in the multiple logistic regression model were those anthropometric and biochemical variables biologically linked to T2D development (age, sex, sedentarism, HDL-C and LDL cholesterol, TG levels, FPG and WC), in addition to ucOC levels categorised by the 25th percentile cut-off point of the total sample (2.53 ng/mL). We found that the serum levels of ucOC were an independent estimator of T2D risk in patients with MetS (OR = 6.39, [2.51/16.27], p < 0.001) in addition to FPG levels (OR = 1.08, [1.05/1.10], p < 0.001).
A receiver operating curve (ROC) analysis was performed to assess the usefulness of serum levels of ucOC as a marker of T2D risk. Three different models were assessed. The first model included the main T2D risk factors (age, sex, WC, FPG, TG levels, HDL-C and LDL cholesterol) (Area under the curve (AUC) = 0.848; p < 0.001). The second model included only the logarithm of serum levels of ucOC (AUC = 0.727; p < 0.001). Finally, the model that combined serum levels of ucOC and T2D risk factors showed the highest AUC value (AUC = 0.894; p < 0.001) (Fig. 3).
Discussion
Our results show that ucOC serum levels are independently associated with cardiovascular risk determined as Z-score in MetS patients without prevalent T2D. We found that lower circulating levels of ucOC are related to worse metabolic profile and higher cardiovascular risk in MetS patients regardless of the presence of T2D. Furthermore, we found a relationship between serum levels of ucOC, sex, FPG and lipid profile in the whole population and with WC and HDL-C cholesterol in patients with MetS without T2D. Finally, serum levels of ucOC may act as an independent estimator of T2D risk in MetS patients.
The involvement of total OC and ucOC levels on energy metabolism and their close association with glucose and lipid metabolism has been largely studied21. Several studies described the inverse association between circulating OC and the presence of T2D16,22,23, insulin resistance24,25, and measures of adiposity26. Most of the studies in MetS patients outlined the decrease in total OC levels in MetS patients compared to healthy subjects18,27–29. Nevertheless, other authors found no differences in total OC levels in postmenopausal women diagnosed with MetS compared to those without MetS23. Regarding ucOC levels, few data are available in patients with MetS.
Our findings showed lower ucOC serum levels in MetS patients at higher cardiovascular risk, regardless of the presence of T2D. Among patients with MetS, those with prevalent T2D showed worse cardiometabolic profile and lower serum levels of ucOC. This finding is supported by validated cardiovascular risk scores, such as Framingham and REGICOR scores for the Spanish population, showing that patients above 50th percentile of cardiovascular risk scores had lower ucOC levels and more unfavourable biochemical and anthropometric profiles. In consistency with our results, recent studies have reported lower serum levels of ucOC in T2D patients than in healthy subjects30 and lower in T2D patients with MetS than in those without MetS31.
MetS diagnosis implies an increase in cardiovascular risk32. However, a high variability of cardiovascular risk is found among these patients. Thus, within the MetS population, some patients are metabolically “healthier” than those with more unfavourable analytical and anthropometric values who would have worse prognosis. This fact makes difficult to categorise the cardiovascular risk in MetS patients. Despite tools to estimate cardiovascular risk, such as Framingham or REGICOR scores, are available, both of them present some limitations, such as the non-inclusion of important risk parameters, such as WC, the variability of parameters included depending on the calculator used, the loss of cases due to the lack of qualifying options, or the subjectivity of patients, among others. Therefore, these tools have been used primarily for epidemiological studies. In this way, it would be very useful to have a tool based on the diagnostic criteria of MetS reflecting the “metabolic” cardiovascular risk regardless of the risk due to environmental factors, such as lifestyle and the current medication (“acquired” cardiovascular risk).
In this regard, we calculated a CV-ZS to homogenise and to stratify the cardiovascular risk in this population considering the risk factors for MetS diagnostic accepted by the US National Cholesterol Education Program Adult Treatment Panel III (NCEP ATP III)33. This score shows a close correlation with validated cardiovascular risk scores, such as Framingham and REGICOR.
The relationship between total OC levels and cardiovascular parameters has been previously explored showing an association between lower serum levels of OC and atherosclerotic parameters in patients with T2D8,34 and myocardial infarction in young patients35, as well as a lower mortality rate associated with increased total OC levels36.
In the MetS population, some studies associate lower levels of total OC with cardiovascular risk parameters30,37,38 and with abdominal aortic calcification in men39.
Although some studies have linked ucOC levels to the risk of MetS through its relationship with individual cardiovascular risk factors18,40–42; to date, no studies evaluating the role of circulating ucOC as estimator of generalised cardiovascular risk in MetS patients are available. Our results show that ucOC serum levels could be an important estimator affecting cardiovascular risk expressed as CV-ZS, after adjusting by lifestyle and medication-related variables, only in those MetS patients who do not meet T2D criteria. This result could be explained because the presence of diabetes is one of the major determinants of cardiovascular risk rather than OC levels. In consistency with our results, some studies have shown that a higher ratio of circulating ucOC/OC was independently associated with lower incidence of myocardial infarction in older men43. Contrary to our results, a cross-sectional study including 162 Korean subjects showed a relationship between higher serum levels of ucOC and coronary artery calcification44. These differences could be due to the fact that their study population included also diabetic patients, but no adjustment for the presence of diabetes or any type of medication was performed.
The association between ucOC levels and cardiovascular risk could be explained, in part, by its relationship with some cardiovascular factors, such as WC, HDL-C, total cholesterol, FPG and HbA1c. In MetS patients without T2D, HDL-C was the main variable associated with serum ucOC levels. These relationships have been previously reported in other studies16,30,31. One of these studies suggested that higher levels of HDL-C could influence a higher OC production16. According to this, higher levels of ucOC found in MetS patients with lower CV-ZS could be related to higher levels of HDL-C.
Our results showed an association between serum levels of ucOC and sex, being these levels higher in women than men, in consistency with the previously reported45. However, the cause of this sex-based difference has not been explored yet. We suggest that higher ucOC levels found in women could be explained by the increase in bone resorption leading to bone loss during menopause. Bone degradation could increase serum levels of ucOC. An alternative hypothesis that we suggest states that increased levels of ucOC may act as a compensatory mechanism to restore bone homeostasis in postmenopausal women.
In contrast with the studies reporting an association between OC and ucOC levels and age46,47, we found no association in our study population, neither for men nor for women. Accordingly, De Pergola et al., also found no association between serum levels of OC and age neither in obese nor in T2D patients16. The lack of association between ucOC levels and age could be due to the restricted inclusion criteria on age, since our study population aged 55–75 years.
Based on the inverse and independent association between serum ucOC levels and CV-ZS found in our study, we determined that MetS patients with serum ucOC values below 2.53 ng/mL would have a worse metabolic profile than those with levels above this cut-off point. This trend was maintained for the group of MetS patients without prevalent T2D, but significant differences were found only for HDL-C levels. As expected, all patients below this cut-off point had significantly higher cardiovascular risk in terms of CV-ZS and REGICOR related to lower ucOC levels, regardless of diabetes.
We suggest that the measurement of ucOC serum levels could be useful for the estimation of cardiovascular risk in MetS patients. Accordingly, Alfadda A. et al.31 suggested that ucOC levels could play a role in the evaluation of the cardiovascular risk in patients with T2D due to the multiple associations found between ucOC levels and individual cardiovascular risk factors. However, this is the first study that determines an unified Z-score including the main cardiovascular risk factors to classify MetS patients according to their “metabolic” cardiovascular risk.
Additionally, MetS patients have a larger risk of developing T2D associated with their metabolic profile. The association between ucOC levels and glucose homeostasis is consistent and there is a large evidence reporting the role of ucOC as a regulator of glucose and energy metabolism48,49. Higher levels of this protein have been related to an improvement in insulin sensitivity and secretion due to the direct action of ucOC on adipocytes and β-cell mass50. As above mentioned, within a population of MetS patients, there are patients at higher risk than others to become diabetic patients depending on their metabolic profile. Considering ucOC levels as an independent variable in conjunction with biological variables related to T2D development, we found that the risk of T2D development in MetS patients with ucOC serum levels below 2.53 ng/mL was 6-fold higher than in those with serum levels of ucOC above this value. Our ROC curve analysis revealed that the inclusion of ucOC serum levels in addition to age and T2D-related variables, improves the prediction model for T2D risk in MetS patients. Similarly, to our results, Villafan-Bernal et al. used the ucOC/OC index to predict the probability of having T2D in a cohort of T2D patients and healthy subjects. Patients with ucOC/OC index below 0.31 had 12.6-fold increased probability of developing T2D than patients with higher index51. These findings strengthen our above-mentioned results, suggesting that serum levels of ucOC could be a potential biomarker to estimate cardiovascular and T2D risk in MetS patients. In addition, based on the aforementioned evidences, in the future, ucOC might become a therapeutic target to prevent cardiovascular events as reported by recent studies conducted in animal models52,53.
Our study has certain limitations. First, the cross-sectional design precludes any determination of causality in our findings. Second, we did not measure total OC, N-MID OC or other factors that could affect serum levels of ucOC, such as vitamins D and K, which would add valuable information to our results. Third, the collection of sedentary lifestyle data was recorded using a self-administered questionnaire, which implies the possibility of bias. Finally, since our study was conducted in a specific population of MetS patients, we cannot ascertain that the same results would be found in other ethnic or study groups.
The strengths of this study lie on the novel evaluation of cardiovascular risk in MetS patients using a global and unified score of accepted MetS risk factors, allowing thus a better characterisation of the cardiovascular risk in this heterogeneous population. In addition, we have considered potential confounders, such as the presence of T2D and the most commonly used medication in MetS patients.
To our knowledge, this is the first study showing a robust relationship between serum levels of ucOC and cardiovascular risk score. Moreover, the large sample size provides sufficient statistical power giving robustness to our results.
In summary, we suggest that circulating ucOC levels could be an estimator of the cardiovascular risk in MetS patients without T2D. In addition, lower serum levels of ucOC could contribute to T2D development. The measurement of circulating ucOC levels could become a strategy to identify MetS patients at high risk in order to establish preventive and therapeutic approaches. These findings break new ground for new research lines to evaluate the role of ucOC as a biomarker and as a potential therapeutic target, as well as the usefulness of CV-ZS in clinical practice in future longitudinal studies.
Methods
Study population
A cross-sectional study was conducted in 235 patients with MetS, aged 55–75 years (53.2% women). All patients included were overweight or obese (BMI ≥ 27 kg/m²) and met at least three diagnostic criteria for MetS: high BP, impaired FPG level, high TG level, low HDL-C level and increased WC according to the definitions of the NCEP ATP III33. A total of 21.8% of the study patients had prevalent T2D, diagnosed according to the American Diabetes Association criteria.
From December 2014 to December 2016, patients were consecutively recruited at primary healthcare centres in Granada (Spain). All patients were Caucasian outpatients, and they did not present any prevalent cardiovascular disease, cancer, morbid obesity (≥40 kg/m²), and/or presence of bone diseases that could interfere with the study protocol. None of them had been treated with calcium or vitamin D supplements, hormone therapy, anti-osteoporotic drugs, steroids, vitamin K antagonists, thiazolidinediones, glucocorticoids or other medications that might affect bone metabolism.
The study was conducted with the approval of the ethics committee of the San Cecilio University Hospital of Granada and conformed to the principles of the World Medical Association’s Declaration of Helsinki. Written informed consent was obtained from all patients.
Clinical and anthropometric evaluation
Anthropometric data were collected according to standard procedures. The BMI was calculated using the Quetelet formula (weight in kilograms divided by the square of height in meters); WC was measured midway between the superior border of the iliac crest and the lowest rib. Systolic BP (SBP) and diastolic BP (DBP) were obtained using a standard mercury sphygmomanometer (12 cm long and 35 cm wide). The mean BP was calculated using the equation (2 x DBP + SBP)/3)54.
Patients reported smoking status and level of physical activity by using a specific health questionnaire. Smoking status was categorised as non-smoker or current smoker. Physical activity was recorded using a specific questionnaire in which study patients reported how many hours used to spend on each activity throughout the day. Based on the results, the study sample was divided into two groups: sedentary (more than 7 hours sitting per day) and non-sedentary (less than 7 hours sitting per day).
Biochemical measurements
Blood samples were collected after an overnight fast. Conventional analyses of lipid profile (total cholesterol, HDL-C, LDL-cholesterol and TG level), FPG and glycated haemoglobin (HbA1c) were determined at the Clinical Analysis Unit of San Cecilio University Hospital of Granada. The levels of ucOC were measured by enzyme-linked immunosorbent assay (ELISA) according to the manufacturer’s instructions (Takara Bio, Japan). All measurements were determined in duplicate at our laboratory. Precision testing was performed by the determination of intra-assay and inter-assay variations (6% and 10%, respectively), which were consistent with those reported by the manufacturer (5.21% and 8.33%, respectively).
Calculation of cardiovascular risk scores
A Z-score of the combined cardiovascular risk factors used for the diagnosis of MetS (CV-ZS) was calculated including WC, mean BP, HDL-C, TG levels, and FPG according to the NCEP ATP III. The Z-score of each cardiovascular risk factor was calculated using the mean and standard deviation (SD) by applying the equation (x – mean (x))/SD), being x the variable of interest. The mean-centring and SD normalisation were sex-specific for each variable. The CV-ZS was the average of the Z-scores of TG levels, FPG, WC, mean BP and the inverse Z-score of HDL-C55,56.
In order to correlate the CV-ZS with other validated cardiovascular risk scores, the Framingham and REGICOR (for Spanish population) scores were estimated according to the equation described by Wilson P.W. et al.57 and through the online calculator available at www.imim.cat/ofertadeserveis/software-public/regicor/?158, respectively. Both scores include age, sex-adjusted cardiovascular risk variables (total cholesterol, HDL-C and SBP and DBP), and presence of diabetes and tobacco consumption (both variables collected using a questionnaire).
Statistical analysis
Analyses were performed using SPSS version 22.0 software (SPSS, Inc., Chicago, IL). Continuous variables were expressed as mean ± SD, and categorical variables were expressed as percentages. Kolmogorov-Smirnov test was used to test the normality of the variables. A log transformation was performed for skewed variables. Comparisons of continuous variables among groups were performed using the unpaired Student’s t test. When the comparison between groups required an adjustment by covariates, a univariate analysis of variance using a general linear factorial model was constructed. The χ2 test was used to compare categorical variables between groups.
Associations between continuous variables were described by the Pearson’s correlation coefficient. Multiple linear regression analysis was performed to identify the variables influencing cardiovascular risk (dependent variable). The independent variables used were those potentially related to cardiovascular risk, such as age, sex, smoking status, sedentarism and related medication (hypolipidaemic, antidiabetic and antihypertensive drugs).
In order to identify ucOC as an independent predictor of T2D, a multiple logistic regression model was performed. The usefulness of serum ucOC levels as a marker of T2D risk was analysed using a ROC curve. The AUC indicates the probability to predict an event. AUC values above 0.75 indicate a good predictive performance59.
Statistical significance was set at p < 0.05 (two tailed) and p < 0.10 for multiple linear regression analysis.
Acknowledgements
We acknowledge Nutraceutical Translations for English language editing of this manuscript. This work was supported by Junta de Andalucía grant (PI-0207-2016, 2016) and Instituto de Salud-Carlos III grants (PI18-00803, 2018; PI18-01235, 2018) co-funded by the European Regional Development Fund (FEDER).
Author contributions
Study design: A.B.-C., M.M.-T., B.G.-F., G.S.-D.; Study conduct: B.R.-G., L.G.-M., N.C.-I., B.G.-F., C.G.-F., E.G.-R., S.G.-S.; Data collection: B.R.-G., L.G.-M., N.C.-I., V.M.-R. Data analysis: B.G.-F., B.R.-G., G.S.-D., F.A.-V., V.M.-R.; Data interpretation: B.R.-G., B.G.-F., A.B.-C., M.M.-T., G.S.-D., F.A.-V.; Drafting of the manuscript: B.R.-G., B.G.-F., C.G.-F., S.G.-S., E.G.-R.; Reviewing the manuscript and approving final version of manuscript: All Authors.
Competing interests
The authors declare no competing interests.
Footnotes
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Contributor Information
Manuel Muñoz-Torres, Email: mmt@mamuto.es.
Beatriz García-Fontana, Email: bgfontana@fibao.es.
References
- 1.Ng M, et al. Global, regional, and national prevalence of overweight and obesity in children and adults during 1980–2013: a systematic analysis for the Global Burden of Disease Study 2013. Lancet. 2014;384:766–781. doi: 10.1016/S0140-6736(14)60460-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Gutiérrez-Fisac JL, et al. Prevalence of general and abdominal obesity in the adult population of Spain, 2008-2010: the ENRICA study. Obes. Rev. 2012;13:388–392. doi: 10.1111/j.1467-789X.2011.00964.x. [DOI] [PubMed] [Google Scholar]
- 3.Hernáez Álvaro, Zomeño M. Dolores, Dégano Irene R., Pérez-Fernández Silvia, Goday Alberto, Vila Joan, Civeira Fernando, Moure Ricardo, Marrugat Jaume. Excess Weight in Spain: Current Situation, Projections for 2030, and Estimated Direct Extra Cost for the Spanish Health System. Revista Española de Cardiología (English Edition) 2019;72(11):916–924. doi: 10.1016/j.rec.2018.10.010. [DOI] [PubMed] [Google Scholar]
- 4.Berrington de Gonzalez A, et al. Body-Mass Index and Mortality among 1.46 Million White Adults. N. Engl. J. Med. 2010;363:2211–2219. doi: 10.1056/NEJMoa1000367. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Gami AS, et al. Metabolic Syndrome and Risk of Incident Cardiovascular Events and Death. J. Am. Coll. Cardiol. 2007;49:403–414. doi: 10.1016/j.jacc.2006.09.032. [DOI] [PubMed] [Google Scholar]
- 6.Sambrook PN, et al. High bone turnover is an independent predictor of mortality in the frail elderly. J. Bone Miner. Res. 2006;21:549–55. doi: 10.1359/jbmr.060104. [DOI] [PubMed] [Google Scholar]
- 7.Van Der Klift M, et al. Bone mineral density and mortality in elderly men and women: the Rotterdam Study. Bone. 2002;30:643–8. doi: 10.1016/S8756-3282(02)00670-1. [DOI] [PubMed] [Google Scholar]
- 8.Reyes-Garcia R, et al. Relationship between serum levels of osteocalcin and atherosclerotic disease in type 2 diabetes. Diabetes Metab. 2012;38:76–81. doi: 10.1016/j.diabet.2011.07.008. [DOI] [PubMed] [Google Scholar]
- 9.Farhat GN, et al. The association of bone mineral density measures with incident cardiovascular disease in older adults. Osteoporos. Int. 2007;18:999–1008. doi: 10.1007/s00198-007-0338-8. [DOI] [PubMed] [Google Scholar]
- 10.Beamer B, Hettrich C, Lane J. Vascular Endothelial Growth Factor: An Essential Component of Angiogenesis and Fracture Healing. HSS J. 2010;6:85–94. doi: 10.1007/s11420-009-9129-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Carulli, C., Innocenti, M. & Brandi, M. L. Bone Vascularization in Normal and Disease Conditions. Front. Endocrinol. Lausanne., 4, (2013). [DOI] [PMC free article] [PubMed]
- 12.Seibel Markus J. Biochemical markers of bone remodeling. Endocrinology and Metabolism Clinics of North America. 2003;32(1):83–113. doi: 10.1016/S0889-8529(02)00077-4. [DOI] [PubMed] [Google Scholar]
- 13.Zoch ML, Clemens TL, Riddle RC. New insights into the biology of osteocalcin. Bone. 2016;82:42–49. doi: 10.1016/j.bone.2015.05.046. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Lee NK, et al. Endocrine Regulation of Energy Metabolism by the Skeleton. Cell. 2007;130:456–469. doi: 10.1016/j.cell.2007.05.047. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Kindblom JM, et al. Plasma osteocalcin is inversely related to fat mass and plasma glucose in elderly Swedish men. J. Bone Miner. Res. 2009;24:785–91. doi: 10.1359/jbmr.081234. [DOI] [PubMed] [Google Scholar]
- 16.De Pergola G, et al. Independent Relationship of Osteocalcin Circulating Levels with Obesity, Type 2 Diabetes, Hypertension, and HDL Cholesterol. Endocr. Metab. Immune Disord. Drug Targets. 2016;16:270–275. doi: 10.2174/1871530317666170106150756. [DOI] [PubMed] [Google Scholar]
- 17.Kanazawa I, et al. Serum Osteocalcin Level Is Associated with Glucose Metabolism and Atherosclerosis Parameters in Type 2 Diabetes Mellitus. J. Clin. Endocrinol. Metab. 2009;94:45–49. doi: 10.1210/jc.2008-1455. [DOI] [PubMed] [Google Scholar]
- 18.Garcia-Martin A, et al. Osteocalcin as a marker of metabolic risk in healthy postmenopausal women. Menopause. 2011;18:537–541. doi: 10.1097/gme.0b013e3181f8565e. [DOI] [PubMed] [Google Scholar]
- 19.Hwang Y-C, Jeong I-K, Ahn KJ, Chung HY. The uncarboxylated form of osteocalcin is associated with improved glucose tolerance and enhanced beta-cell function in middle-aged male subjects. Diabetes. Metab. Res. Rev. 2009;25:768–772. doi: 10.1002/dmrr.1045. [DOI] [PubMed] [Google Scholar]
- 20.Bullo M, Moreno-Navarrete JM, Fernandez-Real JM, Salas-Salvado J. Total and undercarboxylated osteocalcin predict changes in insulin sensitivity and beta cell function in elderly men at high cardiovascular risk. Am. J. Clin. Nutr. 2012;95:249–255. doi: 10.3945/ajcn.111.016642. [DOI] [PubMed] [Google Scholar]
- 21.Liu D-M, et al. Association between osteocalcin and glucose metabolism: a meta-analysis. Osteoporos. Int. 2015;26:2823–2833. doi: 10.1007/s00198-015-3197-8. [DOI] [PubMed] [Google Scholar]
- 22.Kanazawa I, et al. Serum undercarboxylated osteocalcin was inversely associated with plasma glucose level and fat mass in type 2 diabetes mellitus. Osteoporos. Int. 2011;22:187–194. doi: 10.1007/s00198-010-1184-7. [DOI] [PubMed] [Google Scholar]
- 23.Movahed A, et al. Reduced serum osteocalcin concentrations are associated with type 2 diabetes mellitus and the metabolic syndrome components in postmenopausal women: the crosstalk between bone and energy metabolism. J. Bone Miner. Metab. 2012;30:683–691. doi: 10.1007/s00774-012-0367-z. [DOI] [PubMed] [Google Scholar]
- 24.Kanazawa I, et al. Serum osteocalcin level is positively associated with insulin sensitivity and secretion in patients with type 2 diabetes. Bone. 2011;48:720–725. doi: 10.1016/j.bone.2010.12.020. [DOI] [PubMed] [Google Scholar]
- 25.Iki M, et al. Serum undercarboxylated osteocalcin levels are inversely associated with glycemic status and insulin resistance in an elderly Japanese male population: Fujiwara-kyo Osteoporosis Risk in Men (FORMEN) Study. Osteoporos. Int. 2012;23:761–770. doi: 10.1007/s00198-011-1600-7. [DOI] [PubMed] [Google Scholar]
- 26.Pittas AG, Harris SS, Eliades M, Stark P, Dawson-Hughes B. Association between serum osteocalcin and markers of metabolic phenotype. J. Clin. Endocrinol. Metab. 2009;94:827–832. doi: 10.1210/jc.2008-1422. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Bae SJ, et al. The association between serum osteocalcin levels and metabolic syndrome in Koreans. Osteoporos. Int. 2011;22:2837–2846. doi: 10.1007/s00198-010-1504-y. [DOI] [PubMed] [Google Scholar]
- 28.Saleem U, Mosley TH, Kullo IJ. Serum Osteocalcin Is Associated With Measures of Insulin Resistance, Adipokine Levels, and the Presence of Metabolic Syndrome. Arterioscler. Thromb. Vasc. Biol. 2010;30:1474–1478. doi: 10.1161/ATVBAHA.110.204859. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Lee SW, Jo HH, Kim MR, You YO, Kim JH. Association between obesity, metabolic risks and serum osteocalcin level in postmenopausal women. Gynecol. Endocrinol. 2012;28:472–477. doi: 10.3109/09513590.2011.633660. [DOI] [PubMed] [Google Scholar]
- 30.Sanchez-Enriquez S, et al. Serum levels of undercarboxylated osteocalcin are related to cardiovascular risk factors in patients with type 2 diabetes mellitus and healthy subjects. World J. Diabetes. 2017;8:11. doi: 10.4239/wjd.v8.i1.11. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Alfadda, A. A., Masood, A., Shaik, S. A., Dekhil, H. & Goran, M. Association between osteocalcin, metabolic syndrome, and cardiovascular risk factors: Role of total and undercarboxylated osteocalcin in patients with type 2 diabetes. Int. J. Endocrinol., 2013 (2013). [DOI] [PMC free article] [PubMed]
- 32.Martínez-Larrad MT, et al. Metabolic syndrome, glucose tolerance categories and the cardiovascular risk in Spanish population. Diabetes Res. Clin. Pract. 2016;114:23–31. doi: 10.1016/j.diabres.2016.02.003. [DOI] [PubMed] [Google Scholar]
- 33.Expert Panel on Detection, Evaluation, and Treatment of High Blood Cholesterol in Adults Executive Summary of The Third Report of The National Cholesterol Education Program (NCEP) Expert Panel on Detection, Evaluation, And Treatment of High Blood Cholesterol In Adults (Adult Treatment Panel III) JAMA. 2001;285:2486–97. doi: 10.1001/jama.285.19.2486. [DOI] [PubMed] [Google Scholar]
- 34.Ogawa-Furuya N, Yamaguchi T, Yamamoto M, Kanazawa I, Sugimoto T. Serum osteocalcin levels are inversely associated with abdominal aortic calcification in men with type 2 diabetes mellitus. Osteoporos. Int. 2013;24:2223–2230. doi: 10.1007/s00198-013-2289-6. [DOI] [PubMed] [Google Scholar]
- 35.Goliasch G, et al. Markers of bone metabolism in premature myocardial infarction (≤40years of age) Bone. 2011;48:622–626. doi: 10.1016/j.bone.2010.11.005. [DOI] [PubMed] [Google Scholar]
- 36.Yeap BB, et al. Associations of total osteocalcin with all-cause and cardiovascular mortality in older men. The Health In Men Study. Osteoporos. Int. 2012;23:599–606. doi: 10.1007/s00198-011-1586-1. [DOI] [PubMed] [Google Scholar]
- 37.Tan A, et al. Low serum osteocalcin level is a potential marker for metabolic syndrome: results from a Chinese male population survey. Metabolism. 2011;60:1186–1192. doi: 10.1016/j.metabol.2011.01.002. [DOI] [PubMed] [Google Scholar]
- 38.Yeap BB, et al. Reduced serum total osteocalcin is associated with metabolic syndrome in older men via waist circumference, hyperglycemia, and triglyceride levels. Eur. J. Endocrinol. 2010;163:265–272. doi: 10.1530/EJE-10-0414. [DOI] [PubMed] [Google Scholar]
- 39.Bao Y, et al. Serum levels of osteocalcin are inversely associated with the metabolic syndrome and the severity of coronary artery disease in Chinese men. Clin. Endocrinol. (Oxf). 2011;75:196–201. doi: 10.1111/j.1365-2265.2011.04065.x. [DOI] [PubMed] [Google Scholar]
- 40.Prats-Puig A, et al. Undercarboxylated osteocalcin relates to cardiovascular risk markers in offspring of families with metabolic syndrome. Atherosclerosis. 2014;233:272–277. doi: 10.1016/j.atherosclerosis.2014.01.002. [DOI] [PubMed] [Google Scholar]
- 41.Liu J-J, et al. Elevated undercarboxylated and reduced carboxylated osteocalcin are associated with metabolic syndrome in middle age Asian females. Exp. Clin. Endocrinol. Diabetes. 2013;121:329–333. doi: 10.1055/s-0033-1336723. [DOI] [PubMed] [Google Scholar]
- 42.Zanatta LCB, Boguszewski CL, Borba VZC, Moreira CA. Association between undercarboxylated osteocalcin, bone mineral density, and metabolic parameters in postmenopausal women. Arch. Endocrinol. Metab. 2018;62:446–451. doi: 10.20945/2359-3997000000061. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Yeap BB, et al. Proportion of Undercarboxylated Osteocalcin and Serum P1NP Predict Incidence of Myocardial Infarction in Older Men. J. Clin. Endocrinol. Metab. 2015;100:3934–3942. doi: 10.1210/jc.2015-1899. [DOI] [PubMed] [Google Scholar]
- 44.Choi B, et al. Coronary artery calcification is associated with high serum concentration of undercarboxylated osteocalcin in asymptomatic Korean men. Clin. Endocrinol. (Oxf). 2015;83:320–326. doi: 10.1111/cen.12792. [DOI] [PubMed] [Google Scholar]
- 45.Levinger I, et al. Multifaceted interaction of bone, muscle, lifestyle interventions and metabolic and cardiovascular disease: role of osteocalcin. Osteoporos. Int. 2017;28:2265–2273. doi: 10.1007/s00198-017-3994-3. [DOI] [PubMed] [Google Scholar]
- 46.Jung KY, et al. Age- and sex-specific association of circulating osteocalcin with dynamic measures of glucose homeostasis. Osteoporos. Int. 2016;27:1021–1029. doi: 10.1007/s00198-015-3315-7. [DOI] [PubMed] [Google Scholar]
- 47.Nimptsch K, et al. Determinants and correlates of serum undercarboxylated osteocalcin. Ann. Nutr. Metab. 2007;51:563–570. doi: 10.1159/000114211. [DOI] [PubMed] [Google Scholar]
- 48.Razzaque MS. Osteocalcin: a pivotal mediator or an innocent bystander in energy metabolism? Nephrol. Dial. Transplant. 2011;26:42–5. doi: 10.1093/ndt/gfq721. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Villafán-Bernal JR, Sánchez-Enríquez S, Muñoz-Valle JF. Molecular modulation of osteocalcin and its relevance in diabetes (Review) Int. J. Mol. Med. 2011;28:283–93. doi: 10.3892/ijmm.2011.706. [DOI] [PubMed] [Google Scholar]
- 50.Buday B, et al. The role of osteocalcin in the connection of bone and glucose metabolism in humans. Orv. Hetil. 2008;149:2453–2461. doi: 10.1556/OH.2008.28518. [DOI] [PubMed] [Google Scholar]
- 51.Villafán-Bernal JR, et al. A Cut-Point Value of Uncarboxylated to Carboxylated Index Is Associated With Glycemic Status Markers in Type 2 Diabetes. J. Investig. Med. 2014;62:33–36. doi: 10.2310/JIM.0000000000000015. [DOI] [PubMed] [Google Scholar]
- 52.Qaradakhi T, et al. The Effect of Recombinant Undercarboxylated Osteocalcin on Endothelial Dysfunction. Calcif. Tissue Int. 2019;105:546–556. doi: 10.1007/s00223-019-00600-6. [DOI] [PubMed] [Google Scholar]
- 53.Sadek Nermeen B., Gamal Sarah M., Aboulhoda Basma E., Rashed Laila A., Shawky Heba M., Gamal El-Din Maha M. The Potential Role of Undercarboxylated Osteocalcin Upregulation in Microvascular Insufficiency in a Rat Model of Diabetic Cardiomyopathy. Journal of Cardiovascular Pharmacology and Therapeutics. 2019;25(1):86–97. doi: 10.1177/1074248419876632. [DOI] [PubMed] [Google Scholar]
- 54.Benetos, A., Rudnichi, A., Safar, M. & Guize, L. Pulse Pressure and Cardiovascular Mortality in Normotensive and Hypertensive Subjects. http://ahajournals.org (1998). [DOI] [PubMed]
- 55.Grøntved A, et al. Muscle strength in youth and cardiovascular risk in young adulthood (the European Youth Heart Study) Br. J. Sports Med. 2015;49:90–4. doi: 10.1136/bjsports-2012-091907. [DOI] [PubMed] [Google Scholar]
- 56.Nyström CD, et al. Does Cardiorespiratory Fitness Attenuate the Adverse Effects of Severe/Morbid Obesity on Cardiometabolic Risk and Insulin Resistance in Children? A Pooled Analysis. Diabetes Care. 2017;40:1580–1587. doi: 10.2337/dc17-1334. [DOI] [PubMed] [Google Scholar]
- 57.Wilson PWF, et al. Prediction of Coronary Heart Disease Using Risk Factor Categories. Circulation. 1998;97:1837–1847. doi: 10.1161/01.CIR.97.18.1837. [DOI] [PubMed] [Google Scholar]
- 58.Buitrago F, et al. Original and REGICOR Framingham Functions in a Nondiabetic Population of a Spanish Health Care Center: A Validation Study. Ann. Fam. Med. 2011;9:431–438. doi: 10.1370/afm.1287. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.David Clayton, M. H. Statistical models in Epidemiology. (1993).