Skip to main content
. 2021 Nov 13;29(1):109–119. doi: 10.1093/jamia/ocab248

Table 4.

Performance of the best model selected by cross-validation, an elastic net regression model using word2vec embeddings, stratified by race and sex

Frailty aspect Group Multiclass SBS (95% CI) Negative class SBS (95% CI) Neutral class SBS (95% CI) Positive class SBS (95% CI)
Respiratory impairment White 0.57 (0.56–0.59) 0.60 (0.59–0.62) 0.54 (0.52–0.56) 0.56 (0.53–0.59)
Nonwhite 0.54 (0.52–0.57) 0.57 (0.55–0.59) 0.51 (0.48–0.53) 0.54 (0.5–0.59)
Male 0.57 (0.55–0.59) 0.60 (0.57–0.62) 0.55 (0.52–0.57) 0.54 (0.5–0.58)
Female 0.56 (0.54–0.58) 0.59 (0.57–0.61) 0.51 (0.48–0.54) 0.56 (0.53–0.59)
Musculo-skeletal White 0.44 (0.41–0.47) 0.46 (0.43–0.5) 0.40 (0.36–0.45) 0.43 (0.39–0.47)
Problem Nonwhite 0.41 (0.38–0.44) 0.44 (0.41–0.47) 0.39 (0.35–0.43) 0.37 (0.32–0.43)
Male 0.38 (0.35–0.42) 0.41 (0.38–0.45) 0.33 (0.28–0.38) 0.41 (0.35–0.46)
Female 0.45 (0.42–0.48) 0.47 (0.45–0.5) 0.43 (0.39–0.46) 0.41 (0.37–0.45)
Fall risk White 0.53 (0.5–0.55) 0.55 (0.52–0.58) 0.32 (0.28–0.36) 0.61 (0.58–0.65)
Nonwhite 0.43 (0.39–0.47) 0.46 (0.42–0.5) 0.19 (0.12–0.27) 0.52 (0.48–0.57)
Male 0.50 (0.47–0.54) 0.53 (0.5–0.57) 0.26 (0.19–0.33) 0.60 (0.56–0.64)
Female 0.49 (0.46–0.51) 0.51 (0.48–0.53) 0.29 (0.24–0.33) 0.57 (0.54–0.6)
Nutritional deficiency White 0.64 (0.6–0.69) 0.67 (0.63–0.72) 0.14 (0.01–0.3) 0.7 (0.66–0.75)
Nonwhite 0.49 (0.42–0.57) 0.50 (0.43–0.59) 0.10 (−0.05 to 0.3) 0.59 (0.51–0.68)
Male 0.66 (0.6–0.72) 0.70 (0.65–0.75) 0.37 (0.25–0.5) 0.68 (0.61–0.75)
Female 0.55 (0.5–0.6) 0.57 (0.52–0.62) −0.03 (−0.17 to 0.14) 0.66 (0.61–0.72)

Note: Each scaled Brier score is the macro average across all 4 frailty aspects. The multiclass scaled Brier score is our primary performance metric. We also report the scaled Brier score for each class (positive, negative, or neutral) separately and evaluated as a binary outcome against the other 2 classes.

SBS: scaled Brier Score.