Table 2.
Performance of models that predict clinician information seeking behavior. To reduce clutter the word “target” is not included in the names of the target variables. Domain: L = laboratory test, V = vital sign, M = medication, and S = ventilator setting. Results are reported as AUROC with 95% confidence intervals. For each target variable, the AUROC of the best performing model is bolded.
| Target variable | Domain | Selected/ available | Logistic regression median impute | Random forests median impute | Random forests regression impute |
|---|---|---|---|---|---|
| red blood cells | L | 24/165 | 0.68 (0.55, 0.80) | 0.94 (0.87, 0.99) | 0.94 (0.89, 0.98) |
| ventilator status | S | 20/131 | 0.54 (0.42, 0.67) | 0.72 (0.60, 0.83) | 0.83 (0.72, 0.92) |
| pH | L | 46/137 | 0.57 (0.49, 0.66) | 0.77 (0.70, 0.84) | 0.71 (0.64, 0.79) |
| bicarbonate (blood gases) | L | 11/108 | 0.63 (0.49, 0.77) | 0.75 (0.62, 0.86) | 0.61 (0.47, 0.73) |
| oxygen saturation | V | 103/177 | 0.64 (0.57, 0.71) | 0.74 (0.68, 0.80) | 0.61 (0.53, 0.68) |
| anion gap | L | 19/118 | 0.45 (0.34, 0.58) | 0.69 (0.58, 0.80) | 0.74 (0.63, 0.84) |
| prothrombin time | L | 21/125 | 0.64 (0.52, 0.76) | 0.73 (0.60, 0.86) | 0.73 (0.61, 0.84) |
| bilirubin total | L | 39/110 | 0.62 (0.53, 0.70) | 0.73 (0.64, 0.81) | 0.73 (0.64, 0.81) |
| chloride | L | 106/178 | 0.63 (0.56, 0.71) | 0.71 (0.64, 0.78) | 0.67 (0.60, 0.74) |
| lactate | L | 50/117 | 0.70 (0.61, 0.78) | 0.71 (0.63, 0.79) | 0.71 (0.63, 0.79) |
| glucose | L | 114/175 | 0.71 (0.64, 0.78) | 0.64 (0.57, 0.72) | 0.67 (0.59, 0.74) |
| potassium chloride | M | 28/136 | 0.52 (0.41, 0.63) | 0.71 (0.62, 0.79) | 0.56 (0.46, 0.66) |
| heparin | M | 41/102 | 0.71 (0.62, 0.80) | 0.58 (0.48, 0.67) | 0.50 (0.40, 0.60) |
| alkaline phosphatase | L | 16/109 | 0.53 (0.39, 0.67) | 0.71 (0.61, 0.79) | 0.57 (0.44, 0.70) |
| fraction of inspired O2 | S | 99/151 | 0.50 (0.41, 0.59) | 0.69 (0.62, 0.77) | 0.68 (0.61, 0.75) |
| central venous pressure | V | 31/111 | 0.62 (0.52, 0.72) | 0.68 (0.58, 0.77) | 0.69 (0.59, 0.78) |
| magnesium | L | 74/173 | 0.58 (0.51, 0.65) | 0.69 (0.62, 0.75) | 0.62 (0.55, 0.69) |
| blood urea nitrogen | L | 114/177 | 0.62 (0.54, 0.70) | 0.68 (0.60, 0.75) | 0.60 (0.53, 0.68) |
| respiratory rate | V | 121/178 | 0.58 (0.51, 0.66) | 0.56 (0.48, 0.64) | 0.68 (0.61, 0.75) |
| calcium | L | 41/163 | 0.65 (0.57, 0.73) | 0.68 (0.59, 0.76) | 0.67 (0.59, 0.75) |
| partial thromboplastin time | L | 21/108 | 0.68 (0.55, 0.79) | 0.64 (0.52, 0.77) | 0.64 (0.55, 0.73) |
| hematocrit | L | 11/166 | 0.61 (0.35, 0.85) | 0.59 (0.40, 0.76) | 0.68 (0.46, 0.88) |
| neutrophils | L | 31/156 | 0.49 (0.38, 0.59) | 0.67 (0.57, 0.78) | 0.65 (0.56, 0.74) |
| partial pressure of CO2 | L | 31/138 | 0.65 (0.55, 0.74) | 0.67 (0.58, 0.75) | 0.62 (0.53, 0.72) |
| temperature | V | 144/178 | 0.51 (0.42, 0.61) | 0.61 (0.52, 0.71) | 0.67 (0.58, 0.75) |
| ventilator mode | S | 72/148 | 0.66 (0.59, 0.74) | 0.67 (0.59, 0.74) | 0.66 (0.59, 0.73) |
| intake and output | V | 81/178 | 0.64 (0.57, 0.71) | 0.66 (0.59, 0.73) | 0.55 (0.47, 0.62) |
| blood pressure | V | 151/178 | 0.47 (0.36, 0.58) | 0.65 (0.56, 0.74) | 0.53 (0.43, 0.63) |
| INR | L | 74/125 | 0.65 (0.57, 0.73) | 0.59 (0.51, 0.67) | 0.63 (0.54, 0.71) |
| creatinine | L | 132/177 | 0.62 (0.55, 0.71) | 0.64 (0.56, 0.72) | 0.65 (0.57, 0.73) |
| aspartate aminotransferase | L | 28/113 | 0.65 (0.54, 0.75) | 0.64 (0.55, 0.74) | 0.52 (0.41, 0.63) |
| alanine aminotransferase | L | 26/111 | 0.57 (0.46, 0.68) | 0.65 (0.56, 0.74) | 0.50 (0.40, 0.60) |
| platelets | L | 125/166 | 0.65 (0.57, 0.73) | 0.58 (0.50, 0.66) | 0.56 (0.48, 0.64) |
| phosphate | L | 69/170 | 0.53 (0.45, 0.61) | 0.65 (0.58, 0.72) | 0.56 (0.48, 0.63) |
| potassium | L | 121/178 | 0.64 (0.57, 0.71) | 0.43 (0.36, 0.50) | 0.56 (0.48, 0.65) |
| white blood cells | L | 141/166 | 0.60 (0.50, 0.69) | 0.63 (0.55, 0.72) | 0.64 (0.57, 0.72) |
| sodium | L | 128/178 | 0.47 (0.39, 0.55) | 0.64 (0.56, 0.72) | 0.58 (0.50, 0.66) |
| bicarbonate (chemistry) | L | 104/178 | 0.58 (0.51, 0.65) | 0.64 (0.57, 0.71) | 0.62 (0.54, 0.69) |
| albumin | L | 21/114 | 0.56 (0.44, 0.68) | 0.56 (0.45, 0.67) | 0.64 (0.53, 0.76) |
| partial pressure of O2 | L | 30/137 | 0.62 (0.52, 0.71) | 0.64 (0.54, 0.74) | 0.64 (0.55, 0.72) |
| hemoglobin | L | 130/166 | 0.63 (0.55, 0.72) | 0.59 (0.51, 0.67) | 0.59 (0.51, 0.67) |
| heart rate | V | 152/178 | 0.48 (0.39, 0.57) | 0.62 (0.52, 0.73) | 0.48 (0.38, 0.58) |
| ionized calcium | L | 30/132 | 0.62 (0.52, 0.71) | 0.59 (0.50, 0.68) | 0.55 (0.45, 0.65) |
| glomerular filtration rate | L | 19/166 | 0.47 (0.36, 0.58) | 0.61 (0.50, 0.72) | 0.60 (0.48, 0.72) |
| ventilator tube status | S | 45/130 | 0.45 (0.36, 0.55) | 0.60 (0.50, 0.69) | 0.44 (0.35, 0.52) |
| sodium chloride 0.9% | M | 69/154 | 0.56 (0.49, 0.63) | 0.49 (0.42, 0.57) | 0.48 (0.40, 0.56) |
| Average | 0.59 | 0.65 | 0.62 | ||
| Average of best (bolded AUROCs) | 0.68 | ||||