Skip to main content
. 2017 Aug 1;53(3):37–44.

TABLE 4. Comparison of goodness-of-fit and classification accuracy between models.

Performance metric Base model Model 1 Model 2 Model 3 Model 4 Model 5 Model 6
Goodness-of-fit, multinomial models
 –2 Log-likelihood 1842.98 1455.33 1762.55 1835.90 1711.69 1833.55 1429.88
 BIC 1998.64 1625.13 1932.33 2005.70 1881.49 2003.35 1656.28
Classification accuracy, multinomial models
PBCARa 0.50 0.50 0.50 0.50 0.50 0.50 0.50
Model classification accuracy 0.67 0.72 0.66 0.67 0.69 0.67 0.71
% improvement over PBCAR 34.0 44.0 32.0 34.0 38.0 34.0 42.0
Logistic regression comparing persistently high-cost with persistently low-cost (n = 873)
c statistic 0.74 0.87 0.80 0.75 0.85 0.76 0.88
Logistic regression comparing occasionally high-cost with persistently low-cost (n = 1082)
c statistic 0.68 0.82 0.73 0.69 0.74 0.68 0.83

Notes: Base model = age, sex, residence, Charlson comorbidity index; Model 1 = base model + no. of hospital admission in index episode; Model 2 = base model + no. of emergency department visits in index episode; Model 3 = base model + no. of family practitioner visits in index episode; Model 4 = base model + no. of specialist visits in index episode; Model 5 = base model + no. of drugs dispensed in index episode; Model 6 = base model + no. of all the above healthcare services in index episode. BIC, Bayesian information criterion; PBCAR, proportional-by-chance accuracy rate.

a

PBCAR = (100/1182)2 + (309/1182)2 + (773/1182)2 = 0.50.