Skip to main content
. Author manuscript; available in PMC: 2020 Dec 3.
Published in final edited form as: Health Informatics J. 2019 Jan 23;26(1):8–20. doi: 10.1177/1460458218824692

Table 5.

Model performance statistics when using different rurality definitions.

Cancer Performance
statistics
Model B1 Model B2 Model B3 Model B4 Model C1
Breast AIC 34,396.10 34,403.29 34,404.73 34,41 1.01 34,410.68
c-Statistic 0.800 0.800 0.799 0.800 0.800
IDI −0.001 (−0.003 to −0.001) −0.002 (−0.003 to −0.001) −0.002 (−0.003 to −0.001) −0.002 (−0.003 to −0.001)
Relative IDI −0.005 (−0.009 to −0.002) −0.007 (−0.010 to −0.002) −0.008 (−0.012 to −0.002) −0.006 (−0.011 to −0.002)
Continuous NRI −0.07 (−0.12 to −0.03) −0.05 (−0.11 to −0.01) −0.05 (−0.10 to −0.01) −0.04 (−0.10 to −0.01)
Event NRI −0.23 (−0.27 to −0.20) −0.31 (−0.34 to −0.20) −0.04 (−0.33 to −0.01) −0.35 (−0.38 to −0.01)
Non-event NRI 0.16 (0.14 to 0.18) 0.26 (0.14 to 0.27) −0.01 (−0.03 to 0.27) 0.30 (−0.03 to 0.32)
Lung AIC 277,760.61 277,762.77 277,758.83 277,777.22 277,736.12
c-Statistic 0.734 0.734 0.734 0.734 0.734
IDI −0.000 (−0.000 to 0.000) −0.000 (−0.000 to 0.000) −0.000 (−0.000 to 0.000) 0.000 (−0.000 to 0.001)
Relative IDI −0.000 (−0.001 to 0.001) −0.000 (−0.001 to 0.001) −0.001 (−0.002 to 0.001) 0.001 (−0.001 to 0.002)
Continuous NRI 0.03 (−0.01 to 0.08) 0.05 (−0.00 to 0.08) −0.04 (−0.07 to 0.08) 0.03 (−0.07 to 0.08)
Event NRI −0.05 (−0.06 to −0.03) −0.02 (−0.06 to −0.00) −0.15 (−0.16 to −0.01) −0.37 (−0.38 to −0.01)
Non-event NRI 0.08 (0.05 to 0.12) 0.07 (0.03 to 0.1 1) 0.11 (0.03 to 0.14) 0.40 (0.03 to 0.42)
Colorectal AIC 51,526.19 51,527.41 51,526.81 51,528.13 51,508.62
c-Statistic 0.783 0.782 0.782 0.782 0.783
IDI −0.001 (−0.001 to −0.000) −0.001 (−0.001 to −0.002) −0.000 (−0.001 to 0.000) −0.000 (−0.001 to 0.001)
Relative IDI −0.002 (−0.004 to −0.001) −0.003 (−0.004 to −0.001) −0.001 (−0.004 to 0.000) −0.000 (−0.004 to 0.002)
Continuous NRI −0.04 (−0.09 to 0.01) −0.03 (−0.09 to 0.02) −0.01 (−0.08 to 0.03) −0.01 (−0.08 to 0.03)
Event NRI −0.27 (−0.3 1 to −0.23) −0.17 (−0.30 to −0.14) −0.04 (−0.30 to −0.02) 0.04 (−0.29 to 0.06)
Non-event NRI 0.23 (0.21 to 0.26) 0.15 (0.12 to 0.25) 0.03 (0.01 to 0.25) −0.04 (−0.06 to 0.25)

AIC: Akaike information criterion; IDI: integrated discrimination improvement; NRI: net reclassification improvement; FCDS: Florida Cancer Data System. Other predictors included all the individual-level factors from the FCDS. Sex was not included as a predictor in the breast models.

Note: Values in parentheses are lower and upper bounds of 95% confidence intervals.