Skip to main content
. Author manuscript; available in PMC: 2015 Sep 14.
Published in final edited form as: J Stat Comput Simul. 2014 Nov 25;85(17):3498–3511. doi: 10.1080/00949655.2014.983111

Table 2.

Performance of AUC estimation using MI methods as well as case deletion under MAR, MCAR and MNAR.

% miss. Case deletion Joint imputation Sequential imputation Re-sampling (bootstrap)





MM TV CD(SE) Y* Y CR AW RMSE AUC(SE) CR AW RMSE AUC(SE) CR AW RMSE AUC(SE) CR AW RMSE
Scenario 13:{n = 300 πY* = 0.25 σY = 20}
MAR 0.64 0.62 (0.04) 0.30 0.82 0.12 0.04 0.65 (0.05) 0.93 0.20 0.04 0.64 (0.06) 0.88 0.25 0.06 0.63 (0.06) 0.96 0.23 0.04
MCAR 0.64 0.64 (0.05) 0.30 0.30 0.75 0.12 0.04 0.64 (0.05) 0.91 0.21 0.04 0.64 (0.06) 0.95 0.25 0.04 0.64 (0.06) 0.97 0.24 0.04
MNAR 0.64 0.60 (0.05) 0.36 0.30 0.75 0.15 0.06 0.65 (0.05) 0.84 0.22 0.07 0.64 (0.10) 0.98 0.50 0.06 0.62 (0.07) 0.94 0.31 0.06
Scenario 14:{n = 300 πY* = 0.25 σY = 20}
MAR 0.76 0.71 (0.04) 0.42 0.24 0.07 0.06 0.77 (0.04) 0.93 0.17 0.03 0.75 (0.05) 0.81 0.22 0.07 0.75 (0.05) 0.96 0.23 0.04
MCAR 0.76 0.76 (0.04) 0.30 0.30 0.41 0.05 0.03 0.75 (0.05) 0.93 0.19 0.03 0.76 (0.05) 0.96 0.21 0.04 0.76 (0.05) 0.96 0.22 0.03
MNAR 0.76 0.72 (0.04) 0.22 0.30 0.28 0.07 0.05 0.75 (0.05) 0.91 0.18 0.04 0.71 (0.09) 0.97 0.44 0.08 0.75 (0.05) 0.95 0.22 0.04
Scenario 15:{n = 300 πY* = 0.50 σY = 20}
MAR 0.75 0.71 (0.04) 0.35 0.25 0.07 0.05 0.78 (0.03) 0.84 0.13 0.04 0.74 (0.04) 0.80 0.18 0.06 0.75 (0.04) 0.96 0.18 0.03
MCAR 0.75 0.76 (0.04) 0.30 0.30 0.44 0.05 0.03 0.76 (0.04) 0.90 0.15 0.03 0.76 (0.04) 0.94 0.17 0.03 0.76 (0.04) 0.95 0.18 0.03
MNAR 0.76 0.72 (0.04) 0.17 0.30 0.27 0.06 0.05 0.75 (0.04) 0.85 0.14 0.04 0.70 (0.07) 0.94 0.37 0.08 0.75 (0.04) 0.92 0.19 0.04
Scenario 16:{n = 300 πY* = 0.25 σY = 20}
MAR 0.85 0.80 (0.04) 0.54 0.04 0.03 0.07 0.86 (0.04) 0.95 0.15 0.03 0.83 (0.04) 0.66 0.18 0.08 0.84 (0.05) 0.98 0.21 0.03
MCAR 0.85 0.85 (0.03) 0.30 0.30 0.15 0.02 0.03 0.85 (0.04) 0.96 0.16 0.02 0.85 (0.04) 0.95 0.16 0.03 0.85 (0.04) 0.97 0.17 0.03
MNAR 0.85 0.81 (0.03) 0.23 0.30 0.09 0.03 0.05 0.85 (0.04) 0.95 0.15 0.03 0.76 (0.10) 0.95 0.52 0.12 0.85 (0.04) 0.97 0.17 0.03
Scenario 17:{n = 300 πY* = 0.50 σY = 20}
MAR 0.86 0.80 (0.04) 0.43 0.05 0.03 0.07 0.87 (0.03) 0.81 0.10 0.03 0.830 (0.04) 0.70 0.15 0.07 0.85 (0.04) 0.96 0.16 0.03
MCAR 0.86 0.86 (0.03) 0.30 0.30 0.19 0.01 0.02 0.85 (0.03) 0.92 0.12 0.02 0.85 (0.03) 0.94 0.13 0.02 0.85 (0.03) 0.96 0.14 0.02
MNAR 0.86 0.81 (0.03) 0.16 0.30 0.08 0.03 0.05 0.85 (0.03) 0.88 0.11 0.02 0.78 (0.08) 0.93 0.38 0.10 0.85 (0.03) 0.94 0.14 0.02

Notes: MM (missingness mechanism), TV (true value), CD (case deletion), SE (standard error), CR (coverage rate), AW (average width of confidence intervals), RMSE (root-mean-square error). CR and AW are based on 95% nominal confidence rate. CD(SE) column contains AUC estimate and estimate of its standard error under case deletion.