Table 1.
Simulation study comparing the standard CRM, EM-CRM with a single skeleton, and EM-CRM with three skeletons coupled with model selection (EM-CRMSEL), and model averaging (EM-CRMAVG)
Design | Recommendation percentage at dose level |
Average # toxicity |
Average # patients |
Average duration |
||||||
---|---|---|---|---|---|---|---|---|---|---|
1 | 2 | 3 | 4 | 5 | 6 | None | ||||
Scenario 1 | 0.08 | 0.10 | 0.12 | 0.30 | 0.50 | 0.60 | ||||
CRM 1 | 0.1 | 2.9 | 24.4 | 49.2 | 20.5 | 2.9 | 0.1 | 10.3 | 36.0 | 37.0 |
# patients | 4.1 | 4.2 | 6.8 | 10.2 | 7.0 | 3.7 | ||||
EM-CRM 1 | 0.1 | 4.5 | 23.9 | 43.7 | 23.2 | 4.6 | 0.1 | 10.1 | 36.0 | 20.7 |
# patients | 4.9 | 4.7 | 6.8 | 8.8 | 6.9 | 3.9 | ||||
CRM 2 | 0.0 | 0.2 | 12.7 | 68.2 | 18.1 | 0.8 | 0.0 | 9.6 | 36.0 | 37.0 |
# patients | 4.1 | 3.6 | 6.5 | 14.2 | 6.2 | 1.3 | ||||
EM-CRM 2 | 0.0 | 0.3 | 12.7 | 66.3 | 19.9 | 0.7 | 0.1 | 9.4 | 36.0 | 20.8 |
# patients | 4.6 | 3.7 | 7.4 | 12.7 | 6.1 | 1.5 | ||||
CRM 3 | 0.0 | 0.6 | 13.4 | 67.0 | 18.4 | 0.6 | 0.1 | 9.4 | 36.0 | 37.0 |
# patients | 4.2 | 3.7 | 6.7 | 14.0 | 6.4 | 0.9 | ||||
EM-CRM 3 | 0.1 | 0.8 | 13.1 | 65.5 | 19.8 | 0.7 | 0.1 | 9.1 | 36.0 | 20.8 |
# patients | 4.9 | 4.1 | 7.4 | 12.6 | 6.0 | 1.0 | ||||
EM-CRMSEL | 0.0 | 0.6 | 13.2 | 65.4 | 18.8 | 1.8 | 0.1 | 9.6 | 36.0 | 20.7 |
# patients | 4.8 | 3.8 | 6.9 | 12.0 | 6.5 | 1.9 | ||||
EM-CRMAVG | 0.1 | 0.8 | 13.2 | 64.0 | 20.7 | 1.0 | 0.3 | 9.5 | 35.9 | 20.7 |
# patients | 4.8 | 3.9 | 7.2 | 11.6 | 6.6 | 1.8 | ||||
Scenario 2 | 0.06 | 0.08 | 0.10 | 0.15 | 0.30 | 0.45 | ||||
CRM 1 | 0.0 | 0.3 | 3.1 | 18.3 | 39.9 | 38.4 | 0.0 | 9.3 | 36.0 | 37.0 |
# patients | 3.8 | 3.5 | 3.7 | 5.5 | 8.1 | 11.4 | ||||
EM-CRM 1 | 0.0 | 0.4 | 3.3 | 17.0 | 36.9 | 42.3 | 0.0 | 9.0 | 36.0 | 21.8 |
# patients | 4.3 | 3.6 | 3.9 | 5.6 | 7.6 | 11.0 | ||||
CRM 2 | 0.0 | 0.0 | 0.9 | 17.8 | 57.0 | 24.3 | 0.0 | 8.3 | 36.0 | 37.0 |
# patients | 3.7 | 3.3 | 4.0 | 7.1 | 10.9 | 7.0 | ||||
EM-CRM 2 | 0.0 | 0.1 | 1.4 | 17.0 | 57.2 | 24.4 | 0.0 | 7.9 | 36.0 | 21.7 |
# patients | 4.1 | 3.4 | 4.6 | 7.5 | 10.3 | 6.1 | ||||
CRM 3 | 0.0 | 0.1 | 1.6 | 18.8 | 59.6 | 19.9 | 0.0 | 8.1 | 36.0 | 37.0 |
# patients | 3.8 | 3.4 | 4.1 | 7.4 | 11.6 | 5.7 | ||||
EM-CRM 3 | 0.0 | 0.2 | 2.0 | 17.6 | 59.2 | 21.0 | 0.0 | 7.7 | 36.0 | 21.7 |
# patients | 4.2 | 3.5 | 4.8 | 7.8 | 10.6 | 5.2 | ||||
EM-CRMSEL | 0.0 | 0.1 | 1.5 | 17.1 | 54.4 | 26.8 | 0.0 | 8.3 | 36.0 | 21.7 |
# patients | 4.2 | 3.4 | 4.2 | 6.8 | 9.8 | 7.5 | ||||
EM-CRMAVG | 0.0 | 0.1 | 1.3 | 15.8 | 55.8 | 26.8 | 0.1 | 8.2 | 36.0 | 21.7 |
# patients | 4.2 | 3.4 | 4.5 | 6.7 | 9.9 | 7.3 | ||||
Scenario 3 | 0.05 | 0.14 | 0.18 | 0.22 | 0.26 | 0.30 | ||||
CRM 1 | 0.0 | 1.6 | 6.0 | 11.9 | 18.1 | 62.5 | 0.0 | 7.9 | 36.0 | 37.0 |
# patients | 3.8 | 4.4 | 4.9 | 5.0 | 5.6 | 12.2 | ||||
EM-CRM 1 | 0.0 | 1.7 | 5.2 | 12.6 | 18.3 | 62.1 | 0.0 | 7.8 | 36.0 | 20.9 |
# patients | 4.2 | 4.5 | 5.0 | 5.5 | 5.5 | 11.3 | ||||
CRM 2 | 0.0 | 0.9 | 8.4 | 24.7 | 30.6 | 35.4 | 0.0 | 7.5 | 36.0 | 37.0 |
# patients | 3.8 | 4.0 | 6.4 | 8.1 | 7.1 | 6.6 | ||||
EM-CRM 2 | 0.0 | 1.0 | 9.5 | 25.6 | 31.8 | 32.1 | 0.0 | 7.3 | 36.0 | 20.9 |
# patients | 4.1 | 4.1 | 7.0 | 8.3 | 6.9 | 5.5 | ||||
CRM 3 | 0.0 | 1.3 | 8.7 | 26.1 | 34.5 | 29.4 | 0.0 | 7.4 | 36.0 | 37.0 |
# patients | 3.8 | 4.2 | 6.3 | 8.5 | 7.8 | 5.5 | ||||
EM-CRM 3 | 0.0 | 1.4 | 10.1 | 28.0 | 35.0 | 25.6 | 0.0 | 7.2 | 36.0 | 20.8 |
# patients | 4.3 | 4.4 | 7.2 | 8.7 | 7.1 | 4.3 | ||||
EM-CRMSEL | 0.0 | 1.0 | 7.4 | 18.7 | 25.1 | 47.7 | 0.0 | 7.5 | 36.0 | 20.9 |
# patients | 4.2 | 4.3 | 5.9 | 6.9 | 6.4 | 8.3 | ||||
EM-CRMAVG | 0.0 | 0.9 | 8.1 | 21.9 | 29.3 | 39.8 | 0.1 | 7.4 | 36.0 | 20.9 |
# patients | 4.2 | 4.3 | 6.5 | 7.1 | 6.8 | 7.0 | ||||
Scenario 4 | 0.20 | 0.30 | 0.40 | 0.50 | 0.60 | 0.70 | ||||
CRM 1 | 25.4 | 50.8 | 17.7 | 4.0 | 0.4 | 0.0 | 1.7 | 10.8 | 35.5 | 36.6 |
# patients | 13.4 | 12.5 | 6.0 | 2.6 | 0.8 | 0.2 | ||||
EM-CRM 1 | 25.6 | 50.3 | 16.4 | 4.3 | 0.7 | 0.0 | 2.7 | 10.5 | 35.3 | 18.1 |
# patients | 15.0 | 10.9 | 5.3 | 2.8 | 1.0 | 0.3 | ||||
CRM 2 | 20.9 | 44.9 | 28.2 | 4.3 | 0.1 | 0.0 | 1.7 | 10.9 | 35.5 | 36.6 |
# patients | 12.1 | 11.8 | 8.8 | 2.5 | 0.4 | 0.0 | ||||
EM-CRM 2 | 21.1 | 43.8 | 27.8 | 4.1 | 0.2 | 0.0 | 3.0 | 10.6 | 35.2 | 18.1 |
# patients | 13.6 | 10.7 | 8.0 | 2.3 | 0.5 | 0.1 | ||||
CRM 3 | 22.1 | 48.2 | 24.2 | 3.7 | 0.2 | 0.0 | 1.6 | 10.7 | 35.5 | 36.6 |
# patients | 12.8 | 12.3 | 7.8 | 2.2 | 0.3 | 0.0 | ||||
EM-CRM 3 | 21.6 | 47.9 | 24.1 | 3.5 | 0.1 | 0.0 | 2.9 | 10.4 | 35.2 | 18.2 |
# patients | 14.2 | 11.3 | 7.1 | 2.3 | 0.4 | 0.0 | ||||
EM-CRMSEL | 21.9 | 46.4 | 24.3 | 4.2 | 0.4 | 0.0 | 2.8 | 10.7 | 35.2 | 18.2 |
# patients | 14.0 | 10.7 | 7.1 | 2.6 | 0.7 | 0.1 | ||||
EM-CRMAVG | 20.4 | 46.1 | 23.9 | 4.0 | 0.2 | 0.0 | 5.4 | 10.4 | 34.5 | 17.9 |
# patients | 13.6 | 10.9 | 7.0 | 2.4 | 0.6 | 0.1 | ||||
Scenario 5 | 0.08 | 0.12 | 0.20 | 0.30 | 0.40 | 0.50 | ||||
CRM 1 | 0.1 | 5.3 | 22.5 | 35.5 | 25.6 | 11.0 | 0.1 | 10.0 | 36.0 | 37.0 |
# patients | 4.2 | 4.9 | 6.9 | 8.1 | 6.7 | 5.0 | ||||
EM-CRM 1 | 0.1 | 6.0 | 21.1 | 34.4 | 25.6 | 12.7 | 0.1 | 9.7 | 36.0 | 20.5 |
# patients | 4.9 | 5.2 | 6.6 | 7.6 | 6.6 | 5.0 | ||||
CRM 2 | 0.0 | 1.3 | 20.9 | 49.1 | 24.3 | 4.3 | 0.0 | 9.3 | 36.0 | 37.0 |
# patients | 4.2 | 4.2 | 8.4 | 11.3 | 6.0 | 2.0 | ||||
EM-CRM 2 | 0.0 | 1.7 | 21.8 | 47.6 | 24.5 | 4.3 | 0.1 | 9.0 | 36.0 | 20.4 |
# patients | 4.7 | 4.4 | 9.0 | 10.3 | 5.7 | 1.9 | ||||
CRM 3 | 0.1 | 1.9 | 22.0 | 49.3 | 23.9 | 2.9 | 0.0 | 9.1 | 36.0 | 37.0 |
# patients | 4.2 | 4.4 | 8.5 | 11.2 | 6.2 | 1.4 | ||||
EM-CRM 3 | 0.1 | 2.6 | 22.5 | 48.1 | 23.6 | 3.1 | 0.1 | 8.8 | 36.0 | 20.4 |
# patients | 5.0 | 4.9 | 8.9 | 10.4 | 5.5 | 1.4 | ||||
EM-CRMSEL | 0.1 | 2.0 | 20.0 | 46.0 | 25.3 | 6.5 | 0.1 | 9.3 | 36.0 | 20.4 |
# patients | 4.9 | 4.6 | 7.8 | 9.5 | 6.3 | 2.8 | ||||
EM-CRMAVG | 0.1 | 2.0 | 20.1 | 45.2 | 27.4 | 5.0 | 0.3 | 9.1 | 35.9 | 20.3 |
# patients | 4.9 | 4.7 | 8.2 | 9.3 | 6.3 | 2.4 | ||||
Scenario 6 | 0.05 | 0.10 | 0.30 | 0.50 | 0.60 | 0.70 | ||||
CRM 1 | 0.1 | 23.7 | 54.9 | 19.6 | 1.7 | 0.0 | 0.0 | 10.9 | 36.0 | 37.0 |
# patients | 3.8 | 8.4 | 12.5 | 7.8 | 2.7 | 0.8 | ||||
EM-CRM 1 | 0.4 | 27.1 | 47.9 | 22.0 | 2.3 | 0.1 | 0.0 | 10.9 | 36.0 | 20.5 |
# patients | 4.4 | 8.9 | 10.5 | 7.6 | 3.5 | 1.1 | ||||
CRM 2 | 0.0 | 9.0 | 70.1 | 20.2 | 0.7 | 0.0 | 0.0 | 10.9 | 36.0 | 37.0 |
# patients | 3.7 | 5.7 | 16.4 | 8.4 | 1.5 | 0.2 | ||||
EM-CRM 2 | 0.1 | 8.4 | 69.6 | 21.1 | 0.8 | 0.0 | 0.0 | 10.8 | 36.0 | 20.4 |
# patients | 4.2 | 6.4 | 15.0 | 8.2 | 1.9 | 0.3 | ||||
CRM 3 | 0.0 | 9.8 | 69.8 | 19.7 | 0.7 | 0.0 | 0.0 | 10.8 | 36.0 | 37.0 |
# patients | 3.7 | 6.1 | 16.4 | 8.2 | 1.5 | 0.1 | ||||
EM-CRM 3 | 0.0 | 9.3 | 68.0 | 21.9 | 0.8 | 0.0 | 0.0 | 10.6 | 36.0 | 20.4 |
# patients | 4.2 | 6.8 | 15.1 | 8.1 | 1.6 | 0.2 | ||||
EM-CRMSEL | 0.0 | 9.8 | 68.3 | 20.9 | 0.9 | 0.1 | 0.0 | 10.9 | 36.0 | 20.5 |
# patients | 4.2 | 6.9 | 14.2 | 8.1 | 2.3 | 0.5 | ||||
EM-CRMAVG | 0.0 | 11.0 | 66.0 | 22.0 | 0.9 | 0.0 | 0.1 | 10.8 | 36.0 | 20.5 |
# patients | 4.2 | 6.9 | 14.1 | 7.9 | 2.5 | 0.4 | ||||
Scenario 7 | 0.02 | 0.03 | 0.04 | 0.05 | 0.30 | 0.50 | ||||
CRM 1 | 0.0 | 0.0 | 1.4 | 15.9 | 46.2 | 36.5 | 0.0 | 9.8 | 36.0 | 37.0 |
# patients | 3.2 | 3.0 | 3.1 | 4.7 | 8.1 | 13.8 | ||||
EM-CRM 1 | 0.0 | 0.0 | 2.0 | 14.1 | 43.2 | 40.7 | 0.0 | 9.6 | 36.0 | 23.9 |
# patients | 3.4 | 3.1 | 3.2 | 4.8 | 8.1 | 13.2 | ||||
CRM 2 | 0.0 | 0.0 | 0.0 | 7.0 | 66.3 | 26.7 | 0.0 | 9.1 | 36.0 | 37.0 |
# patients | 3.2 | 3.0 | 3.1 | 4.5 | 12.1 | 10.0 | ||||
EM-CRM 2 | 0.0 | 0.0 | 0.0 | 6.1 | 65.3 | 28.5 | 0.0 | 8.8 | 36.0 | 23.9 |
# patients | 3.3 | 3.0 | 3.3 | 5.0 | 11.9 | 9.4 | ||||
CRM 3 | 0.0 | 0.0 | 0.0 | 5.9 | 70.0 | 24.1 | 0.0 | 8.9 | 36.0 | 37.0 |
# patients | 3.2 | 3.0 | 3.1 | 4.5 | 13.3 | 8.9 | ||||
EM-CRM 3 | 0.0 | 0.0 | 0.0 | 4.6 | 69.5 | 25.9 | 0.0 | 8.6 | 36.0 | 23.9 |
# patients | 3.3 | 3.0 | 3.3 | 5.0 | 13.0 | 8.3 | ||||
EM-CRMSEL | 0.0 | 0.0 | 0.0 | 5.3 | 68.9 | 25.8 | 0.0 | 8.9 | 36.0 | 23.9 |
# patients | 3.4 | 3.0 | 3.1 | 4.9 | 12.2 | 9.4 | ||||
EM-CRMAVG | 0.0 | 0.0 | 0.1 | 5.8 | 65.9 | 28.2 | 0.0 | 9.0 | 36.0 | 23.9 |
# patients | 3.4 | 3.0 | 3.3 | 4.7 | 11.5 | 10.1 | ||||
Scenario 8 | 0.50 | 0.60 | 0.70 | 0.80 | 0.85 | 0.90 | ||||
CRM 1 | 18.5 | 0.1 | 0.0 | 0.0 | 0.0 | 0.0 | 81.4 | 9.5 | 18.7 | 21.8 |
# patients | 17.5 | 1.0 | 0.2 | 0.0 | 0.0 | 0.0 | ||||
EM-CRM 1 | 16.3 | 0.1 | 0.0 | 0.0 | 0.0 | 0.0 | 83.6 | 8.8 | 17.3 | 9.4 |
# patients | 15.7 | 1.2 | 0.3 | 0.1 | 0.0 | 0.0 | ||||
CRM 2 | 16.7 | 0.2 | 0.0 | 0.0 | 0.0 | 0.0 | 83.1 | 9.4 | 18.4 | 21.5 |
# patients | 17.0 | 1.2 | 0.2 | 0.0 | 0.0 | 0.0 | ||||
EM-CRM 2 | 14.0 | 0.2 | 0.0 | 0.0 | 0.0 | 0.0 | 85.8 | 8.6 | 16.7 | 9.1 |
# patients | 15.0 | 1.4 | 0.3 | 0.0 | 0.0 | 0.0 | ||||
CRM 3 | 18.7 | 0.1 | 0.0 | 0.0 | 0.0 | 0.0 | 81.2 | 9.4 | 18.6 | 21.7 |
# patients | 17.4 | 1.1 | 0.2 | 0.0 | 0.0 | 0.0 | ||||
EM-CRM 3 | 14.8 | 0.1 | 0.0 | 0.0 | 0.0 | 0.0 | 85.1 | 8.7 | 17.0 | 9.2 |
# patients | 15.5 | 1.2 | 0.3 | 0.0 | 0.0 | 0.0 | ||||
EM-CRMSEL | 14.8 | 0.2 | 0.0 | 0.0 | 0.0 | 0.0 | 85.1 | 8.6 | 16.8 | 9.2 |
# patients | 15.1 | 1.3 | 0.3 | 0.1 | 0.0 | 0.0 | ||||
EM-CRMAVG | 10.6 | 0.1 | 0.0 | 0.0 | 0.0 | 0.0 | 89.3 | 7.4 | 14.4 | 8.3 |
# patients | 12.9 | 1.2 | 0.3 | 0.0 | 0.0 | 0.0 |