Table 3.
Prediction Results based on Nonstandardized MLB Records (Accuracy: ACC; Precision PRE).
Models | ||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
LR |
RF |
XGBoot |
LightGBM |
CatBoost |
||||||||||||
CV | ACC | AUC | PRE | ACC | AUC | PRE | ACC | AUC | PRE | ACC | AUC | PRE | ACC | AUC | PRE | |
Pitcher | 1 | 0.286 | 0.311 | 0 | 0.714 | 0.311 | 0 | 0.714 | 0.622 | 0.667 | 0.643 | 0.578 | 0 | 0.5 | 0.556 | 0 |
2 | 0.462 | 0.425 | 0.25 | 0.538 | 0.5 | 0.25 | 0.462 | 0.425 | 0.25 | 0.692 | 0.575 | 0.667 | 0.462 | 0.425 | 0.25 | |
3 | 0.231 | 0.15 | 0 | 0.538 | 0.275 | 0 | 0.538 | 0.275 | 0.333 | 0.462 | 0.525 | 0.25 | 0.615 | 0.4 | 0.5 | |
4 | 0.462 | 0.375 | 0 | 0.615 | 0.575 | 0 | 0.692 | 0.5 | 0.667 | 0.462 | 0.425 | 0 | 0.692 | 0.625 | 1 | |
5 | 0.615 | 0.556 | 0.333 | 0.462 | 0.389 | 0 | 0.615 | 0.417 | 0.4 | 0.538 | 0.556 | 0.25 | 0.385 | 0.333 | 0 | |
Average | 0.411 | 0.363 | 0.117 | 0.574 | 0.410 | 0.05 | 0.604 | 0.448 | 0.463 | 0.559 | 0.532 | 0.233 | 0.531 | 0.468 | 0.35 | |
Batter | 1 | 0.667 | 0.25 | 0 | 0.556 | 0.139 | 0 | 0.444 | 0.25 | 0 | 0.667 | 0.5 | 0 | 0.556 | 0.25 | 0 |
2 | 0.444 | 0.556 | 0.25 | 0.333 | 0.25 | 0.25 | 0.333 | 0.333 | 0 | 0.667 | 0.5 | 0 | 0.444 | 0.167 | 0.25 | |
3 | 0.556 | 0.722 | 0.333 | 0.556 | 0.556 | 0 | 0.667 | 0.5 | 0.5 | 0.667 | 0.5 | 0 | 0.556 | 0.5 | 0 | |
4 | 0.444 | 0.278 | 0 | 0.556 | 0.333 | 0 | 0.667 | 0.444 | 0.5 | 0.667 | 0.5 | 0 | 0.556 | 0.444 | 0 | |
5 | 0.667 | 0.611 | 0.5 | 0.667 | 0.611 | 0.5 | 0.444 | 0.556 | 0.25 | 0.667 | 0.5 | 0 | 0.667 | 0.5 | 0.5 | |
Average | 0.556 | 0.483 | 0.217 | 0.533 | 0.378 | 0.15 | 0.511 | 0.417 | 0.25 | 0.667 | 0.5 | 0 | 0.556 | 0.372 | 0.15 |