Table 5.
Monte Carlo distance between original and cloned behavior (lower is better).
| Model 1 | PFA | DT | PNN | KNN | RProp | NB |
|---|---|---|---|---|---|---|
| Walk | 0.854 | 0.866 | 0.962 | 0.866 | 4.836 | 4.797 |
| Rnd_Walk | 2.487 | 5.130 | 5.062 | 5.062 | - | - |
| Crash | 3.012 | 2.599 | 2.599 | 2.574 | 3.119 | 5.572 |
| Rnd_Crash | 3.067 | 3.853 | 3.762 | 3.823 | 3.343 | 3.767 |
| Zigzag | 2.261 | 3.497 | 3.608 | 3.497 | 3.316 | 4.324 |
| Rnd_Zigzag | 2.357 | 3.506 | 3.591 | 3.506 | 4.354 | 4.354 |
| Average | 2.340 | 3.242 | 3.264 | 3.221 | 3.794 | 4.563 |
| Model 2 | PFA | DT | PNN | KNN | RProp | NB |
| Walk | 6.165 | 7.072 | 7.274 | 6.718 | 6.159 | 6.033 |
| Rnd_Walk | 5.385 | 6.886 | 6.958 | 7.189 | 7.538 | 7.575 |
| Crash | 5.538 | 6.460 | 5.408 | 5.760 | 4.817 | - |
| Rnd_Crash | 4.750 | 5.157 | 5.602 | 5.757 | 4.912 | - |
| Zigzag | 4.818 | 4.191 | 4.501 | 4.336 | - | 7.663 |
| Rnd_Zigzag | 4.759 | 4.502 | 4.727 | 4.544 | 4.524 | 7.683 |
| Average | 5.236 | 5.711 | 5.745 | 5.718 | 5.590 | 7.239 |
| Model 3 | PFA | DT | PNN | KNN | RProp | NB |
| Walk | 6.961 | 8.082 | 7.953 | 7.524 | 6.955 | 6.830 |
| Rnd_Walk | 6.940 | 7.894 | 7.941 | 7.983 | 7.978 | 8.348 |
| Crash | 6.000 | 4.797 | 6.924 | 6.685 | 5.613 | 5.613 |
| Rnd_Crash | 5.470 | 4.986 | 6.324 | 5.325 | 5.708 | - |
| Zigzag | 5.914 | 4.561 | 5.324 | 4.903 | 5.871 | 8.460 |
| Rnd_Zigzag | 5.845 | 4.220 | 5.416 | 4.934 | 5.234 | 8.459 |
| Average | 6.188 | 5.757 | 6.647 | 6.226 | 6.227 | 7.542 |